-- Logs begin at Wed 2022-09-07 12:19:18 UTC, end at Wed 2022-09-07 13:26:27 UTC. -- Sep 07 12:52:11.283627 dv-cinder-853315-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 07 12:52:11.296331 dv-cinder-853315-7-smb devstack@keystone.service[104906]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 07 12:52:11.298974 dv-cinder-853315-7-smb devstack@keystone.service[104906]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 12:52:11 2022] *** Sep 07 12:52:11.298974 dv-cinder-853315-7-smb devstack@keystone.service[104906]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 12:52:11.298974 dv-cinder-853315-7-smb devstack@keystone.service[104906]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 12:52:11.298974 dv-cinder-853315-7-smb devstack@keystone.service[104906]: nodename: dv-cinder-853315-7-smb Sep 07 12:52:11.298974 dv-cinder-853315-7-smb devstack@keystone.service[104906]: machine: x86_64 Sep 07 12:52:11.298974 dv-cinder-853315-7-smb devstack@keystone.service[104906]: clock source: unix Sep 07 12:52:11.298974 dv-cinder-853315-7-smb devstack@keystone.service[104906]: pcre jit disabled Sep 07 12:52:11.298974 dv-cinder-853315-7-smb devstack@keystone.service[104906]: detected number of CPU cores: 4 Sep 07 12:52:11.298974 dv-cinder-853315-7-smb devstack@keystone.service[104906]: current working directory: / Sep 07 12:52:11.298974 dv-cinder-853315-7-smb devstack@keystone.service[104906]: detected binary path: /usr/bin/uwsgi-core Sep 07 12:52:11.298974 dv-cinder-853315-7-smb devstack@keystone.service[104906]: your processes number limit is 47680 Sep 07 12:52:11.298974 dv-cinder-853315-7-smb devstack@keystone.service[104906]: your memory page size is 4096 bytes Sep 07 12:52:11.298974 dv-cinder-853315-7-smb devstack@keystone.service[104906]: detected max file descriptor number: 2048 Sep 07 12:52:11.298974 dv-cinder-853315-7-smb devstack@keystone.service[104906]: lock engine: pthread robust mutexes Sep 07 12:52:11.300179 dv-cinder-853315-7-smb devstack@keystone.service[104906]: thunder lock: enabled Sep 07 12:52:11.300179 dv-cinder-853315-7-smb devstack@keystone.service[104906]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 07 12:52:11.300179 dv-cinder-853315-7-smb devstack@keystone.service[104906]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 12:52:11.349447 dv-cinder-853315-7-smb devstack@keystone.service[104906]: Python main interpreter initialized at 0x56110380b9c0 Sep 07 12:52:11.349447 dv-cinder-853315-7-smb devstack@keystone.service[104906]: python threads support enabled Sep 07 12:52:11.349447 dv-cinder-853315-7-smb devstack@keystone.service[104906]: your server socket listen backlog is limited to 100 connections Sep 07 12:52:11.349447 dv-cinder-853315-7-smb devstack@keystone.service[104906]: your mercy for graceful operations on workers is 90 seconds Sep 07 12:52:11.349959 dv-cinder-853315-7-smb devstack@keystone.service[104906]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 12:52:11.350071 dv-cinder-853315-7-smb devstack@keystone.service[104906]: *** Operational MODE: preforking *** Sep 07 12:52:11.350410 dv-cinder-853315-7-smb devstack@keystone.service[104906]: *** uWSGI is running in multiple interpreter mode *** Sep 07 12:52:11.350410 dv-cinder-853315-7-smb devstack@keystone.service[104906]: spawned uWSGI master process (pid: 104906) Sep 07 12:52:11.350796 dv-cinder-853315-7-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 07 12:52:11.352554 dv-cinder-853315-7-smb devstack@keystone.service[104906]: spawned uWSGI worker 1 (pid: 104921, cores: 1) Sep 07 12:52:11.352554 dv-cinder-853315-7-smb devstack@keystone.service[104906]: spawned uWSGI worker 2 (pid: 104922, cores: 1) Sep 07 12:52:11.352554 dv-cinder-853315-7-smb devstack@keystone.service[104906]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 12:52:17.667565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:52:17.667565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: from cryptography.utils import int_from_bytes Sep 07 12:52:17.668896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:52:17.668896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: from cryptography.utils import int_from_bytes Sep 07 12:52:17.669629 dv-cinder-853315-7-smb devstack@keystone.service[104922]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:52:17.669629 dv-cinder-853315-7-smb devstack@keystone.service[104922]: from cryptography.utils import int_from_bytes Sep 07 12:52:17.669818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:52:17.669818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: from cryptography.utils import int_from_bytes Sep 07 12:52:17.730559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 12:52:17.730864 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 12:52:17.731008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] command line args: [] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 12:52:17.731170 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 12:52:17.731316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ================================================================================ {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 12:52:17.731578 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] admin_token = **** {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.731827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] config_dir = [] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.732012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.732247 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] config_source = [] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.732624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] debug = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.732807 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.733300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.733432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] insecure_debug = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.734668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.734668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.734668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] list_limit = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.734668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] log_config_append = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.734668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.734668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] log_dir = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.735296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] log_file = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.735296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.735502 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.735904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.736340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.736699 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.737014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.737467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.737903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.738336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.738769 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.739107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.739253 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 12:52:17.739380 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.739508 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 12:52:17.739768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] command line args: [] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 12:52:17.739897 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.740024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 12:52:17.740142 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ================================================================================ {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 12:52:17.740268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] notification_format = cadf {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.740438 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] admin_token = **** {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.740936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] config_dir = [] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.741089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.741283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.741283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] config_source = [] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.741283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] debug = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.741283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.741887 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.741887 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] insecure_debug = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.742099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.742237 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.742352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] publish_errors = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.742505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.742505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] list_limit = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.742711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.742839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] log_config_append = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.742839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.743056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.743171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] log_dir = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.743171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] log_file = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.743385 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.743518 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.743635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.743758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.743880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.743992 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.744114 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.744250 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.744401 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] standard_threads = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.744523 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.744655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] strict_password_check = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.744756 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.744878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.745004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.745119 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.745262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] use_eventlog = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.745391 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.745504 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] use_journal = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.745625 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.745750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] use_json = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.745872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.745987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.746197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] use_stderr = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.746327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] notification_format = cadf {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.746443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] use_syslog = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.746555 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.746677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] watch_log_file = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.746895 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.747061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.747061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] publish_errors = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.747310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.747432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.747552 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.747694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.747812 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.747919 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.748031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.748165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.748307 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.748529 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] standard_threads = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.748670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.748811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] strict_password_check = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.748939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.749066 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.749066 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] use_eventlog = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.749598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.749721 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] use_journal = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.749829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.749935 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] use_json = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.749935 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] use_stderr = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.750141 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.750262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] use_syslog = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.750373 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.750481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] watch_log_file = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:52:17.750597 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.750705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.750833 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.750972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.751098 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.751220 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.751335 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.751449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.751567 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.751805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.751949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.752074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.752199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.752330 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.752330 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.752621 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.752754 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.752881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.753012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.753149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.753287 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.753287 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.753533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.753663 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.753663 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.753911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.754056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.754181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.754398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.754524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.754655 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.754772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.754897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.755025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.755203 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.755350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.755469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.755650 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.755803 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.755988 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.756113 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.756329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.756543 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.756742 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.756888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.757001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.757109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.757231 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.757340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.757458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.757598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.757725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.757865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.757994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.758126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.758294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.758685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.758839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.758963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.759095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.759223 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.759353 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.759491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.759608 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.759717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.759833 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.759946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.760071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.760193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.760300 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.760300 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.760543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.760651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.760771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.760890 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.761003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.761113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.761223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.761331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.761541 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.761815 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.762033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.762187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.762187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.762490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.762624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.762755 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.762960 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.763149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.763340 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.763528 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.763697 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.763826 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.763939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.764089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.764228 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.764345 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.764545 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.764706 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.764837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.765016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.765209 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.765433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.765576 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.765760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.765950 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.766130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.766267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.766452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.766582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.766697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.766874 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.766990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.767110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.767285 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.767409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.767409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.767694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.767824 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.767944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.768126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.768126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.768466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.768630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.768630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.768870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.769005 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.769185 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.769318 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.769454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.769575 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.769765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.769892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.770026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.770026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.enabled = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.770273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.770416 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.770560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.770787 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.770920 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.771194 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.771348 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.771603 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.771742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.772085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.enabled = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.772237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.772502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.772730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.772910 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.773046 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.773300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.773438 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.773562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.773816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.773941 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.774143 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.774276 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.774529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.774659 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.774799 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.774925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.775061 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.775331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.775532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.775676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.775818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.776002 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.776151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.776521 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.776667 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.776894 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.777042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.777306 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.777449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.777742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.777876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.778045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.778173 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.778310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.778517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.778644 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.778745 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.778907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.779101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.779289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.779411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.779592 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.779722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.779855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.779969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.780131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.780299 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.780447 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.780941 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] auth.external = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.781091 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.781209 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] auth.mapped = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.781335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.781452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.781563 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.781710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.781832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.782079 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] auth.password = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.782303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.782464 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] auth.token = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.782638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.782778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.782778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] catalog.caching = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.783029 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.783180 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.783297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.783451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.783586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.783731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.783866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.784000 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.784135 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.784284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] auth.external = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.784456 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] credential.caching = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.784579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] auth.mapped = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.784712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] credential.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.784712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.784956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.785113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.785251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.785387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.785599 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] auth.password = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.785737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.785884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] auth.token = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.786020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.786155 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.786290 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.786449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] catalog.caching = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.786555 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.786682 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.786817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.786950 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.787083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.787217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.787350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.787499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.787751 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.787889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.788024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.788156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] credential.caching = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.788289 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.788467 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] credential.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.788467 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.788968 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.789105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.789105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.789105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.789470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] federation.caching = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.789606 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.789726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.789871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.790004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] federation.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.790151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.790297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.790432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.790577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.790711 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.790846 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.790978 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.791133 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.791266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.791398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.791534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.791664 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.791797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.792054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.792196 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.792331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.792493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] federation.caching = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.792625 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.792761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.792920 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity.caching = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.793056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] federation.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.793193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.793328 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.793463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.793597 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.793737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.793872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.794007 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.794138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.794270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.794386 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.794524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.794524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.794741 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.794741 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.794952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.795087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.795087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.795342 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.795473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity.caching = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.795735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.795873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.796009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.796200 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.796330 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.796489 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.796624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.796759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.796900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.797030 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.797030 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.797275 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.797408 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.797535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.797682 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.797817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.797951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.798085 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.798219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.798353 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.798498 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.798766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.798908 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.799182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.799324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.799659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.799819 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.800009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.800152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.800469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.800630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.800891 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.801387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.801387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.801643 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.801778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.801908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.802361 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.802510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.802647 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.802786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.802917 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.803030 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.803145 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.803548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.803718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.803856 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.804217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.804365 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.804648 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.804648 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.805492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.805632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.805750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.805868 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.805986 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.806089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.806089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.806973 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.password = **** {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.807078 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.807178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.807286 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.807401 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.807871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.807871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.password = **** {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.808066 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.808166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.808166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.808359 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.808499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.808499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.808654 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.808738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.808738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.808906 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.809000 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.809000 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.809116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.809175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.809469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.809594 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.809697 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.809937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.810042 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.810177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.810414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.810542 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.810645 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.810856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.810963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.811114 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.811284 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.811391 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.811575 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.811715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.811821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.812054 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.812180 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.812283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.812542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.812626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.812766 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.812995 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.813080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.813230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.813474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.813557 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.813806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.813876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.814104 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.814342 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.814420 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.814651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.814870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.814962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.815221 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.815300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.815545 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.815678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.815840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.816085 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.816218 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.816328 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.816550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.816634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.816830 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.816968 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.817093 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.817638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.817770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.817972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] policy.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.818110 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.818230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.818230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.818439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.818518 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.818518 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] receipt.caching = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.818701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.818820 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.818968 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.819177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.819281 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.819439 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.819626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.819750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.819899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] resource.caching = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.820166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.820297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.820500 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] resource.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.821231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.826791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.826791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.829150 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.829290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.829429 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.829564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] revoke.caching = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.829564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.829816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.829944 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.829944 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] role.cache_time = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.830240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.830370 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] role.caching = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.830500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.830754 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] role.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.830886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.831013 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] role.list_limit = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.831144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.831273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.831273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.831519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.831653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.831653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.831887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] policy.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.832016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.832147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.832290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.832435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.832568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.832693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.832848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.832964 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] receipt.caching = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.833100 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.833230 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.833359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.833359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.833596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.833742 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.833742 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.833981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.834106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.834236 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.834361 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.834502 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.834631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.834631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.834631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.834631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.835061 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] resource.caching = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.835188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.835188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.835188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.835188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.835188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.835188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.835188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.835188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.835188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.836022 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.836149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.836275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.836452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] resource.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.836577 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.836693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.836809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] token.cache_time = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.836922 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.837046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] token.caching = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.837046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.837265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.837375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] token.provider = fernet {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.837476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] revoke.caching = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.837565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.837628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.837721 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.837814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.837878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.837937 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] role.cache_time = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.838026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.838143 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] role.caching = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.838282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.838403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] role.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.838526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.838526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] trust.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.838754 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] role.list_limit = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.838878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.839013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.839138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.839138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.839369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.839494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.839588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.839706 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.839706 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.839945 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.840093 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.840093 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.840325 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.840587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.connection = **** {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.840737 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.840866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.840996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.841123 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.841250 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.841372 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.841514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.841643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.841768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.841970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.842103 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.842231 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.842435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.842592 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.842718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.842880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.843013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.843135 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.843338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.843477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.843605 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.843790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.843923 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.844045 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.844236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.844495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.844636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.844769 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=104921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 12:52:17.844978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.845436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.845960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.846337 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.846789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.847227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.847697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.848231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.848638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.849101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.849511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.849943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.850479 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.850961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.851424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.851960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.852283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.852758 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] token.cache_time = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.853507 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] token.caching = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.853707 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.854061 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] token.provider = fernet {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.854508 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.854981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.855439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.855890 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.856354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.856828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.857263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] trust.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.857708 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.858154 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.858595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.859046 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.859544 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.859975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.860461 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.860956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.861443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.connection = **** {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.861904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.862368 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.862813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.863268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.863705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.864140 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.864625 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.865074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.865532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.866040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.866499 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.866944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.867404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.867842 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.868301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.868771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.869193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.869627 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:52:17.869937 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=104922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 12:52:17.879138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:17.879399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:17.879574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:17.890907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:17.945733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:17.945938 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:17.946027 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:17.946105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:17.946180 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:17.954970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:17.996517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:17.996892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.007556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.072338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.092131 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.092483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.143905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.144233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.274942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.275232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.275421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.275559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.275798 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.276010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.307866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.308159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.308412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.308694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.308973 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.309210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.309508 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.322876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.340581 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.340945 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.341218 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.341571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.341924 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.342239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.342508 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=104921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.361662 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.361876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 12:52:18.362209 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.362409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 12:52:18.362713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.362972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.363236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.363494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.369878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.370256 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.370632 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.371013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.371381 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.371764 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.373903 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.374422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.374642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.374916 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.383163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.386412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.386733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.387022 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.387324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.387607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.387866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.388108 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.388510 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.388783 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.389520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.389656 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.396712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.397012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.397859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.398212 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.398531 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.399118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.399461 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.415982 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.418203 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.419717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.420091 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.421703 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.422091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.422464 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.422833 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.423197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.423545 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.423931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=104922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:52:18.424927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.425250 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.425593 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.432151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.432490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.438537 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.438847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.439141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.439423 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.439776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.440067 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.440521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.440958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.443072 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.443404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 12:52:18.444108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.444509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 12:52:18.444956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.445406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.445857 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.446297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.460005 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.460296 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.465343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.465842 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.466236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.466393 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.466782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.469652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.469960 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.474303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.477649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.480930 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.481110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.481246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.481511 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.481796 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.482086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.482376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.486793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.487295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.487778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.488266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.488779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.489246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.489698 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.490174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.490664 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.491164 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.491679 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.499758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.500039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.500339 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.500609 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.509439 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.511861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.513469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.513744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.516410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.516800 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.517073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.517359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.517839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.531865 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.532102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.532338 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.532641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.533037 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.533324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.533608 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.534031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.536846 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.537347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.546346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.546822 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.547298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.551519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.555366 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.558719 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.560399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.560553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.560896 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.562379 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.562747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.563236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.568525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.569099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.569606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.570087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.571028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.571773 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.573924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.574498 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.574681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.574981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.579028 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.579473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.579759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.580038 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.589458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.589813 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.590094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.599137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=104921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.599436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.599745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.600089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.601208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.601208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.601505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.601862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.602181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.602645 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.603143 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.603585 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.603955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.604223 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.604410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=104921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.604752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.612117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.618183 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.618706 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.627157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.633105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.638843 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.639363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.639842 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.640533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.641014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.641602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.643504 dv-cinder-853315-7-smb devstack@keystone.service[104921]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56110380b9c0 pid: 104921 (default app) Sep 07 12:52:18.647982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f19528-10d2-4504-b14c-f1d6705aa7c0 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:18.648280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f19528-10d2-4504-b14c-f1d6705aa7c0 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:18.648580 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f19528-10d2-4504-b14c-f1d6705aa7c0 None None] PATH_INFO: `/v3` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:18.653151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Wed Sep 7 12:52:18 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:18.673404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.674197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.674343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.674672 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.683228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.685064 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.686646 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.686925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.689643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.689925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.690216 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.690517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.690790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.703333 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.703737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.704101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.704521 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.704889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.705280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.705663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.725511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.730146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.733542 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.735341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.737471 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.737897 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.738379 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.747217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.749488 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.753107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.753570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.753921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.754303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.765469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.765781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.766065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.773651 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=104922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:52:18.773951 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.774290 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.774568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.774844 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.775128 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.775404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.775684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.775953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.776232 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.776545 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.776816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.777083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.777353 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=104922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:52:18.815034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56110380b9c0 pid: 104922 (default app) Sep 07 12:52:26.249235 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da8d9a-5012-45d5-bfdc-72b7d165bd5f None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:26.250107 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da8d9a-5012-45d5-bfdc-72b7d165bd5f None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:26.250107 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da8d9a-5012-45d5-bfdc-72b7d165bd5f None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:26.251093 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:52:26.266232 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915f7a5-7ff9-411f-90ca-3d8bb9624954 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:26.266884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915f7a5-7ff9-411f-90ca-3d8bb9624954 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:26.267134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915f7a5-7ff9-411f-90ca-3d8bb9624954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:26.417623 dv-cinder-853315-7-smb devstack@keystone.service[104922]: INFO dbcounter [None req-a915f7a5-7ff9-411f-90ca-3d8bb9624954 None None] Registered counter for database keystone Sep 07 12:52:26.453404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG oslo_db.sqlalchemy.engines [None req-a915f7a5-7ff9-411f-90ca-3d8bb9624954 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104922) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:52:26.464574 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writer thread running {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:52:26.790095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG passlib.handlers.bcrypt [None req-a915f7a5-7ff9-411f-90ca-3d8bb9624954 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=104922) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 07 12:52:26.790667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG passlib.handlers.bcrypt [None req-a915f7a5-7ff9-411f-90ca-3d8bb9624954 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=104922) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 07 12:52:26.851206 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-a915f7a5-7ff9-411f-90ca-3d8bb9624954 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:26.853060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a915f7a5-7ff9-411f-90ca-3d8bb9624954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:27.018892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1/3] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 759 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 07 12:52:27.702096 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da8d9a-5012-45d5-bfdc-72b7d165bd5f None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:27.839180 dv-cinder-853315-7-smb devstack@keystone.service[104921]: INFO dbcounter [None req-b1da8d9a-5012-45d5-bfdc-72b7d165bd5f None None] Registered counter for database keystone Sep 07 12:52:27.875975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG oslo_db.sqlalchemy.engines [None req-b1da8d9a-5012-45d5-bfdc-72b7d165bd5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:52:27.885156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writer thread running {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:52:28.037704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da8d9a-5012-45d5-bfdc-72b7d165bd5f None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:28.045436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc2163-6ec8-48c7-a078-c76707261735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:28.046524 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc2163-6ec8-48c7-a078-c76707261735 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:28.046993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc2163-6ec8-48c7-a078-c76707261735 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:28.047470 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc2163-6ec8-48c7-a078-c76707261735 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:28.063945 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc2163-6ec8-48c7-a078-c76707261735 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:28.175578 dv-cinder-853315-7-smb devstack@keystone.service[104921]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0acc2163-6ec8-48c7-a078-c76707261735 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 07 12:52:28.176176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc2163-6ec8-48c7-a078-c76707261735 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:28.195018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 3/4] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Sep 7 12:52:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 12:52:28.205033 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915f7a5-7ff9-411f-90ca-3d8bb9624954 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:28.225475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915f7a5-7ff9-411f-90ca-3d8bb9624954 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:28.231679 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886e4c9-5b1e-4d83-a2f4-20d542160e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:28.233157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886e4c9-5b1e-4d83-a2f4-20d542160e50 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:28.233483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886e4c9-5b1e-4d83-a2f4-20d542160e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:28.233797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886e4c9-5b1e-4d83-a2f4-20d542160e50 admin admin] PATH_INFO: `/v3/projects/e3af01406fe7484583db161921c3b6ee` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:28.235564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886e4c9-5b1e-4d83-a2f4-20d542160e50 admin admin] RBAC: Authorizing `identity:get_project(project_id=e3af01406fe7484583db161921c3b6ee)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:28.293012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2886e4c9-5b1e-4d83-a2f4-20d542160e50 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 07 12:52:28.293284 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886e4c9-5b1e-4d83-a2f4-20d542160e50 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:28.298257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 2/5] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Sep 7 12:52:28 2022] GET /identity/v3/projects/e3af01406fe7484583db161921c3b6ee => generated 344 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:31.068002 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970fc06-505a-41bf-9331-900fa155f1dc None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:31.068659 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970fc06-505a-41bf-9331-900fa155f1dc None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:31.068797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970fc06-505a-41bf-9331-900fa155f1dc None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:31.073139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 4/6] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:52:31.079550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a0fe7-54ce-4ea2-8fd7-61a9679f9c5a None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:31.080132 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a0fe7-54ce-4ea2-8fd7-61a9679f9c5a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:31.080256 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a0fe7-54ce-4ea2-8fd7-61a9679f9c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:31.103015 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-982a0fe7-54ce-4ea2-8fd7-61a9679f9c5a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:31.104773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-982a0fe7-54ce-4ea2-8fd7-61a9679f9c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:31.114782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 3/7] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 07 12:52:31.406988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970fc06-505a-41bf-9331-900fa155f1dc None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:31.421408 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970fc06-505a-41bf-9331-900fa155f1dc None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:31.426851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ab459-40e1-473c-a305-f758bea74fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:31.427870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ab459-40e1-473c-a305-f758bea74fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:31.428183 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ab459-40e1-473c-a305-f758bea74fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:31.428620 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ab459-40e1-473c-a305-f758bea74fd2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:31.441425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ab459-40e1-473c-a305-f758bea74fd2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:31.443975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ab459-40e1-473c-a305-f758bea74fd2 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:31.455374 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 5/8] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Sep 7 12:52:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 12:52:31.465157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a0fe7-54ce-4ea2-8fd7-61a9679f9c5a None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:31.481964 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a0fe7-54ce-4ea2-8fd7-61a9679f9c5a None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:31.489211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec668c0-5e7b-42d6-a4e0-e73f520328b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:31.490325 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec668c0-5e7b-42d6-a4e0-e73f520328b7 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:31.490820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec668c0-5e7b-42d6-a4e0-e73f520328b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:31.491293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec668c0-5e7b-42d6-a4e0-e73f520328b7 admin admin] PATH_INFO: `/v3/users/28cc602f739f4f2fbcd0f584e9147da4` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:31.493782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec668c0-5e7b-42d6-a4e0-e73f520328b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=28cc602f739f4f2fbcd0f584e9147da4)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:31.498031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec668c0-5e7b-42d6-a4e0-e73f520328b7 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:31.501379 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 4/9] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Sep 7 12:52:31 2022] GET /identity/v3/users/28cc602f739f4f2fbcd0f584e9147da4 => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:34.001469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445843e4-4aa2-4867-9526-a85b2af4e8f0 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:34.002266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445843e4-4aa2-4867-9526-a85b2af4e8f0 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:34.002266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445843e4-4aa2-4867-9526-a85b2af4e8f0 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:34.003575 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:52:34.010562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f95d3-c839-4968-9510-e107b7741c04 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:34.011106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f95d3-c839-4968-9510-e107b7741c04 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:34.011476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f95d3-c839-4968-9510-e107b7741c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:34.041681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-848f95d3-c839-4968-9510-e107b7741c04 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:34.043970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-848f95d3-c839-4968-9510-e107b7741c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:34.201058 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 5/11] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:34.304426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c89a38-e981-4626-b8d2-eb00ae1fdbf0 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:34.304709 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c89a38-e981-4626-b8d2-eb00ae1fdbf0 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:34.304961 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c89a38-e981-4626-b8d2-eb00ae1fdbf0 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:34.306374 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 7/12] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:34.312697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4060b-5a1e-42ae-aa60-294f3d2ca969 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:34.312989 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4060b-5a1e-42ae-aa60-294f3d2ca969 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:34.313251 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4060b-5a1e-42ae-aa60-294f3d2ca969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:34.337110 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-59f4060b-5a1e-42ae-aa60-294f3d2ca969 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:34.338552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-59f4060b-5a1e-42ae-aa60-294f3d2ca969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:34.363277 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:34.452767 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 6/13] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:34.624176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c89a38-e981-4626-b8d2-eb00ae1fdbf0 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:34.782845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4060b-5a1e-42ae-aa60-294f3d2ca969 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:34.844217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c89a38-e981-4626-b8d2-eb00ae1fdbf0 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:34.913299 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2966c9c-8c75-4132-85a9-526424e51e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:34.914288 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2966c9c-8c75-4132-85a9-526424e51e93 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:34.914732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2966c9c-8c75-4132-85a9-526424e51e93 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:34.915174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2966c9c-8c75-4132-85a9-526424e51e93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:34.951104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4060b-5a1e-42ae-aa60-294f3d2ca969 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:34.970479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:34.999740 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdecdf-553a-42d7-b4ad-95c063734ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:35.000542 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdecdf-553a-42d7-b4ad-95c063734ee1 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:35.000908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdecdf-553a-42d7-b4ad-95c063734ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:35.001313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdecdf-553a-42d7-b4ad-95c063734ee1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:35.005497 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2966c9c-8c75-4132-85a9-526424e51e93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:35.007023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2966c9c-8c75-4132-85a9-526424e51e93 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:35.016811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdecdf-553a-42d7-b4ad-95c063734ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-99fdecdf-553a-42d7-b4ad-95c063734ee1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:35.028304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:35.030047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:35.031590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:35.031590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:35.031590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:35.031590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:35.031590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:35.031590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:35.031590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:35.031590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:35.031590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:35.031590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:35.031590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:35.031590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:52:35.031590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:52:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:35.037424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdecdf-553a-42d7-b4ad-95c063734ee1 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:35.055394 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:35.156314 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 8/15] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:35.164993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2966c9c-8c75-4132-85a9-526424e51e93 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:35.198266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdecdf-553a-42d7-b4ad-95c063734ee1 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:35.246635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38c9b0-843e-4ff5-b39f-ab80d85c727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:35.247369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38c9b0-843e-4ff5-b39f-ab80d85c727a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:35.247706 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38c9b0-843e-4ff5-b39f-ab80d85c727a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:35.248037 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38c9b0-843e-4ff5-b39f-ab80d85c727a None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:35.249124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38c9b0-843e-4ff5-b39f-ab80d85c727a None admin] RBAC: Adding query filter params (name=admin) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:35.249485 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38c9b0-843e-4ff5-b39f-ab80d85c727a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:35.251001 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38c9b0-843e-4ff5-b39f-ab80d85c727a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:35.266686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 8/16] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:35.276048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38c9b0-843e-4ff5-b39f-ab80d85c727a None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:35.289496 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:35.321199 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2966c9c-8c75-4132-85a9-526424e51e93 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:35.361038 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a57e5-d27c-45ee-808c-6cc625fd062e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:35.362122 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a57e5-d27c-45ee-808c-6cc625fd062e None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:35.362494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a57e5-d27c-45ee-808c-6cc625fd062e None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:35.362868 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a57e5-d27c-45ee-808c-6cc625fd062e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:35.385299 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a57e5-d27c-45ee-808c-6cc625fd062e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:35.387113 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a57e5-d27c-45ee-808c-6cc625fd062e None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:35.407868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-3d5a57e5-d27c-45ee-808c-6cc625fd062e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:35.409651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:35.411261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:35.413805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:35.413805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:35.413805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:52:35.413805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:35.419517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a57e5-d27c-45ee-808c-6cc625fd062e None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:35.444219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38c9b0-843e-4ff5-b39f-ab80d85c727a None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:35.498182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c52b37-cfba-48a2-a354-3d080ee1a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:35.499331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c52b37-cfba-48a2-a354-3d080ee1a633 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:35.499668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c52b37-cfba-48a2-a354-3d080ee1a633 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:35.499996 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c52b37-cfba-48a2-a354-3d080ee1a633 None admin] PATH_INFO: `/v3/users/28cc602f739f4f2fbcd0f584e9147da4` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:35.501531 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c52b37-cfba-48a2-a354-3d080ee1a633 None admin] RBAC: Authorizing `identity:get_user(user_id=28cc602f739f4f2fbcd0f584e9147da4)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:35.503393 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c52b37-cfba-48a2-a354-3d080ee1a633 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:35.506256 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:35 2022] GET /identity/v3/users/28cc602f739f4f2fbcd0f584e9147da4 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:35.512698 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c52b37-cfba-48a2-a354-3d080ee1a633 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:35.583836 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a57e5-d27c-45ee-808c-6cc625fd062e None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:35.624101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:35.636804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9cf32-6f87-41dc-81bd-6761a3c319dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:35.637542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9cf32-6f87-41dc-81bd-6761a3c319dd None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:35.637997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9cf32-6f87-41dc-81bd-6761a3c319dd None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:35.638349 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9cf32-6f87-41dc-81bd-6761a3c319dd None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:35.639082 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9cf32-6f87-41dc-81bd-6761a3c319dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:35.639508 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9cf32-6f87-41dc-81bd-6761a3c319dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:35.641279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9cf32-6f87-41dc-81bd-6761a3c319dd None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:35.665290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:35.669247 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c52b37-cfba-48a2-a354-3d080ee1a633 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:35.749550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6b305-d874-4908-ad6a-72e4c289671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:35.750633 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6b305-d874-4908-ad6a-72e4c289671e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:35.751131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6b305-d874-4908-ad6a-72e4c289671e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:35.751616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6b305-d874-4908-ad6a-72e4c289671e None admin] PATH_INFO: `/v3/domains/default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:35.753931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6b305-d874-4908-ad6a-72e4c289671e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:35.757816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6b305-d874-4908-ad6a-72e4c289671e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:35.760989 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 10/20] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:35.774239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9cf32-6f87-41dc-81bd-6761a3c319dd None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:35.982229 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9cf32-6f87-41dc-81bd-6761a3c319dd None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:36.049475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f2c42-63a0-44c2-a2ee-6a130058bd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:36.050638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2c42-63a0-44c2-a2ee-6a130058bd81 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:36.050970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2c42-63a0-44c2-a2ee-6a130058bd81 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:36.051446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2c42-63a0-44c2-a2ee-6a130058bd81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:36.053061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f2c42-63a0-44c2-a2ee-6a130058bd81 None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.domain.id=default, user.id=28cc602f739f4f2fbcd0f584e9147da4) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:36.053760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f2c42-63a0-44c2-a2ee-6a130058bd81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:36.056744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f2c42-63a0-44c2-a2ee-6a130058bd81 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:36.075574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 11/21] 10.222.0.30 () {56 vars in 1322 bytes} [Wed Sep 7 12:52:35 2022] GET /identity/v3/role_assignments?user.id=28cc602f739f4f2fbcd0f584e9147da4&scope.domain.id=default&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 233 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:39.662319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cff8e-56c8-4432-9b52-c2d47a6b4997 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:39.663687 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cff8e-56c8-4432-9b52-c2d47a6b4997 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:39.664174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cff8e-56c8-4432-9b52-c2d47a6b4997 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:39.666229 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 11/22] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:39.672811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a5d75-cc42-437a-a28a-00078cd51a46 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:39.673761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a5d75-cc42-437a-a28a-00078cd51a46 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:39.674262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a5d75-cc42-437a-a28a-00078cd51a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:39.699763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG passlib.handlers.bcrypt [None req-065a5d75-cc42-437a-a28a-00078cd51a46 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=104921) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 07 12:52:39.700624 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG passlib.handlers.bcrypt [None req-065a5d75-cc42-437a-a28a-00078cd51a46 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=104921) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 07 12:52:39.766910 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-065a5d75-cc42-437a-a28a-00078cd51a46 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:39.768982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-065a5d75-cc42-437a-a28a-00078cd51a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:39.814789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93629c3-44d1-4f26-941f-dee61c461737 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:39.815411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93629c3-44d1-4f26-941f-dee61c461737 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:39.815918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93629c3-44d1-4f26-941f-dee61c461737 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:39.818069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 12/23] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:39.847033 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512052a6-0cf0-411b-9fdc-36192ee9015b None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:39.853023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512052a6-0cf0-411b-9fdc-36192ee9015b None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:39.853577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512052a6-0cf0-411b-9fdc-36192ee9015b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:39.902412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-512052a6-0cf0-411b-9fdc-36192ee9015b None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:39.908289 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-512052a6-0cf0-411b-9fdc-36192ee9015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:39.912931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:39.919020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:39.960406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 12/24] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:40.112894 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 13/25] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:40.530610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa244fd-e1e0-4eb9-af16-494369ec456f None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:40.531597 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa244fd-e1e0-4eb9-af16-494369ec456f None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:40.532341 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa244fd-e1e0-4eb9-af16-494369ec456f None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:40.534743 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 13/26] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:40.544116 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964e163-165d-4a09-a8b0-a22e88ada09d None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:40.545140 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964e163-165d-4a09-a8b0-a22e88ada09d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:40.545813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964e163-165d-4a09-a8b0-a22e88ada09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:40.585671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-a964e163-165d-4a09-a8b0-a22e88ada09d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:40.588125 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a964e163-165d-4a09-a8b0-a22e88ada09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:40.759730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 14/27] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:40.842415 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa244fd-e1e0-4eb9-af16-494369ec456f None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:40.987725 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964e163-165d-4a09-a8b0-a22e88ada09d None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:40.998473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa244fd-e1e0-4eb9-af16-494369ec456f None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:41.074757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2473f2-a01b-40df-b6ec-cd22585b7284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:41.075684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2473f2-a01b-40df-b6ec-cd22585b7284 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:41.076114 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2473f2-a01b-40df-b6ec-cd22585b7284 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:41.076567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2473f2-a01b-40df-b6ec-cd22585b7284 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:41.077696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2473f2-a01b-40df-b6ec-cd22585b7284 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:41.079505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2473f2-a01b-40df-b6ec-cd22585b7284 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:41.237668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:41.279329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 14/28] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Sep 7 12:52:40 2022] POST /identity/v3/roles => generated 219 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:52:41.334013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964e163-165d-4a09-a8b0-a22e88ada09d None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:41.418346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2473f2-a01b-40df-b6ec-cd22585b7284 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:41.441816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91818381-9480-4eef-8ede-3253b50eb4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:41.443018 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91818381-9480-4eef-8ede-3253b50eb4b4 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:41.443507 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91818381-9480-4eef-8ede-3253b50eb4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:41.443986 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91818381-9480-4eef-8ede-3253b50eb4b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:41.472232 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91818381-9480-4eef-8ede-3253b50eb4b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:41.475271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91818381-9480-4eef-8ede-3253b50eb4b4 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:41.510028 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-91818381-9480-4eef-8ede-3253b50eb4b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:41.531155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:41.532872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:41.534529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:41.534529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:41.534529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:52:41.534529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 15/29] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 547 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:41.543562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91818381-9480-4eef-8ede-3253b50eb4b4 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:41.633019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2473f2-a01b-40df-b6ec-cd22585b7284 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:41.703107 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad194a-eee3-416a-92b5-3e4cd77dff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:41.704938 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad194a-eee3-416a-92b5-3e4cd77dff9d None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:41.705459 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad194a-eee3-416a-92b5-3e4cd77dff9d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:41.705947 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad194a-eee3-416a-92b5-3e4cd77dff9d None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:41.707243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad194a-eee3-416a-92b5-3e4cd77dff9d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:41.711844 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad194a-eee3-416a-92b5-3e4cd77dff9d None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:41.742836 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91818381-9480-4eef-8ede-3253b50eb4b4 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:41.743555 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 15/30] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Sep 7 12:52:41 2022] POST /identity/v3/roles => generated 225 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:52:41.749712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5958b-01e4-43fa-bd04-310ba67e64bb None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:41.750683 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5958b-01e4-43fa-bd04-310ba67e64bb None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:41.750991 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5958b-01e4-43fa-bd04-310ba67e64bb None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:41.754873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 16/31] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:41.764059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcaba9e-d4b7-4f49-84af-e5b5fba717b5 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:41.764059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcaba9e-d4b7-4f49-84af-e5b5fba717b5 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:41.764059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcaba9e-d4b7-4f49-84af-e5b5fba717b5 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:41.764059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 17/32] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:41.774219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dfa50-202e-466c-9941-9755751b02a4 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:41.775151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dfa50-202e-466c-9941-9755751b02a4 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:41.775636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dfa50-202e-466c-9941-9755751b02a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:41.807546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:41.822212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-169dfa50-202e-466c-9941-9755751b02a4 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:41.826019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-169dfa50-202e-466c-9941-9755751b02a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:41.832609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563c1bb-2b78-4e65-8cc8-d7b8335f7c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:41.833815 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563c1bb-2b78-4e65-8cc8-d7b8335f7c7f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:41.834451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563c1bb-2b78-4e65-8cc8-d7b8335f7c7f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:41.834451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563c1bb-2b78-4e65-8cc8-d7b8335f7c7f None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:41.835337 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563c1bb-2b78-4e65-8cc8-d7b8335f7c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:41.835825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563c1bb-2b78-4e65-8cc8-d7b8335f7c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:41.837679 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563c1bb-2b78-4e65-8cc8-d7b8335f7c7f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:41.871362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 16/33] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:41.874715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2d9ce-97a3-4983-a9cc-8e9aede6a527 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:41.875024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2d9ce-97a3-4983-a9cc-8e9aede6a527 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:41.875461 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2d9ce-97a3-4983-a9cc-8e9aede6a527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:41.901917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-eaf2d9ce-97a3-4983-a9cc-8e9aede6a527 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:41.903211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-eaf2d9ce-97a3-4983-a9cc-8e9aede6a527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:41.979588 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 18/34] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:41.981333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dfa50-202e-466c-9941-9755751b02a4 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:42.026371 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 17/35] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:42.042150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:42.141249 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dfa50-202e-466c-9941-9755751b02a4 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:42.191241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f07830-91f3-463a-a12a-228750a0d9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:42.191955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f07830-91f3-463a-a12a-228750a0d9b9 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.192302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f07830-91f3-463a-a12a-228750a0d9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.193375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f07830-91f3-463a-a12a-228750a0d9b9 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.194994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f07830-91f3-463a-a12a-228750a0d9b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:42.197914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f07830-91f3-463a-a12a-228750a0d9b9 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:42.258322 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 19/36] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Sep 7 12:52:41 2022] POST /identity/v3/projects => generated 301 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:52:42.320110 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2d9ce-97a3-4983-a9cc-8e9aede6a527 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:42.351756 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654be9f0-5d50-46a0-ba92-698308e99f9f None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.352095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654be9f0-5d50-46a0-ba92-698308e99f9f None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.352766 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654be9f0-5d50-46a0-ba92-698308e99f9f None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.354230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 20/37] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:42.360971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654be9f0-5d50-46a0-ba92-698308e99f9f None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:42.480701 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:42.492433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2d9ce-97a3-4983-a9cc-8e9aede6a527 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:42.521257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:42.522421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654be9f0-5d50-46a0-ba92-698308e99f9f None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:42.563806 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6151fc-3cd1-4d65-ad97-31dbd5a8ac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:42.564518 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6151fc-3cd1-4d65-ad97-31dbd5a8ac66 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.565065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6151fc-3cd1-4d65-ad97-31dbd5a8ac66 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.565397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6151fc-3cd1-4d65-ad97-31dbd5a8ac66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.583610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6151fc-3cd1-4d65-ad97-31dbd5a8ac66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:42.587766 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb5219-ccec-4a94-a9a7-da3bc8811ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:42.590745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb5219-ccec-4a94-a9a7-da3bc8811ae0 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.590745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb5219-ccec-4a94-a9a7-da3bc8811ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.590745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb5219-ccec-4a94-a9a7-da3bc8811ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.590745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb5219-ccec-4a94-a9a7-da3bc8811ae0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:42.591521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb5219-ccec-4a94-a9a7-da3bc8811ae0 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-4a6151fc-3cd1-4d65-ad97-31dbd5a8ac66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:42.593458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:42.594642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:42.596283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:42.596283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:42.596283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:42.596283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:42.596283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:42.596283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:42.596283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:42.596283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:42.596283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:42.596283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:42.596283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:42.596283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:52:42.596283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 18/38] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:52:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:42.598086 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd3394-2774-4a1d-9c94-ac8a55469346 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.598417 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd3394-2774-4a1d-9c94-ac8a55469346 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.599125 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd3394-2774-4a1d-9c94-ac8a55469346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.610358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 21/39] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Sep 7 12:52:42 2022] POST /identity/v3/roles => generated 223 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:52:42.611516 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb5219-ccec-4a94-a9a7-da3bc8811ae0 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:42.625423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-befd3394-2774-4a1d-9c94-ac8a55469346 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:42.627289 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-befd3394-2774-4a1d-9c94-ac8a55469346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:42.754192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 19/40] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:42.792619 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb5219-ccec-4a94-a9a7-da3bc8811ae0 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:42.847496 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65304a39-7629-425a-a9ed-ac68053b4f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:42.848046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65304a39-7629-425a-a9ed-ac68053b4f27 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.848326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65304a39-7629-425a-a9ed-ac68053b4f27 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.848704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65304a39-7629-425a-a9ed-ac68053b4f27 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.851481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65304a39-7629-425a-a9ed-ac68053b4f27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:42.851481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65304a39-7629-425a-a9ed-ac68053b4f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:42.851818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65304a39-7629-425a-a9ed-ac68053b4f27 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:42.873835 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 22/41] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:42.882235 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd3394-2774-4a1d-9c94-ac8a55469346 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:43.019678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd3394-2774-4a1d-9c94-ac8a55469346 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:43.022058 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:43.076156 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04120db7-623b-4995-a739-7e5537984e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:43.076901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04120db7-623b-4995-a739-7e5537984e91 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:43.077189 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04120db7-623b-4995-a739-7e5537984e91 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:43.077460 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04120db7-623b-4995-a739-7e5537984e91 None admin] PATH_INFO: `/v3/users/28cc602f739f4f2fbcd0f584e9147da4` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:43.078802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04120db7-623b-4995-a739-7e5537984e91 None admin] RBAC: Authorizing `identity:get_user(user_id=28cc602f739f4f2fbcd0f584e9147da4)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:43.080343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04120db7-623b-4995-a739-7e5537984e91 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:43.082124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 20/42] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:42 2022] GET /identity/v3/users/28cc602f739f4f2fbcd0f584e9147da4 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:43.088725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65304a39-7629-425a-a9ed-ac68053b4f27 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:43.094985 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:43.153331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04120db7-623b-4995-a739-7e5537984e91 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:43.238555 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65304a39-7629-425a-a9ed-ac68053b4f27 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:43.284646 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04120db7-623b-4995-a739-7e5537984e91 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:43.290440 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fe3f6-c05e-40cf-a900-f9c3a695c0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:43.291264 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fe3f6-c05e-40cf-a900-f9c3a695c0e7 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:43.291650 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fe3f6-c05e-40cf-a900-f9c3a695c0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:43.292027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fe3f6-c05e-40cf-a900-f9c3a695c0e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:43.293537 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fe3f6-c05e-40cf-a900-f9c3a695c0e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:43.295126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fe3f6-c05e-40cf-a900-f9c3a695c0e7 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:43.296921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 23/43] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:43.305104 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fe3f6-c05e-40cf-a900-f9c3a695c0e7 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:43.334094 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf634c-2124-4a24-9645-7d1eb67731c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:43.335098 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf634c-2124-4a24-9645-7d1eb67731c7 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:43.335424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf634c-2124-4a24-9645-7d1eb67731c7 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:43.335699 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf634c-2124-4a24-9645-7d1eb67731c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:43.337528 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf634c-2124-4a24-9645-7d1eb67731c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:43.339901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf634c-2124-4a24-9645-7d1eb67731c7 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:43.343391 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 21/44] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:43.350464 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf634c-2124-4a24-9645-7d1eb67731c7 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:43.401667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:43.433200 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:43.482889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fe3f6-c05e-40cf-a900-f9c3a695c0e7 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:43.492056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf634c-2124-4a24-9645-7d1eb67731c7 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:43.538983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c91ec6-4370-4596-9c06-d57183ed20d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:43.539698 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c91ec6-4370-4596-9c06-d57183ed20d9 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:43.539977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c91ec6-4370-4596-9c06-d57183ed20d9 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:43.540249 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c91ec6-4370-4596-9c06-d57183ed20d9 None admin] PATH_INFO: `/v3/domains/default/users/28cc602f739f4f2fbcd0f584e9147da4/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:43.544503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c91ec6-4370-4596-9c06-d57183ed20d9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=28cc602f739f4f2fbcd0f584e9147da4, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:43.546721 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c91ec6-4370-4596-9c06-d57183ed20d9 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:43.562375 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feac3e-9d61-46ea-98d0-d70124af998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:43.563465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feac3e-9d61-46ea-98d0-d70124af998c None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:43.563946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feac3e-9d61-46ea-98d0-d70124af998c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:43.564462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feac3e-9d61-46ea-98d0-d70124af998c None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:43.565551 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 24/45] 10.222.0.30 () {58 vars in 1361 bytes} [Wed Sep 7 12:52:43 2022] PUT /identity/v3/domains/default/users/28cc602f739f4f2fbcd0f584e9147da4/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:52:43.565985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77feac3e-9d61-46ea-98d0-d70124af998c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:43.568974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77feac3e-9d61-46ea-98d0-d70124af998c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:43.985480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 22/46] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Sep 7 12:52:43 2022] POST /identity/v3/projects => generated 312 bytes in 635 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:52:45.909607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e18de-627e-422e-8f88-a57067b96d2e None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:45.910378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e18de-627e-422e-8f88-a57067b96d2e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:45.910378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e18de-627e-422e-8f88-a57067b96d2e None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:45.911959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 25/47] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:45.918628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a35ccd-e08d-4563-930e-90e7aae4bf44 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:45.919659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a35ccd-e08d-4563-930e-90e7aae4bf44 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:45.919659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a35ccd-e08d-4563-930e-90e7aae4bf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:45.954287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-80a35ccd-e08d-4563-930e-90e7aae4bf44 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:45.957055 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-80a35ccd-e08d-4563-930e-90e7aae4bf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:46.087004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 23/48] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:46.383852 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e18de-627e-422e-8f88-a57067b96d2e None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:46.497801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a6e6b-db2e-4781-a785-737c6dacdd78 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:46.498464 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a6e6b-db2e-4781-a785-737c6dacdd78 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:46.498635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a6e6b-db2e-4781-a785-737c6dacdd78 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:46.500028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 24/49] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:52:46.506421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712bcb1-93ab-4742-ac30-5822c023bbe6 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:46.506731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712bcb1-93ab-4742-ac30-5822c023bbe6 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:46.506986 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712bcb1-93ab-4742-ac30-5822c023bbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:46.514879 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e18de-627e-422e-8f88-a57067b96d2e None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:46.526398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-0712bcb1-93ab-4742-ac30-5822c023bbe6 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:46.527677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0712bcb1-93ab-4742-ac30-5822c023bbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:46.548883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:46.630330 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 25/50] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:46.695847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:46.705520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa6512-e523-43af-9b37-ebabf1086d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:46.706647 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa6512-e523-43af-9b37-ebabf1086d5d None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:46.707156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa6512-e523-43af-9b37-ebabf1086d5d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:46.707919 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa6512-e523-43af-9b37-ebabf1086d5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:46.731219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa6512-e523-43af-9b37-ebabf1086d5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-abfa6512-e523-43af-9b37-ebabf1086d5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:46.744675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:46.745675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:46.746409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:46.746409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:46.746409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:46.746409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:46.746409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:46.746409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:46.746409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:46.746409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:46.746409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:46.746409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:46.746409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:46.746409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:52:46.747188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 26/51] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:52:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:46.756996 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712bcb1-93ab-4742-ac30-5822c023bbe6 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:46.942350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa6512-e523-43af-9b37-ebabf1086d5d None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:46.948991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712bcb1-93ab-4742-ac30-5822c023bbe6 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:47.004750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336690a2-08fa-4637-a240-cdc7ece02a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:47.005715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336690a2-08fa-4637-a240-cdc7ece02a0f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:47.006155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336690a2-08fa-4637-a240-cdc7ece02a0f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:47.006653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336690a2-08fa-4637-a240-cdc7ece02a0f None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:47.007765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336690a2-08fa-4637-a240-cdc7ece02a0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:47.008266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336690a2-08fa-4637-a240-cdc7ece02a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:47.010653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336690a2-08fa-4637-a240-cdc7ece02a0f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:47.026061 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 26/52] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:47.032997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336690a2-08fa-4637-a240-cdc7ece02a0f None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:47.051432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:47.117872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa6512-e523-43af-9b37-ebabf1086d5d None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:47.178471 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336690a2-08fa-4637-a240-cdc7ece02a0f None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:47.182838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878c6da-b6ee-4c25-bcd2-b7c9272cdeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:47.183968 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878c6da-b6ee-4c25-bcd2-b7c9272cdeff None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:47.184511 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878c6da-b6ee-4c25-bcd2-b7c9272cdeff None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:47.185001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878c6da-b6ee-4c25-bcd2-b7c9272cdeff None admin] PATH_INFO: `/v3/domains/default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:47.187220 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878c6da-b6ee-4c25-bcd2-b7c9272cdeff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:47.190226 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878c6da-b6ee-4c25-bcd2-b7c9272cdeff None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:47.193506 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 27/53] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:47.200787 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878c6da-b6ee-4c25-bcd2-b7c9272cdeff None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:47.229851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4c008-337c-425b-8763-68a54f61319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:47.230511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4c008-337c-425b-8763-68a54f61319c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:47.230777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4c008-337c-425b-8763-68a54f61319c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:47.231061 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4c008-337c-425b-8763-68a54f61319c None admin] PATH_INFO: `/v3/users/28cc602f739f4f2fbcd0f584e9147da4` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:47.232561 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4c008-337c-425b-8763-68a54f61319c None admin] RBAC: Authorizing `identity:get_user(user_id=28cc602f739f4f2fbcd0f584e9147da4)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:47.234084 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4c008-337c-425b-8763-68a54f61319c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:47.235777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 27/54] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:47 2022] GET /identity/v3/users/28cc602f739f4f2fbcd0f584e9147da4 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:47.242681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4c008-337c-425b-8763-68a54f61319c None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:47.310993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:47.359219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:47.364303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878c6da-b6ee-4c25-bcd2-b7c9272cdeff None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:47.384764 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4c008-337c-425b-8763-68a54f61319c None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:47.411683 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60775f1-fe8c-4f5a-b57a-6c0ce3265ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:47.412531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60775f1-fe8c-4f5a-b57a-6c0ce3265ea5 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:47.412897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60775f1-fe8c-4f5a-b57a-6c0ce3265ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:47.413255 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60775f1-fe8c-4f5a-b57a-6c0ce3265ea5 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:47.414099 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60775f1-fe8c-4f5a-b57a-6c0ce3265ea5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:47.415983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60775f1-fe8c-4f5a-b57a-6c0ce3265ea5 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:47.432008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c38ac1-9b6f-409c-9332-84a645db8798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:47.432998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c38ac1-9b6f-409c-9332-84a645db8798 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:47.433458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c38ac1-9b6f-409c-9332-84a645db8798 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:47.433924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c38ac1-9b6f-409c-9332-84a645db8798 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:47.435851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c38ac1-9b6f-409c-9332-84a645db8798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:47.438471 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c38ac1-9b6f-409c-9332-84a645db8798 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:47.441526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 28/55] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:47.451635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c38ac1-9b6f-409c-9332-84a645db8798 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:47.463202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 28/56] 10.222.0.30 () {60 vars in 1140 bytes} [Wed Sep 7 12:52:47 2022] POST /identity/v3/projects => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:52:47.595413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c38ac1-9b6f-409c-9332-84a645db8798 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:47.644122 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308af914-71cf-4ba8-980d-9f703d7c1aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:47.644863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308af914-71cf-4ba8-980d-9f703d7c1aaf None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:47.645344 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308af914-71cf-4ba8-980d-9f703d7c1aaf None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:47.645750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308af914-71cf-4ba8-980d-9f703d7c1aaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:47.646515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308af914-71cf-4ba8-980d-9f703d7c1aaf None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.domain.id=default, user.id=28cc602f739f4f2fbcd0f584e9147da4) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:47.646865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308af914-71cf-4ba8-980d-9f703d7c1aaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:47.648455 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308af914-71cf-4ba8-980d-9f703d7c1aaf None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:47.658250 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 29/57] 10.222.0.30 () {56 vars in 1322 bytes} [Wed Sep 7 12:52:47 2022] GET /identity/v3/role_assignments?user.id=28cc602f739f4f2fbcd0f584e9147da4&scope.domain.id=default&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 530 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:50.058771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc3fcc-2bab-4f7d-9a72-137295fb21ba None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.059596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc3fcc-2bab-4f7d-9a72-137295fb21ba None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.059596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc3fcc-2bab-4f7d-9a72-137295fb21ba None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.060958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 29/58] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:50.067609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7f5c5-e3ac-4ce8-8270-cad96c308ac9 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.068219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7f5c5-e3ac-4ce8-8270-cad96c308ac9 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.068219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7f5c5-e3ac-4ce8-8270-cad96c308ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.090239 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-b4f7f5c5-e3ac-4ce8-8270-cad96c308ac9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:50.091546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b4f7f5c5-e3ac-4ce8-8270-cad96c308ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:50.101728 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:50.190205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 30/59] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:50.500163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc3fcc-2bab-4f7d-9a72-137295fb21ba None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:50.659782 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc3fcc-2bab-4f7d-9a72-137295fb21ba None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:50.684885 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:50.714535 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2fb2c-d09d-4de5-a100-bc4e94ec1b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:50.715357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2fb2c-d09d-4de5-a100-bc4e94ec1b27 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.715679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2fb2c-d09d-4de5-a100-bc4e94ec1b27 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.716096 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2fb2c-d09d-4de5-a100-bc4e94ec1b27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.717632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2fb2c-d09d-4de5-a100-bc4e94ec1b27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:50.719694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2fb2c-d09d-4de5-a100-bc4e94ec1b27 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:50.721525 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 30/60] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:50.727446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7f5c5-e3ac-4ce8-8270-cad96c308ac9 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:50.855653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7f5c5-e3ac-4ce8-8270-cad96c308ac9 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:50.916092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0426414-87eb-4342-9a17-a35a3f53a52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:50.917231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0426414-87eb-4342-9a17-a35a3f53a52a None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.917730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0426414-87eb-4342-9a17-a35a3f53a52a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.918247 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0426414-87eb-4342-9a17-a35a3f53a52a None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.919492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0426414-87eb-4342-9a17-a35a3f53a52a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:50.922536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0426414-87eb-4342-9a17-a35a3f53a52a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:50.961166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:50.972190 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 31/61] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:52:50 2022] POST /identity/v3/users => generated 275 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:52:55.689122 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3aaaf-aedf-4b84-ab42-716efffa3c94 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:55.690777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3aaaf-aedf-4b84-ab42-716efffa3c94 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:55.691623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3aaaf-aedf-4b84-ab42-716efffa3c94 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:55.694517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 31/62] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:55.704053 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca32db-4ec9-41d1-a94a-ac5fb0793acc None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:55.705580 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca32db-4ec9-41d1-a94a-ac5fb0793acc None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:55.706340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca32db-4ec9-41d1-a94a-ac5fb0793acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:55.750426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-95ca32db-4ec9-41d1-a94a-ac5fb0793acc None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:55.753290 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-95ca32db-4ec9-41d1-a94a-ac5fb0793acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:55.968604 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 32/63] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:56.002795 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe93ed-3d80-494d-b748-6ea37dbd7e1a None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.003543 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe93ed-3d80-494d-b748-6ea37dbd7e1a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.004194 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe93ed-3d80-494d-b748-6ea37dbd7e1a None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.006927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 32/64] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:56.016784 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b692ae-3f69-4827-8570-73a36348febc None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.017232 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b692ae-3f69-4827-8570-73a36348febc None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.017722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b692ae-3f69-4827-8570-73a36348febc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.061690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-e3b692ae-3f69-4827-8570-73a36348febc None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:56.063705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e3b692ae-3f69-4827-8570-73a36348febc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:56.244588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 33/65] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:56.279363 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346b74b-5261-4ae3-8be5-6df00d53e42f None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.280319 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346b74b-5261-4ae3-8be5-6df00d53e42f None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.281139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346b74b-5261-4ae3-8be5-6df00d53e42f None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.284446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 33/66] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:56.291435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9bcab-a665-4ab6-a862-0b60bd4af391 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.291884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9bcab-a665-4ab6-a862-0b60bd4af391 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.292365 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9bcab-a665-4ab6-a862-0b60bd4af391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.317544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749ea7f-5fc2-4690-8701-086620850f20 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.318202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749ea7f-5fc2-4690-8701-086620850f20 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.318691 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749ea7f-5fc2-4690-8701-086620850f20 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.320690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 34/67] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:52:56.333013 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97f3ef-0686-4bc4-87c8-a1aa7e4c29e0 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.333739 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97f3ef-0686-4bc4-87c8-a1aa7e4c29e0 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.334206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97f3ef-0686-4bc4-87c8-a1aa7e4c29e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.338333 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-1fa9bcab-a665-4ab6-a862-0b60bd4af391 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:56.340332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1fa9bcab-a665-4ab6-a862-0b60bd4af391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:56.393784 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-3a97f3ef-0686-4bc4-87c8-a1aa7e4c29e0 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:56.396665 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3a97f3ef-0686-4bc4-87c8-a1aa7e4c29e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:56.474522 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:56.534225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 34/68] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:56.572043 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9bcab-a665-4ab6-a862-0b60bd4af391 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:56.615847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 35/69] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:56.779289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97f3ef-0686-4bc4-87c8-a1aa7e4c29e0 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:56.788504 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9bcab-a665-4ab6-a862-0b60bd4af391 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:56.863899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d232f2-d927-4f00-8309-a66a6ffd4219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:56.865437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d232f2-d927-4f00-8309-a66a6ffd4219 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.865720 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d232f2-d927-4f00-8309-a66a6ffd4219 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.866006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d232f2-d927-4f00-8309-a66a6ffd4219 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.901308 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d232f2-d927-4f00-8309-a66a6ffd4219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-31d232f2-d927-4f00-8309-a66a6ffd4219 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:56.907700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:56.909387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:56.910741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:56.910741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:56.910741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:56.910741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:56.910741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:56.910741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:56.910741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:56.910741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:56.910741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:56.910741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:56.910741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:56.910741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:52:56.910741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 35/70] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:56.937632 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d232f2-d927-4f00-8309-a66a6ffd4219 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:57.059747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97f3ef-0686-4bc4-87c8-a1aa7e4c29e0 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:57.067593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:57.076958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:57.114162 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062065ba-4c5b-4cef-aa0a-23962ff1a1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:57.115240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062065ba-4c5b-4cef-aa0a-23962ff1a1af None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.115712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062065ba-4c5b-4cef-aa0a-23962ff1a1af None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.116180 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062065ba-4c5b-4cef-aa0a-23962ff1a1af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.139624 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062065ba-4c5b-4cef-aa0a-23962ff1a1af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:57.149353 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d232f2-d927-4f00-8309-a66a6ffd4219 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-062065ba-4c5b-4cef-aa0a-23962ff1a1af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:57.150064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:57.151689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:57.154216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:57.154216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:57.154216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:57.154216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:57.154216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:57.154216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:57.154216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:57.154216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:57.154216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:57.154216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:57.154216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:57.154216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:52:57.154216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 36/71] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:52:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:57.154216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062065ba-4c5b-4cef-aa0a-23962ff1a1af None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:57.202737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f708994-3d71-4fcf-98e3-37f54de78809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:57.204014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f708994-3d71-4fcf-98e3-37f54de78809 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.204644 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f708994-3d71-4fcf-98e3-37f54de78809 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.205208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f708994-3d71-4fcf-98e3-37f54de78809 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.206463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f708994-3d71-4fcf-98e3-37f54de78809 None admin] RBAC: Adding query filter params (name=member) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:57.206979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f708994-3d71-4fcf-98e3-37f54de78809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:57.210088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f708994-3d71-4fcf-98e3-37f54de78809 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:57.226866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 36/72] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:57.228658 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f708994-3d71-4fcf-98e3-37f54de78809 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:57.331605 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062065ba-4c5b-4cef-aa0a-23962ff1a1af None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:57.376946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f708994-3d71-4fcf-98e3-37f54de78809 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:57.382735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8c9d3-3e5d-4e0f-84a7-f8b24155d161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:57.383507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8c9d3-3e5d-4e0f-84a7-f8b24155d161 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.383870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8c9d3-3e5d-4e0f-84a7-f8b24155d161 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.384256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8c9d3-3e5d-4e0f-84a7-f8b24155d161 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.389771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:57.401718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8c9d3-3e5d-4e0f-84a7-f8b24155d161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-dff8c9d3-3e5d-4e0f-84a7-f8b24155d161 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:57.406899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:57.407886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:57.408805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:57.408805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:57.408805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:57.408805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:57.408805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:57.408805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:57.408805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:57.408805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:57.408805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:57.408805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:57.408805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:57.408805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:52:57.408805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 37/73] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:52:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:57.409454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8c9d3-3e5d-4e0f-84a7-f8b24155d161 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:57.425887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1971b3-f922-4c4d-8b69-609ce4e4f83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:57.426823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1971b3-f922-4c4d-8b69-609ce4e4f83c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.427239 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1971b3-f922-4c4d-8b69-609ce4e4f83c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.427609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1971b3-f922-4c4d-8b69-609ce4e4f83c None admin] PATH_INFO: `/v3/roles/member` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.440220 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1971b3-f922-4c4d-8b69-609ce4e4f83c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-5d1971b3-f922-4c4d-8b69-609ce4e4f83c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:57.446440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:57.447949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:57.449258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:57.449258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:57.449258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:57.449258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:57.449258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:57.449258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:57.449258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:57.449258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:57.449258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:57.449258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:57.449258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:57.449258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:52:57.451216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:57.451341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 37/74] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:57.451341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1971b3-f922-4c4d-8b69-609ce4e4f83c None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:57.542941 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8c9d3-3e5d-4e0f-84a7-f8b24155d161 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:57.592623 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1971b3-f922-4c4d-8b69-609ce4e4f83c None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:57.595201 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bc4e7-cbb0-4d75-969d-c1cc3d00d197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:57.595937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bc4e7-cbb0-4d75-969d-c1cc3d00d197 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.596356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bc4e7-cbb0-4d75-969d-c1cc3d00d197 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.596752 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bc4e7-cbb0-4d75-969d-c1cc3d00d197 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.597581 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bc4e7-cbb0-4d75-969d-c1cc3d00d197 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:57.598009 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bc4e7-cbb0-4d75-969d-c1cc3d00d197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:57.599723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bc4e7-cbb0-4d75-969d-c1cc3d00d197 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:57.609324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 38/75] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:57.614569 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c383bb-7dc7-4b43-a584-1c37db2fb7fb None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.614569 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c383bb-7dc7-4b43-a584-1c37db2fb7fb None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.614569 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c383bb-7dc7-4b43-a584-1c37db2fb7fb None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.614569 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 39/76] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:57.614569 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c383bb-7dc7-4b43-a584-1c37db2fb7fb None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:57.637032 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112d05d-b160-4095-be47-4a8b58e4ff53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:57.637687 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112d05d-b160-4095-be47-4a8b58e4ff53 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.637970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112d05d-b160-4095-be47-4a8b58e4ff53 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.638251 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112d05d-b160-4095-be47-4a8b58e4ff53 None admin] PATH_INFO: `/v3/users/0c72aeb6d2de4684b788eeaec1b07e38` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.656239 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112d05d-b160-4095-be47-4a8b58e4ff53 None admin] RBAC: Authorizing `identity:get_user(user_id=0c72aeb6d2de4684b788eeaec1b07e38)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:57.657967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112d05d-b160-4095-be47-4a8b58e4ff53 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:57.660046 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 38/77] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:57 2022] GET /identity/v3/users/0c72aeb6d2de4684b788eeaec1b07e38 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:57.665414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112d05d-b160-4095-be47-4a8b58e4ff53 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:57.698721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:57.764209 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:57.782323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c383bb-7dc7-4b43-a584-1c37db2fb7fb None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:57.799552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112d05d-b160-4095-be47-4a8b58e4ff53 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:57.840978 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ce894-9fbe-40fa-920f-72975184a3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:57.841657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ce894-9fbe-40fa-920f-72975184a3fa None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.842022 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ce894-9fbe-40fa-920f-72975184a3fa None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.842410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ce894-9fbe-40fa-920f-72975184a3fa None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.843400 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ce894-9fbe-40fa-920f-72975184a3fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:57.843867 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ce894-9fbe-40fa-920f-72975184a3fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:57.846501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ce894-9fbe-40fa-920f-72975184a3fa None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:57.852685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a894c-f4be-4d37-a9ac-461289666762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:57.853487 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a894c-f4be-4d37-a9ac-461289666762 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.854769 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a894c-f4be-4d37-a9ac-461289666762 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.854769 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a894c-f4be-4d37-a9ac-461289666762 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.855394 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a894c-f4be-4d37-a9ac-461289666762 None admin] RBAC: Adding query filter params (name=member) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:57.855813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a894c-f4be-4d37-a9ac-461289666762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:57.857504 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a894c-f4be-4d37-a9ac-461289666762 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:57.861522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 40/78] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:57.868958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ce894-9fbe-40fa-920f-72975184a3fa None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:57.869103 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 39/79] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:57.869103 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb94ee4-d4fc-4e55-89fe-747ca90ba221 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.869103 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb94ee4-d4fc-4e55-89fe-747ca90ba221 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.869457 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb94ee4-d4fc-4e55-89fe-747ca90ba221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.892180 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-cfb94ee4-d4fc-4e55-89fe-747ca90ba221 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:57.894349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-cfb94ee4-d4fc-4e55-89fe-747ca90ba221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:58.012826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ce894-9fbe-40fa-920f-72975184a3fa None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.029466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 40/80] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:58.030583 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb94ee4-d4fc-4e55-89fe-747ca90ba221 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.073102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ef336-6154-402a-a490-cf2e07c50ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.074009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:58.075167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ef336-6154-402a-a490-cf2e07c50ee5 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.075644 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ef336-6154-402a-a490-cf2e07c50ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.076117 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ef336-6154-402a-a490-cf2e07c50ee5 None admin] PATH_INFO: `/v3/users/28cc602f739f4f2fbcd0f584e9147da4` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.079024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ef336-6154-402a-a490-cf2e07c50ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=28cc602f739f4f2fbcd0f584e9147da4)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.082750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ef336-6154-402a-a490-cf2e07c50ee5 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:58.085954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 41/81] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:57 2022] GET /identity/v3/users/28cc602f739f4f2fbcd0f584e9147da4 => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:58.087803 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ef336-6154-402a-a490-cf2e07c50ee5 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.137186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:58.200847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb94ee4-d4fc-4e55-89fe-747ca90ba221 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.249887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34ff45-5469-4c26-99b2-67d57532697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.251008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34ff45-5469-4c26-99b2-67d57532697d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.251293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34ff45-5469-4c26-99b2-67d57532697d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.251569 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34ff45-5469-4c26-99b2-67d57532697d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.293587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ef336-6154-402a-a490-cf2e07c50ee5 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.361371 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34ff45-5469-4c26-99b2-67d57532697d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.361810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cdbf0-ed0f-4b29-9873-0d75d0dfcba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.362890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cdbf0-ed0f-4b29-9873-0d75d0dfcba8 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.363775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cdbf0-ed0f-4b29-9873-0d75d0dfcba8 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.364265 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cdbf0-ed0f-4b29-9873-0d75d0dfcba8 None admin] PATH_INFO: `/v3/users/0c72aeb6d2de4684b788eeaec1b07e38` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.364955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34ff45-5469-4c26-99b2-67d57532697d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:58.366663 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cdbf0-ed0f-4b29-9873-0d75d0dfcba8 None admin] RBAC: Authorizing `identity:get_user(user_id=0c72aeb6d2de4684b788eeaec1b07e38)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.369556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cdbf0-ed0f-4b29-9873-0d75d0dfcba8 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:58.373085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 42/82] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/users/0c72aeb6d2de4684b788eeaec1b07e38 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:58.375549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cdbf0-ed0f-4b29-9873-0d75d0dfcba8 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.408101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:58.530487 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:58.551211 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cdbf0-ed0f-4b29-9873-0d75d0dfcba8 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.572459 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 41/83] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:58.573962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34ff45-5469-4c26-99b2-67d57532697d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.620459 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288fff9-c2e0-45c7-8dc9-7056b37dddba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.621697 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288fff9-c2e0-45c7-8dc9-7056b37dddba None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.622324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288fff9-c2e0-45c7-8dc9-7056b37dddba None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.623011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288fff9-c2e0-45c7-8dc9-7056b37dddba None admin] PATH_INFO: `/v3/users/0c72aeb6d2de4684b788eeaec1b07e38` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.624738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288fff9-c2e0-45c7-8dc9-7056b37dddba None admin] RBAC: Authorizing `identity:get_user(user_id=0c72aeb6d2de4684b788eeaec1b07e38)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.626881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288fff9-c2e0-45c7-8dc9-7056b37dddba None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:58.633399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 43/84] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/users/0c72aeb6d2de4684b788eeaec1b07e38 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:58.633399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288fff9-c2e0-45c7-8dc9-7056b37dddba None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.766637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288fff9-c2e0-45c7-8dc9-7056b37dddba None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.785406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34ff45-5469-4c26-99b2-67d57532697d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.811330 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a218e4-8e9f-4335-9b45-8dbecb5ba847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.812108 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a218e4-8e9f-4335-9b45-8dbecb5ba847 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.812228 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a218e4-8e9f-4335-9b45-8dbecb5ba847 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.812528 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a218e4-8e9f-4335-9b45-8dbecb5ba847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.828712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:58.857630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:58.858148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199863f9-bb01-42ba-8da1-2b8c2f4d273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.859197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199863f9-bb01-42ba-8da1-2b8c2f4d273a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.859798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199863f9-bb01-42ba-8da1-2b8c2f4d273a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.860657 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199863f9-bb01-42ba-8da1-2b8c2f4d273a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.908912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a218e4-8e9f-4335-9b45-8dbecb5ba847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.910539 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a218e4-8e9f-4335-9b45-8dbecb5ba847 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:58.968841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199863f9-bb01-42ba-8da1-2b8c2f4d273a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.971608 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199863f9-bb01-42ba-8da1-2b8c2f4d273a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.037874 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 44/85] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:59.039374 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a218e4-8e9f-4335-9b45-8dbecb5ba847 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.116510 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:59.124966 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 42/86] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:59.125859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199863f9-bb01-42ba-8da1-2b8c2f4d273a None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.154352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:59.185679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a218e4-8e9f-4335-9b45-8dbecb5ba847 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:59.230685 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b00e1-8566-4e5c-af7d-b99d7a372bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.231332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b00e1-8566-4e5c-af7d-b99d7a372bde None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.231613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b00e1-8566-4e5c-af7d-b99d7a372bde None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.231889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b00e1-8566-4e5c-af7d-b99d7a372bde None admin] PATH_INFO: `/v3/domains/default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.233107 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b00e1-8566-4e5c-af7d-b99d7a372bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.234608 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b00e1-8566-4e5c-af7d-b99d7a372bde None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.236355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 45/87] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:59.238745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b00e1-8566-4e5c-af7d-b99d7a372bde None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.280412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199863f9-bb01-42ba-8da1-2b8c2f4d273a None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:59.326885 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46048b14-6ba6-48be-8bb9-db48cd2bffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.327525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46048b14-6ba6-48be-8bb9-db48cd2bffdb None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.327813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46048b14-6ba6-48be-8bb9-db48cd2bffdb None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.328102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46048b14-6ba6-48be-8bb9-db48cd2bffdb None admin] PATH_INFO: `/v3/projects/dfc25c361bd14e4d8d7abe0ab2d8ad41` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.329477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46048b14-6ba6-48be-8bb9-db48cd2bffdb None admin] RBAC: Authorizing `identity:get_project(project_id=dfc25c361bd14e4d8d7abe0ab2d8ad41)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.331274 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46048b14-6ba6-48be-8bb9-db48cd2bffdb None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.333543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 43/88] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/projects/dfc25c361bd14e4d8d7abe0ab2d8ad41 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:59.335177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46048b14-6ba6-48be-8bb9-db48cd2bffdb None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.385548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b00e1-8566-4e5c-af7d-b99d7a372bde None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:59.428326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:59.440883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f86dea-7340-47af-867f-b1fa8fe95377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.441972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f86dea-7340-47af-867f-b1fa8fe95377 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.441972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f86dea-7340-47af-867f-b1fa8fe95377 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.442918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f86dea-7340-47af-867f-b1fa8fe95377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.472365 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:59.491241 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46048b14-6ba6-48be-8bb9-db48cd2bffdb None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:59.549151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48051cb-4336-4667-b132-7d37c036c7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.550157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48051cb-4336-4667-b132-7d37c036c7c5 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.550595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48051cb-4336-4667-b132-7d37c036c7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.550952 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f86dea-7340-47af-867f-b1fa8fe95377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.551707 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48051cb-4336-4667-b132-7d37c036c7c5 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.553617 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f86dea-7340-47af-867f-b1fa8fe95377 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.553807 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48051cb-4336-4667-b132-7d37c036c7c5 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.556150 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48051cb-4336-4667-b132-7d37c036c7c5 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.558954 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 44/89] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:59.560361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48051cb-4336-4667-b132-7d37c036c7c5 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.703212 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48051cb-4336-4667-b132-7d37c036c7c5 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:59.705415 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 46/90] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:59.706586 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f86dea-7340-47af-867f-b1fa8fe95377 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.742785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:59.752030 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c154ba7-12b3-4e8a-b5b0-5d7ddaedbff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.752912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c154ba7-12b3-4e8a-b5b0-5d7ddaedbff4 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.753308 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c154ba7-12b3-4e8a-b5b0-5d7ddaedbff4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.753684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c154ba7-12b3-4e8a-b5b0-5d7ddaedbff4 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.755474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c154ba7-12b3-4e8a-b5b0-5d7ddaedbff4 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.757549 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c154ba7-12b3-4e8a-b5b0-5d7ddaedbff4 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.759506 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 45/91] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:59.760585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c154ba7-12b3-4e8a-b5b0-5d7ddaedbff4 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.793120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:59.849075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f86dea-7340-47af-867f-b1fa8fe95377 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:59.898138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3c1d2-368b-468b-b644-a28debe1bf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.898780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3c1d2-368b-468b-b644-a28debe1bf35 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.899063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3c1d2-368b-468b-b644-a28debe1bf35 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.899334 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3c1d2-368b-468b-b644-a28debe1bf35 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.900026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3c1d2-368b-468b-b644-a28debe1bf35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.901726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3c1d2-368b-468b-b644-a28debe1bf35 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.902180 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c154ba7-12b3-4e8a-b5b0-5d7ddaedbff4 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:59.937222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 47/92] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:52:59 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:52:59.938152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3c1d2-368b-468b-b644-a28debe1bf35 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.968721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51664c-a836-4e4f-b217-9c2456b05661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.969444 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51664c-a836-4e4f-b217-9c2456b05661 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.969741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51664c-a836-4e4f-b217-9c2456b05661 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.970037 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51664c-a836-4e4f-b217-9c2456b05661 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.970811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51664c-a836-4e4f-b217-9c2456b05661 None admin] RBAC: Adding query filter params (role.id=30891346cde644e7bd9ae90a3876efc8, scope.project.id=dfc25c361bd14e4d8d7abe0ab2d8ad41, user.id=0c72aeb6d2de4684b788eeaec1b07e38) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:59.971126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51664c-a836-4e4f-b217-9c2456b05661 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.973165 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51664c-a836-4e4f-b217-9c2456b05661 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.980460 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 46/93] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/role_assignments?user.id=0c72aeb6d2de4684b788eeaec1b07e38&scope.project.id=dfc25c361bd14e4d8d7abe0ab2d8ad41&role.id=30891346cde644e7bd9ae90a3876efc8 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:59.982367 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51664c-a836-4e4f-b217-9c2456b05661 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:00.133031 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:00.152804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3c1d2-368b-468b-b644-a28debe1bf35 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:00.220356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:00.231358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294d70a-cfdc-469b-be89-b6048ea2b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:00.231975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294d70a-cfdc-469b-be89-b6048ea2b8a7 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:00.232279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294d70a-cfdc-469b-be89-b6048ea2b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:00.232645 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294d70a-cfdc-469b-be89-b6048ea2b8a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:00.233474 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294d70a-cfdc-469b-be89-b6048ea2b8a7 None admin] RBAC: Adding query filter params (role.id=0560a82175224c8e86d1b430212748d4, scope.project.id=d2ad57e577854d67ae2401564821ce05, user.id=0c72aeb6d2de4684b788eeaec1b07e38) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:00.235114 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294d70a-cfdc-469b-be89-b6048ea2b8a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:00.235969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294d70a-cfdc-469b-be89-b6048ea2b8a7 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:00.243874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51664c-a836-4e4f-b217-9c2456b05661 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:00.248886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 48/94] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/role_assignments?user.id=0c72aeb6d2de4684b788eeaec1b07e38&scope.project.id=d2ad57e577854d67ae2401564821ce05&role.id=0560a82175224c8e86d1b430212748d4 => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:00.250327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294d70a-cfdc-469b-be89-b6048ea2b8a7 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:00.311994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6c243-8c51-4ec0-81df-d9d4df79ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:00.313076 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6c243-8c51-4ec0-81df-d9d4df79ecb7 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:00.313558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6c243-8c51-4ec0-81df-d9d4df79ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:00.314026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6c243-8c51-4ec0-81df-d9d4df79ecb7 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:00.316187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6c243-8c51-4ec0-81df-d9d4df79ecb7 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:00.319239 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6c243-8c51-4ec0-81df-d9d4df79ecb7 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:00.322470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 47/95] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:00.333198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6c243-8c51-4ec0-81df-d9d4df79ecb7 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:00.499152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294d70a-cfdc-469b-be89-b6048ea2b8a7 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:00.548492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6c243-8c51-4ec0-81df-d9d4df79ecb7 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:00.570371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f04a9d-ceac-4082-9c0d-6a7a72e5b4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:00.571757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f04a9d-ceac-4082-9c0d-6a7a72e5b4ec None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:00.571757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f04a9d-ceac-4082-9c0d-6a7a72e5b4ec None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:00.572258 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f04a9d-ceac-4082-9c0d-6a7a72e5b4ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:00.573642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f04a9d-ceac-4082-9c0d-6a7a72e5b4ec None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=d2ad57e577854d67ae2401564821ce05, user.id=28cc602f739f4f2fbcd0f584e9147da4) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:00.574168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f04a9d-ceac-4082-9c0d-6a7a72e5b4ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:00.576841 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f04a9d-ceac-4082-9c0d-6a7a72e5b4ec None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:00.588218 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 49/96] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:00 2022] GET /identity/v3/role_assignments?user.id=28cc602f739f4f2fbcd0f584e9147da4&scope.project.id=d2ad57e577854d67ae2401564821ce05&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 259 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:00.624302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa58f9-bd3b-4e31-89b4-c23e671daa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:00.625936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa58f9-bd3b-4e31-89b4-c23e671daa9b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:00.626697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa58f9-bd3b-4e31-89b4-c23e671daa9b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:00.627415 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa58f9-bd3b-4e31-89b4-c23e671daa9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:00.629431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa58f9-bd3b-4e31-89b4-c23e671daa9b None admin] RBAC: Adding query filter params (role.id=30891346cde644e7bd9ae90a3876efc8, scope.project.id=d2ad57e577854d67ae2401564821ce05, user.id=0c72aeb6d2de4684b788eeaec1b07e38) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:00.630318 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa58f9-bd3b-4e31-89b4-c23e671daa9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:00.633345 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa58f9-bd3b-4e31-89b4-c23e671daa9b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:00.645648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 48/97] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:00 2022] GET /identity/v3/role_assignments?user.id=0c72aeb6d2de4684b788eeaec1b07e38&scope.project.id=d2ad57e577854d67ae2401564821ce05&role.id=30891346cde644e7bd9ae90a3876efc8 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:03.706103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312002c-047a-478d-a8bd-694a5f12fc33 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:03.707087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312002c-047a-478d-a8bd-694a5f12fc33 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:03.708432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312002c-047a-478d-a8bd-694a5f12fc33 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:03.711094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 50/98] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:03.720642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116b39c-f799-4501-bf2c-0d53ab75d058 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:03.722241 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116b39c-f799-4501-bf2c-0d53ab75d058 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:03.723219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116b39c-f799-4501-bf2c-0d53ab75d058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:03.765757 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-d116b39c-f799-4501-bf2c-0d53ab75d058 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:03.767586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d116b39c-f799-4501-bf2c-0d53ab75d058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:03.799174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:03.893111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 49/99] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:04.295624 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc46e4-5c48-4fe7-87d7-dddeff0ed873 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:04.296141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc46e4-5c48-4fe7-87d7-dddeff0ed873 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:04.296636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc46e4-5c48-4fe7-87d7-dddeff0ed873 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:04.299356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 51/100] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:04.313581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e29597-35de-4dbe-b17d-c14c34888c69 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:04.314072 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e29597-35de-4dbe-b17d-c14c34888c69 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:04.314543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e29597-35de-4dbe-b17d-c14c34888c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:04.354185 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-b2e29597-35de-4dbe-b17d-c14c34888c69 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:04.356273 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b2e29597-35de-4dbe-b17d-c14c34888c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:04.403356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c0948-d03f-486c-abf5-ff555f5f0caa None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:04.403811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c0948-d03f-486c-abf5-ff555f5f0caa None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:04.404291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c0948-d03f-486c-abf5-ff555f5f0caa None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:04.407395 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 52/101] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:04.418201 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4437f8c-a87d-415e-954b-1c9532b29b54 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:04.418628 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4437f8c-a87d-415e-954b-1c9532b29b54 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:04.419066 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4437f8c-a87d-415e-954b-1c9532b29b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:04.478360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-e4437f8c-a87d-415e-954b-1c9532b29b54 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:04.480615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-e4437f8c-a87d-415e-954b-1c9532b29b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:04.490610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:04.515279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 50/102] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:04.528800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e29597-35de-4dbe-b17d-c14c34888c69 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:04.722210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 53/103] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:04.727232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fdf12-2d42-4d79-844d-96fa187350d2 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:04.728518 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fdf12-2d42-4d79-844d-96fa187350d2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:04.731799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fdf12-2d42-4d79-844d-96fa187350d2 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:04.735105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 54/104] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:04.753136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236b406-efd1-41e4-9af1-421345dc08d2 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:04.754133 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236b406-efd1-41e4-9af1-421345dc08d2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:04.754875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236b406-efd1-41e4-9af1-421345dc08d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:04.817797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-8236b406-efd1-41e4-9af1-421345dc08d2 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:04.821770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:04.825210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-8236b406-efd1-41e4-9af1-421345dc08d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:04.920543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e29597-35de-4dbe-b17d-c14c34888c69 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:05.047152 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5041f17-ecb6-48c3-b9c7-81a627d1c072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:05.048192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5041f17-ecb6-48c3-b9c7-81a627d1c072 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:05.048694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5041f17-ecb6-48c3-b9c7-81a627d1c072 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:05.049152 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5041f17-ecb6-48c3-b9c7-81a627d1c072 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:05.086364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5041f17-ecb6-48c3-b9c7-81a627d1c072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-b5041f17-ecb6-48c3-b9c7-81a627d1c072 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:05.097831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:05.099656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:05.101109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:05.101109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:05.101109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:05.101109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:05.101109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:05.101109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:05.101109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:05.101109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:05.101109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:05.101109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:05.101109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:05.101109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:05.101109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 51/105] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 572 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:05.107068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 55/106] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:05.111897 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5041f17-ecb6-48c3-b9c7-81a627d1c072 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:05.312919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5041f17-ecb6-48c3-b9c7-81a627d1c072 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:05.336198 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236b406-efd1-41e4-9af1-421345dc08d2 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:05.359201 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15926b3-3f28-4691-9dc9-9ecdaadf9267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:05.359847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15926b3-3f28-4691-9dc9-9ecdaadf9267 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:05.360134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15926b3-3f28-4691-9dc9-9ecdaadf9267 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:05.360543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15926b3-3f28-4691-9dc9-9ecdaadf9267 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:05.361453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15926b3-3f28-4691-9dc9-9ecdaadf9267 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:05.362226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15926b3-3f28-4691-9dc9-9ecdaadf9267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:05.363870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15926b3-3f28-4691-9dc9-9ecdaadf9267 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:05.380210 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 52/107] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:05.385663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15926b3-3f28-4691-9dc9-9ecdaadf9267 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:05.390178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:05.500116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:05.522499 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15926b3-3f28-4691-9dc9-9ecdaadf9267 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:05.564924 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236b406-efd1-41e4-9af1-421345dc08d2 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:05.575163 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7367c2-9763-48ec-857d-e88b6f74739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:05.575915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7367c2-9763-48ec-857d-e88b6f74739f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:05.576177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7367c2-9763-48ec-857d-e88b6f74739f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:05.576513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7367c2-9763-48ec-857d-e88b6f74739f None admin] PATH_INFO: `/v3/users/0c72aeb6d2de4684b788eeaec1b07e38` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:05.577750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7367c2-9763-48ec-857d-e88b6f74739f None admin] RBAC: Authorizing `identity:get_user(user_id=0c72aeb6d2de4684b788eeaec1b07e38)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:05.579812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7367c2-9763-48ec-857d-e88b6f74739f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:05.582586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 53/108] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:05 2022] GET /identity/v3/users/0c72aeb6d2de4684b788eeaec1b07e38 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:05.584089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7367c2-9763-48ec-857d-e88b6f74739f None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:05.675723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cdb52-5289-4b18-aa65-0fcb5cbaad0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:05.676895 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cdb52-5289-4b18-aa65-0fcb5cbaad0b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:05.677401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cdb52-5289-4b18-aa65-0fcb5cbaad0b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:05.677895 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cdb52-5289-4b18-aa65-0fcb5cbaad0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:05.678134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:05.712947 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cdb52-5289-4b18-aa65-0fcb5cbaad0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-d83cdb52-5289-4b18-aa65-0fcb5cbaad0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:05.726970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:05.731570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:05.734732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:05.734732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:05.734732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:05.734732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:05.734732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:05.734732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:05.734732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:05.734732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:05.734732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:05.734732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:05.734732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:05.734732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:53:05.734732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 56/109] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:05.734732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cdb52-5289-4b18-aa65-0fcb5cbaad0b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:05.746390 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7367c2-9763-48ec-857d-e88b6f74739f None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:05.793270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40a327-7cb4-4f49-a348-7f8fc7c10273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:05.793954 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40a327-7cb4-4f49-a348-7f8fc7c10273 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:05.794238 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40a327-7cb4-4f49-a348-7f8fc7c10273 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:05.794516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40a327-7cb4-4f49-a348-7f8fc7c10273 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:05.810983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40a327-7cb4-4f49-a348-7f8fc7c10273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-1f40a327-7cb4-4f49-a348-7f8fc7c10273 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:05.818120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:05.819858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:05.821510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:05.821510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:05.821510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:05.821510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:05.821510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:05.821510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:05.821510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:05.821510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:05.821510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:05.821510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:05.821510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:05.821510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:05.821510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 54/110] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:05.823536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449ab7-a7fb-4ede-a84d-2821bd991576 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:05.823536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449ab7-a7fb-4ede-a84d-2821bd991576 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:05.823536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449ab7-a7fb-4ede-a84d-2821bd991576 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:05.825545 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 55/111] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:05.830760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5449ab7-a7fb-4ede-a84d-2821bd991576 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:05.970705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cdb52-5289-4b18-aa65-0fcb5cbaad0b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:06.011894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:06.020478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942cd1f-7f67-4edb-af47-bdc91d4eca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:06.021362 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942cd1f-7f67-4edb-af47-bdc91d4eca17 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.021796 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942cd1f-7f67-4edb-af47-bdc91d4eca17 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.022245 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942cd1f-7f67-4edb-af47-bdc91d4eca17 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.024410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942cd1f-7f67-4edb-af47-bdc91d4eca17 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:06.026157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5449ab7-a7fb-4ede-a84d-2821bd991576 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:06.027030 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942cd1f-7f67-4edb-af47-bdc91d4eca17 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:06.030191 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 57/112] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:05 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:06.030988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942cd1f-7f67-4edb-af47-bdc91d4eca17 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:06.081268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:06.091845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a88ca-9168-49e6-82de-b52c0a8ca63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:06.092810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a88ca-9168-49e6-82de-b52c0a8ca63e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.093307 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a88ca-9168-49e6-82de-b52c0a8ca63e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.093811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a88ca-9168-49e6-82de-b52c0a8ca63e None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.095062 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a88ca-9168-49e6-82de-b52c0a8ca63e None admin] RBAC: Adding query filter params (name=reader) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:06.095610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a88ca-9168-49e6-82de-b52c0a8ca63e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:06.098287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a88ca-9168-49e6-82de-b52c0a8ca63e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:06.115908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 56/113] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:06.117477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a88ca-9168-49e6-82de-b52c0a8ca63e None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:06.172473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942cd1f-7f67-4edb-af47-bdc91d4eca17 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:06.218486 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a58ab5-04fb-49e8-ae0f-75459478ac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:06.219596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a58ab5-04fb-49e8-ae0f-75459478ac18 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.220096 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a58ab5-04fb-49e8-ae0f-75459478ac18 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.220613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a58ab5-04fb-49e8-ae0f-75459478ac18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.242124 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a58ab5-04fb-49e8-ae0f-75459478ac18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-48a58ab5-04fb-49e8-ae0f-75459478ac18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:06.251531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:06.252652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:06.253610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:06.253610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:06.253610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:06.253610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:06.253610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:06.253610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:06.253610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:06.253610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:06.253610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:06.253610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:06.253610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:06.253610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:53:06.253610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 58/114] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:06.255904 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21948aa0-e14d-47b2-8c6a-79b004bb58f5 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.256406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21948aa0-e14d-47b2-8c6a-79b004bb58f5 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.256886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21948aa0-e14d-47b2-8c6a-79b004bb58f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.278156 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a88ca-9168-49e6-82de-b52c0a8ca63e None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:06.287766 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-21948aa0-e14d-47b2-8c6a-79b004bb58f5 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:06.289947 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-21948aa0-e14d-47b2-8c6a-79b004bb58f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:06.320218 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236a1f5-a05b-4b1d-ac88-93cfe8cad991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:06.320885 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236a1f5-a05b-4b1d-ac88-93cfe8cad991 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.321173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236a1f5-a05b-4b1d-ac88-93cfe8cad991 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.321453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236a1f5-a05b-4b1d-ac88-93cfe8cad991 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.322140 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236a1f5-a05b-4b1d-ac88-93cfe8cad991 None admin] RBAC: Adding query filter params (name=member) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:06.322464 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236a1f5-a05b-4b1d-ac88-93cfe8cad991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:06.323898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236a1f5-a05b-4b1d-ac88-93cfe8cad991 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:06.335874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 57/115] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:06.337817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a3c81-bbb2-4998-aa04-a11e4e1c0a07 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.338384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a3c81-bbb2-4998-aa04-a11e4e1c0a07 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.338671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a3c81-bbb2-4998-aa04-a11e4e1c0a07 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.344624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 58/116] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:06.344624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a3c81-bbb2-4998-aa04-a11e4e1c0a07 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:06.383823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:06.403427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 59/117] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:06.409172 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21948aa0-e14d-47b2-8c6a-79b004bb58f5 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:06.458047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:06.546224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a3c81-bbb2-4998-aa04-a11e4e1c0a07 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:06.604166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21948aa0-e14d-47b2-8c6a-79b004bb58f5 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:06.611588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eff0b8-ddc9-419d-9cd5-041d1c3626e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:06.612777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eff0b8-ddc9-419d-9cd5-041d1c3626e9 None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.613288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eff0b8-ddc9-419d-9cd5-041d1c3626e9 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.613811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eff0b8-ddc9-419d-9cd5-041d1c3626e9 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05/users/0c72aeb6d2de4684b788eeaec1b07e38/roles/0560a82175224c8e86d1b430212748d4` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.617747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eff0b8-ddc9-419d-9cd5-041d1c3626e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2ad57e577854d67ae2401564821ce05, user_id=0c72aeb6d2de4684b788eeaec1b07e38, role_id=0560a82175224c8e86d1b430212748d4)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:06.620549 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eff0b8-ddc9-419d-9cd5-041d1c3626e9 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:06.647605 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 59/118] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:53:06 2022] PUT /identity/v3/projects/d2ad57e577854d67ae2401564821ce05/users/0c72aeb6d2de4684b788eeaec1b07e38/roles/0560a82175224c8e86d1b430212748d4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:06.649129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eff0b8-ddc9-419d-9cd5-041d1c3626e9 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:06.679143 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638a9dc-6150-46be-a4cd-224f4c28a87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:06.680884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638a9dc-6150-46be-a4cd-224f4c28a87c None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.682825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638a9dc-6150-46be-a4cd-224f4c28a87c None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.683792 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638a9dc-6150-46be-a4cd-224f4c28a87c None admin] PATH_INFO: `/v3/users/f94fa0cb98ca4b9e80781353d561ab11` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.727733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638a9dc-6150-46be-a4cd-224f4c28a87c None admin] RBAC: Authorizing `identity:get_user(user_id=f94fa0cb98ca4b9e80781353d561ab11)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:06.730356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638a9dc-6150-46be-a4cd-224f4c28a87c None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:06.733166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 60/119] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:06 2022] GET /identity/v3/users/f94fa0cb98ca4b9e80781353d561ab11 => generated 289 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:06.739494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638a9dc-6150-46be-a4cd-224f4c28a87c None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:06.829690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:06.862047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eff0b8-ddc9-419d-9cd5-041d1c3626e9 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:06.890675 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:06.933228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f660f90-1df0-4507-81fb-34571c4dc749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:06.934474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f660f90-1df0-4507-81fb-34571c4dc749 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.934886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f660f90-1df0-4507-81fb-34571c4dc749 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.935227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f660f90-1df0-4507-81fb-34571c4dc749 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.936153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f660f90-1df0-4507-81fb-34571c4dc749 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:06.936691 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f660f90-1df0-4507-81fb-34571c4dc749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:06.938129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638a9dc-6150-46be-a4cd-224f4c28a87c None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:06.938854 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f660f90-1df0-4507-81fb-34571c4dc749 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:06.959248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 60/120] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:06.959248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca4f92-1888-4da8-aec6-060c508ce79c None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.959248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca4f92-1888-4da8-aec6-060c508ce79c None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.959248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca4f92-1888-4da8-aec6-060c508ce79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.995816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-abca4f92-1888-4da8-aec6-060c508ce79c None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:06.998053 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-abca4f92-1888-4da8-aec6-060c508ce79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:07.005767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1cfd3-1051-4b4a-97c2-07a2176a96d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:07.006826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1cfd3-1051-4b4a-97c2-07a2176a96d2 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:07.007306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1cfd3-1051-4b4a-97c2-07a2176a96d2 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:07.007815 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1cfd3-1051-4b4a-97c2-07a2176a96d2 None admin] PATH_INFO: `/v3/users/0c72aeb6d2de4684b788eeaec1b07e38` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:07.010021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1cfd3-1051-4b4a-97c2-07a2176a96d2 None admin] RBAC: Authorizing `identity:get_user(user_id=0c72aeb6d2de4684b788eeaec1b07e38)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:07.012875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1cfd3-1051-4b4a-97c2-07a2176a96d2 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:07.016457 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 61/121] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:06 2022] GET /identity/v3/users/0c72aeb6d2de4684b788eeaec1b07e38 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:07.017990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1cfd3-1051-4b4a-97c2-07a2176a96d2 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:07.098775 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 61/122] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:07.099945 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca4f92-1888-4da8-aec6-060c508ce79c None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:07.218845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1cfd3-1051-4b4a-97c2-07a2176a96d2 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:07.238484 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:07.264853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362657cc-c6dd-4419-b5bf-dd60f0c6a1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:07.265522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362657cc-c6dd-4419-b5bf-dd60f0c6a1bd None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:07.265807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362657cc-c6dd-4419-b5bf-dd60f0c6a1bd None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:07.266089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362657cc-c6dd-4419-b5bf-dd60f0c6a1bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:07.279943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362657cc-c6dd-4419-b5bf-dd60f0c6a1bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-362657cc-c6dd-4419-b5bf-dd60f0c6a1bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:07.287308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:07.289283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:07.291060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:07.291060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:07.291060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:07.291060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:07.291060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:07.291060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:07.291060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:07.291060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:07.291060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:07.291060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:07.291060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:07.291060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:53:07.291060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 62/123] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:07.291060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362657cc-c6dd-4419-b5bf-dd60f0c6a1bd None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:07.350336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca4f92-1888-4da8-aec6-060c508ce79c None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:07.373076 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:07.428090 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce981b-7dcd-4942-95ad-6332311e6077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:07.429526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce981b-7dcd-4942-95ad-6332311e6077 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:07.430190 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce981b-7dcd-4942-95ad-6332311e6077 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:07.430885 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce981b-7dcd-4942-95ad-6332311e6077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:07.505617 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362657cc-c6dd-4419-b5bf-dd60f0c6a1bd None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:07.551183 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce981b-7dcd-4942-95ad-6332311e6077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:07.554475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce981b-7dcd-4942-95ad-6332311e6077 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:07.561048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bab6d-ee4b-4c17-96b1-52b43f10603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:07.561940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bab6d-ee4b-4c17-96b1-52b43f10603b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:07.562429 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bab6d-ee4b-4c17-96b1-52b43f10603b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:07.562861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bab6d-ee4b-4c17-96b1-52b43f10603b None admin] PATH_INFO: `/v3/users/28cc602f739f4f2fbcd0f584e9147da4` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:07.564282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bab6d-ee4b-4c17-96b1-52b43f10603b None admin] RBAC: Authorizing `identity:get_user(user_id=28cc602f739f4f2fbcd0f584e9147da4)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:07.566074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bab6d-ee4b-4c17-96b1-52b43f10603b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:07.573322 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 63/124] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:07 2022] GET /identity/v3/users/28cc602f739f4f2fbcd0f584e9147da4 => generated 247 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:07.573322 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bab6d-ee4b-4c17-96b1-52b43f10603b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:07.647004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:07.747813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 62/125] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:07.749394 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce981b-7dcd-4942-95ad-6332311e6077 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:07.760212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bab6d-ee4b-4c17-96b1-52b43f10603b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:07.767800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:07.832643 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a1aba-1e63-46e8-ac6f-7e8488ba7aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:07.833735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a1aba-1e63-46e8-ac6f-7e8488ba7aac None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:07.834228 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a1aba-1e63-46e8-ac6f-7e8488ba7aac None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:07.834723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a1aba-1e63-46e8-ac6f-7e8488ba7aac None admin] PATH_INFO: `/v3/projects/dfc25c361bd14e4d8d7abe0ab2d8ad41` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:07.837527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a1aba-1e63-46e8-ac6f-7e8488ba7aac None admin] RBAC: Authorizing `identity:get_project(project_id=dfc25c361bd14e4d8d7abe0ab2d8ad41)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:07.839638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a1aba-1e63-46e8-ac6f-7e8488ba7aac None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:07.847987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 64/126] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:07 2022] GET /identity/v3/projects/dfc25c361bd14e4d8d7abe0ab2d8ad41 => generated 312 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:07.847987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a1aba-1e63-46e8-ac6f-7e8488ba7aac None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:07.963179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce981b-7dcd-4942-95ad-6332311e6077 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:08.034540 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b26c0-8823-474a-84ca-91f4c2975709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:08.035375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a1aba-1e63-46e8-ac6f-7e8488ba7aac None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:08.035532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b26c0-8823-474a-84ca-91f4c2975709 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.035952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b26c0-8823-474a-84ca-91f4c2975709 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.036423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b26c0-8823-474a-84ca-91f4c2975709 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.037604 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b26c0-8823-474a-84ca-91f4c2975709 None admin] RBAC: Adding query filter params (name=member) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:08.038140 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b26c0-8823-474a-84ca-91f4c2975709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:08.040881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b26c0-8823-474a-84ca-91f4c2975709 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:08.055039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:08.060355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 63/127] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:08.061909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b26c0-8823-474a-84ca-91f4c2975709 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:08.111637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc5f57-80a4-498b-a2b5-1cb528a3a132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:08.112775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc5f57-80a4-498b-a2b5-1cb528a3a132 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.113295 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc5f57-80a4-498b-a2b5-1cb528a3a132 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.113768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc5f57-80a4-498b-a2b5-1cb528a3a132 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.115952 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc5f57-80a4-498b-a2b5-1cb528a3a132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:08.118921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc5f57-80a4-498b-a2b5-1cb528a3a132 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:08.124445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 65/128] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:08.124445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc5f57-80a4-498b-a2b5-1cb528a3a132 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:08.181804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:08.246615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b26c0-8823-474a-84ca-91f4c2975709 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:08.311562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8b0e6-5041-4829-9033-4be7dc6ad8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:08.312478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8b0e6-5041-4829-9033-4be7dc6ad8fb None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.312881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8b0e6-5041-4829-9033-4be7dc6ad8fb None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.313268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8b0e6-5041-4829-9033-4be7dc6ad8fb None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.315267 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8b0e6-5041-4829-9033-4be7dc6ad8fb None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:08.321304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8b0e6-5041-4829-9033-4be7dc6ad8fb None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:08.321304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 64/129] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:08 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:08.322522 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8b0e6-5041-4829-9033-4be7dc6ad8fb None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:08.347242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc5f57-80a4-498b-a2b5-1cb528a3a132 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:08.416956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4708947-48d0-4a84-8d1b-9959df2834e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:08.418113 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4708947-48d0-4a84-8d1b-9959df2834e7 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.418549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4708947-48d0-4a84-8d1b-9959df2834e7 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.418985 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4708947-48d0-4a84-8d1b-9959df2834e7 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.421013 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4708947-48d0-4a84-8d1b-9959df2834e7 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:08.423494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4708947-48d0-4a84-8d1b-9959df2834e7 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:08.436222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 66/130] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:08 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:08.436222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4708947-48d0-4a84-8d1b-9959df2834e7 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:08.508348 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:08.529061 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8b0e6-5041-4829-9033-4be7dc6ad8fb None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:08.597120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e122d-3376-4b40-93b3-a3fbe91826d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:08.598230 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e122d-3376-4b40-93b3-a3fbe91826d6 None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.598741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e122d-3376-4b40-93b3-a3fbe91826d6 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.599243 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e122d-3376-4b40-93b3-a3fbe91826d6 None admin] PATH_INFO: `/v3/projects/dfc25c361bd14e4d8d7abe0ab2d8ad41/users/0c72aeb6d2de4684b788eeaec1b07e38/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.602902 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e122d-3376-4b40-93b3-a3fbe91826d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfc25c361bd14e4d8d7abe0ab2d8ad41, user_id=0c72aeb6d2de4684b788eeaec1b07e38, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:08.603156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4708947-48d0-4a84-8d1b-9959df2834e7 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:08.605710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e122d-3376-4b40-93b3-a3fbe91826d6 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:08.611412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:08.627817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 65/131] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:53:08 2022] PUT /identity/v3/projects/dfc25c361bd14e4d8d7abe0ab2d8ad41/users/0c72aeb6d2de4684b788eeaec1b07e38/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:08.637550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e122d-3376-4b40-93b3-a3fbe91826d6 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:08.677332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99fe47-9850-4fe0-9b43-747c59084069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:08.678576 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99fe47-9850-4fe0-9b43-747c59084069 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.679103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99fe47-9850-4fe0-9b43-747c59084069 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.679389 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99fe47-9850-4fe0-9b43-747c59084069 None admin] PATH_INFO: `/v3/users/0c72aeb6d2de4684b788eeaec1b07e38` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.681924 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99fe47-9850-4fe0-9b43-747c59084069 None admin] RBAC: Authorizing `identity:get_user(user_id=0c72aeb6d2de4684b788eeaec1b07e38)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:08.684997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99fe47-9850-4fe0-9b43-747c59084069 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:08.688626 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 67/132] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:08 2022] GET /identity/v3/users/0c72aeb6d2de4684b788eeaec1b07e38 => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:08.689928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99fe47-9850-4fe0-9b43-747c59084069 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:08.869763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e122d-3376-4b40-93b3-a3fbe91826d6 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:08.877291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99fe47-9850-4fe0-9b43-747c59084069 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:08.900419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:08.940157 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf50b4f-2847-4345-918c-dc67eb308800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:08.941794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf50b4f-2847-4345-918c-dc67eb308800 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.942252 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf50b4f-2847-4345-918c-dc67eb308800 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.942725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf50b4f-2847-4345-918c-dc67eb308800 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05/users/28cc602f739f4f2fbcd0f584e9147da4/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.946291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf50b4f-2847-4345-918c-dc67eb308800 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2ad57e577854d67ae2401564821ce05, user_id=28cc602f739f4f2fbcd0f584e9147da4, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:08.949387 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf50b4f-2847-4345-918c-dc67eb308800 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:08.967504 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353fcf0-253f-4567-ba8b-1e5f99e80b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:08.969569 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353fcf0-253f-4567-ba8b-1e5f99e80b46 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.970475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353fcf0-253f-4567-ba8b-1e5f99e80b46 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.970971 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353fcf0-253f-4567-ba8b-1e5f99e80b46 None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.972366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353fcf0-253f-4567-ba8b-1e5f99e80b46 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:08.976772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 68/133] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:53:08 2022] PUT /identity/v3/projects/d2ad57e577854d67ae2401564821ce05/users/28cc602f739f4f2fbcd0f584e9147da4/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:08.978640 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf50b4f-2847-4345-918c-dc67eb308800 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:08.980837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353fcf0-253f-4567-ba8b-1e5f99e80b46 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:09.082526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 66/134] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Sep 7 12:53:08 2022] POST /identity/v3/projects => generated 302 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:09.085627 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353fcf0-253f-4567-ba8b-1e5f99e80b46 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:09.240951 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:09.364761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf50b4f-2847-4345-918c-dc67eb308800 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:09.396596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353fcf0-253f-4567-ba8b-1e5f99e80b46 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:09.455866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300fcf0-992c-4bd1-9947-af1d14f93ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:09.457677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300fcf0-992c-4bd1-9947-af1d14f93ca1 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.458178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300fcf0-992c-4bd1-9947-af1d14f93ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.458788 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300fcf0-992c-4bd1-9947-af1d14f93ca1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.460692 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300fcf0-992c-4bd1-9947-af1d14f93ca1 None admin] RBAC: Adding query filter params (role.id=ad483fe996284752ae36cd0fcfcbf503, scope.project.id=d2ad57e577854d67ae2401564821ce05, user.id=f94fa0cb98ca4b9e80781353d561ab11) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:09.461239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300fcf0-992c-4bd1-9947-af1d14f93ca1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:09.464147 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300fcf0-992c-4bd1-9947-af1d14f93ca1 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:09.464759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1716a-d419-4fa9-a5b0-e232d052c0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:09.465419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1716a-d419-4fa9-a5b0-e232d052c0f1 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.465698 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1716a-d419-4fa9-a5b0-e232d052c0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.465976 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1716a-d419-4fa9-a5b0-e232d052c0f1 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.467237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1716a-d419-4fa9-a5b0-e232d052c0f1 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:09.468813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1716a-d419-4fa9-a5b0-e232d052c0f1 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:09.470908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 67/135] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:09 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:09.472309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd6d67-b9cb-4fb0-b3ae-8329c573a4d8 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.473338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd6d67-b9cb-4fb0-b3ae-8329c573a4d8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.473722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd6d67-b9cb-4fb0-b3ae-8329c573a4d8 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.475283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 68/136] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:09.478454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 69/137] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:08 2022] GET /identity/v3/role_assignments?user.id=f94fa0cb98ca4b9e80781353d561ab11&scope.project.id=d2ad57e577854d67ae2401564821ce05&role.id=ad483fe996284752ae36cd0fcfcbf503 => generated 259 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:09.481714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00224544-be0d-457f-8b3c-e44b2c8c45f4 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.482084 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00224544-be0d-457f-8b3c-e44b2c8c45f4 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.482430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00224544-be0d-457f-8b3c-e44b2c8c45f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.485854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300fcf0-992c-4bd1-9947-af1d14f93ca1 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:09.517077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-00224544-be0d-457f-8b3c-e44b2c8c45f4 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:09.519173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-00224544-be0d-457f-8b3c-e44b2c8c45f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:09.577089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:09.690608 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 69/138] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:09.727924 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300fcf0-992c-4bd1-9947-af1d14f93ca1 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:09.776460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e06c8-6195-4fc1-af50-06fec4db7845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:09.777063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e06c8-6195-4fc1-af50-06fec4db7845 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.777350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e06c8-6195-4fc1-af50-06fec4db7845 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.777632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e06c8-6195-4fc1-af50-06fec4db7845 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05/users/0c72aeb6d2de4684b788eeaec1b07e38/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.786265 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e06c8-6195-4fc1-af50-06fec4db7845 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2ad57e577854d67ae2401564821ce05, user_id=0c72aeb6d2de4684b788eeaec1b07e38, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:09.788398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e06c8-6195-4fc1-af50-06fec4db7845 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:09.806223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 70/139] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:53:09 2022] PUT /identity/v3/projects/d2ad57e577854d67ae2401564821ce05/users/0c72aeb6d2de4684b788eeaec1b07e38/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:10.320766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00224544-be0d-457f-8b3c-e44b2c8c45f4 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:10.410015 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:10.519846 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00224544-be0d-457f-8b3c-e44b2c8c45f4 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:10.582636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d497f2f-e59e-499f-9ba5-dcdd53aef757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:10.583221 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d497f2f-e59e-499f-9ba5-dcdd53aef757 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:10.583516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d497f2f-e59e-499f-9ba5-dcdd53aef757 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:10.583936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d497f2f-e59e-499f-9ba5-dcdd53aef757 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:10.596711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d497f2f-e59e-499f-9ba5-dcdd53aef757 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-5d497f2f-e59e-499f-9ba5-dcdd53aef757 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:10.603832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:10.604796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:10.605538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:10.605538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:10.605538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:10.605538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:10.605538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:10.605538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:10.605538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:10.605538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:10.605538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:10.605538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:10.605538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:10.605538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:10.605538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 70/140] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:10.615594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e06c8-6195-4fc1-af50-06fec4db7845 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:10.774985 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:10.781068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e06c8-6195-4fc1-af50-06fec4db7845 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:10.833263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8955908-2ff7-44d9-a074-27d881812561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:10.834009 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8955908-2ff7-44d9-a074-27d881812561 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:10.834413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8955908-2ff7-44d9-a074-27d881812561 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:10.834821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8955908-2ff7-44d9-a074-27d881812561 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:10.835831 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8955908-2ff7-44d9-a074-27d881812561 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:10.836296 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8955908-2ff7-44d9-a074-27d881812561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:10.837746 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8955908-2ff7-44d9-a074-27d881812561 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:10.859692 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 71/141] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:10.865826 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d497f2f-e59e-499f-9ba5-dcdd53aef757 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:11.054710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d497f2f-e59e-499f-9ba5-dcdd53aef757 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:11.069471 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:11.113866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c5975-2772-4bd5-9291-f514823ca318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:11.114506 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c5975-2772-4bd5-9291-f514823ca318 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:11.114822 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c5975-2772-4bd5-9291-f514823ca318 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:11.115094 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c5975-2772-4bd5-9291-f514823ca318 None admin] PATH_INFO: `/v3/users/0c72aeb6d2de4684b788eeaec1b07e38` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:11.117249 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c5975-2772-4bd5-9291-f514823ca318 None admin] RBAC: Authorizing `identity:get_user(user_id=0c72aeb6d2de4684b788eeaec1b07e38)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:11.118801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c5975-2772-4bd5-9291-f514823ca318 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:11.120940 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 71/142] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:10 2022] GET /identity/v3/users/0c72aeb6d2de4684b788eeaec1b07e38 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:11.127173 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8955908-2ff7-44d9-a074-27d881812561 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:11.304171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8955908-2ff7-44d9-a074-27d881812561 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:11.370681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ec6ff-d167-4fef-a165-d22f480900d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:11.371646 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ec6ff-d167-4fef-a165-d22f480900d2 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:11.372135 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ec6ff-d167-4fef-a165-d22f480900d2 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:11.372948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ec6ff-d167-4fef-a165-d22f480900d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:11.422047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:11.478738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ec6ff-d167-4fef-a165-d22f480900d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:11.481099 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ec6ff-d167-4fef-a165-d22f480900d2 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:11.656992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 72/143] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:11.666561 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c5975-2772-4bd5-9291-f514823ca318 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:11.880593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c5975-2772-4bd5-9291-f514823ca318 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:11.959622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af67256-e361-4e9c-8910-dacf08337d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:11.960602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af67256-e361-4e9c-8910-dacf08337d9d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:11.961086 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af67256-e361-4e9c-8910-dacf08337d9d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:11.961539 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af67256-e361-4e9c-8910-dacf08337d9d None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:11.963647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af67256-e361-4e9c-8910-dacf08337d9d None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:11.966553 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af67256-e361-4e9c-8910-dacf08337d9d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:11.969789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 72/144] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:11 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:11.980350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ec6ff-d167-4fef-a165-d22f480900d2 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:12.091356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:12.173702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ec6ff-d167-4fef-a165-d22f480900d2 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:12.247151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7494a3c-a744-4adb-b758-f91a0e66cab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:12.248652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7494a3c-a744-4adb-b758-f91a0e66cab7 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:12.249137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7494a3c-a744-4adb-b758-f91a0e66cab7 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:12.249679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7494a3c-a744-4adb-b758-f91a0e66cab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:12.251074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7494a3c-a744-4adb-b758-f91a0e66cab7 None admin] RBAC: Adding query filter params (role.id=0560a82175224c8e86d1b430212748d4, scope.project.id=d2ad57e577854d67ae2401564821ce05, user.id=0c72aeb6d2de4684b788eeaec1b07e38) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:12.251687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7494a3c-a744-4adb-b758-f91a0e66cab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:12.254749 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7494a3c-a744-4adb-b758-f91a0e66cab7 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:12.271244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 73/145] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:11 2022] GET /identity/v3/role_assignments?user.id=0c72aeb6d2de4684b788eeaec1b07e38&scope.project.id=d2ad57e577854d67ae2401564821ce05&role.id=0560a82175224c8e86d1b430212748d4 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:13.103801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbe78b-291a-4bb6-b516-621d09c0c46d None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.104334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbe78b-291a-4bb6-b516-621d09c0c46d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.104334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbe78b-291a-4bb6-b516-621d09c0c46d None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.106393 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 73/146] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:13.112507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c76a7-9dc3-42a9-98cc-abc07febefb7 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.113156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c76a7-9dc3-42a9-98cc-abc07febefb7 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.113438 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c76a7-9dc3-42a9-98cc-abc07febefb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.138911 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-151c76a7-9dc3-42a9-98cc-abc07febefb7 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:13.140246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-151c76a7-9dc3-42a9-98cc-abc07febefb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:13.200251 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7d6e9-c260-49e2-b98f-909f6ce9e216 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.200539 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7d6e9-c260-49e2-b98f-909f6ce9e216 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.200826 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7d6e9-c260-49e2-b98f-909f6ce9e216 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.202648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 74/147] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:13.209954 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb83e5-ec37-4a40-a783-e89a0a4c9c7c None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.210332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb83e5-ec37-4a40-a783-e89a0a4c9c7c None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.210566 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb83e5-ec37-4a40-a783-e89a0a4c9c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.231795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-01bb83e5-ec37-4a40-a783-e89a0a4c9c7c None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:13.233186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-01bb83e5-ec37-4a40-a783-e89a0a4c9c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:13.240203 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 74/148] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:13.306058 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:13.358915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 75/149] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:13.377317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3cd15-408b-4c4e-8579-5a6715925af7 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.377938 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3cd15-408b-4c4e-8579-5a6715925af7 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.379891 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3cd15-408b-4c4e-8579-5a6715925af7 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.382394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 75/150] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:13.388459 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b58cc5-8804-4d1f-887f-5c2ab18dd5fa None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.388818 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b58cc5-8804-4d1f-887f-5c2ab18dd5fa None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.389115 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b58cc5-8804-4d1f-887f-5c2ab18dd5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.426856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-53b58cc5-8804-4d1f-887f-5c2ab18dd5fa None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:13.430211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-53b58cc5-8804-4d1f-887f-5c2ab18dd5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:13.562965 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 76/151] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:13.728139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd232411-00c6-44c2-8e84-7b3deb9b438e None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.729567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd232411-00c6-44c2-8e84-7b3deb9b438e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.730509 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd232411-00c6-44c2-8e84-7b3deb9b438e None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.734696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 76/152] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:13.744979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccb621-2e2e-41b4-bbba-e2518e92c9a8 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.745355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccb621-2e2e-41b4-bbba-e2518e92c9a8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.745573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccb621-2e2e-41b4-bbba-e2518e92c9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.777716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-c6ccb621-2e2e-41b4-bbba-e2518e92c9a8 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:13.779137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c6ccb621-2e2e-41b4-bbba-e2518e92c9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:13.800256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd232411-00c6-44c2-8e84-7b3deb9b438e None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:13.920258 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:13.930549 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 77/153] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:13.932789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccb621-2e2e-41b4-bbba-e2518e92c9a8 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:13.989369 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd232411-00c6-44c2-8e84-7b3deb9b438e None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:13.992417 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:14.041004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8b04d-4a5f-4b23-b1a7-a2614ba6ea92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.042021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8b04d-4a5f-4b23-b1a7-a2614ba6ea92 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.042688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8b04d-4a5f-4b23-b1a7-a2614ba6ea92 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.043103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8b04d-4a5f-4b23-b1a7-a2614ba6ea92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.044958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8b04d-4a5f-4b23-b1a7-a2614ba6ea92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:14.047139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8b04d-4a5f-4b23-b1a7-a2614ba6ea92 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:14.054481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 77/154] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:14.056170 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8b04d-4a5f-4b23-b1a7-a2614ba6ea92 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.130762 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccb621-2e2e-41b4-bbba-e2518e92c9a8 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:14.189743 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8b04d-4a5f-4b23-b1a7-a2614ba6ea92 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:14.197427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e5881-2394-401c-b7e7-77b7df47f05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.198842 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e5881-2394-401c-b7e7-77b7df47f05f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.199542 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e5881-2394-401c-b7e7-77b7df47f05f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.200182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e5881-2394-401c-b7e7-77b7df47f05f None admin] PATH_INFO: `/v3/roles/member` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.220755 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e5881-2394-401c-b7e7-77b7df47f05f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:14.231185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3178cb6-b216-488d-8f68-a86893be77ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-2a6e5881-2394-401c-b7e7-77b7df47f05f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:14.231517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:14.232413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:14.233198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:14.233198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:14.233198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:14.233198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:14.233198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:14.233198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:14.233198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:14.233198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:14.233198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:14.233198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:14.233198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:14.233198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:14.234108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 78/155] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:14.235708 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e5881-2394-401c-b7e7-77b7df47f05f None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.235878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3178cb6-b216-488d-8f68-a86893be77ad None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.236134 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3178cb6-b216-488d-8f68-a86893be77ad None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.236432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3178cb6-b216-488d-8f68-a86893be77ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.237859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:14.267298 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3178cb6-b216-488d-8f68-a86893be77ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-b3178cb6-b216-488d-8f68-a86893be77ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:14.280776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:14.282704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:14.284414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:14.284414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:14.284414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:14.284414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:14.284414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:14.284414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:14.284414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:14.284414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:14.284414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:14.284414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:14.284414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:14.284414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:53:14.287527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 78/156] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:14.288416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3178cb6-b216-488d-8f68-a86893be77ad None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.405241 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:14.426065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e5881-2394-401c-b7e7-77b7df47f05f None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:14.488911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c50726-9479-4c6c-b645-90d3d2ab2644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.489830 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c50726-9479-4c6c-b645-90d3d2ab2644 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.490224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c50726-9479-4c6c-b645-90d3d2ab2644 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.490655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c50726-9479-4c6c-b645-90d3d2ab2644 None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.491393 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c50726-9479-4c6c-b645-90d3d2ab2644 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:14.492548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3178cb6-b216-488d-8f68-a86893be77ad None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:14.493105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c50726-9479-4c6c-b645-90d3d2ab2644 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:14.525722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 79/157] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:53:14 2022] POST /identity/v3/users => generated 283 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:14.527268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c50726-9479-4c6c-b645-90d3d2ab2644 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.551366 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa98b8-0a8f-42d7-851a-251c33e0cccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.552073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa98b8-0a8f-42d7-851a-251c33e0cccc None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.552367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa98b8-0a8f-42d7-851a-251c33e0cccc None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.552709 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa98b8-0a8f-42d7-851a-251c33e0cccc None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.555997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa98b8-0a8f-42d7-851a-251c33e0cccc None admin] RBAC: Adding query filter params (name=member) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:14.555997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa98b8-0a8f-42d7-851a-251c33e0cccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:14.555997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa98b8-0a8f-42d7-851a-251c33e0cccc None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:14.568212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 79/158] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:14.575837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa98b8-0a8f-42d7-851a-251c33e0cccc None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.649749 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:14.703056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c50726-9479-4c6c-b645-90d3d2ab2644 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:14.752545 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa98b8-0a8f-42d7-851a-251c33e0cccc None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:14.765912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0736e93-08fe-4c8e-b960-d9c6b6a0b2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.765912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0736e93-08fe-4c8e-b960-d9c6b6a0b2b3 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.765912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0736e93-08fe-4c8e-b960-d9c6b6a0b2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.765912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0736e93-08fe-4c8e-b960-d9c6b6a0b2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.766662 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0736e93-08fe-4c8e-b960-d9c6b6a0b2b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:14.766662 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0736e93-08fe-4c8e-b960-d9c6b6a0b2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:14.766662 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0736e93-08fe-4c8e-b960-d9c6b6a0b2b3 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:14.781249 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 80/159] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:14.782996 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84415ccc-f077-48f7-8dfe-93ffceb4e8db None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.783439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84415ccc-f077-48f7-8dfe-93ffceb4e8db None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.783865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84415ccc-f077-48f7-8dfe-93ffceb4e8db None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.791615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 81/160] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:14.791615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84415ccc-f077-48f7-8dfe-93ffceb4e8db None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.808543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:14.811479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aa0f2-de92-4756-b949-4890954b7f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.812618 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aa0f2-de92-4756-b949-4890954b7f5e None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.813097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aa0f2-de92-4756-b949-4890954b7f5e None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.813569 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aa0f2-de92-4756-b949-4890954b7f5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.835571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9aa0f2-de92-4756-b949-4890954b7f5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-6e9aa0f2-de92-4756-b949-4890954b7f5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:14.846460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:14.848346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:14.849976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:14.849976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:14.849976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:14.849976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:14.849976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:14.849976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:14.849976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:14.849976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:14.849976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:14.849976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:14.849976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:14.849976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:53:14.853380 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 80/161] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:14.853380 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aa0f2-de92-4756-b949-4890954b7f5e None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:15.011874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84415ccc-f077-48f7-8dfe-93ffceb4e8db None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:15.029995 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aa0f2-de92-4756-b949-4890954b7f5e None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:15.041596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:15.073110 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d2844-a3d6-41cc-aa16-cb0dee16b5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:15.073926 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d2844-a3d6-41cc-aa16-cb0dee16b5be None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.074306 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d2844-a3d6-41cc-aa16-cb0dee16b5be None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.074673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d2844-a3d6-41cc-aa16-cb0dee16b5be None admin] PATH_INFO: `/v3/users/0c72aeb6d2de4684b788eeaec1b07e38` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.076087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d2844-a3d6-41cc-aa16-cb0dee16b5be None admin] RBAC: Authorizing `identity:get_user(user_id=0c72aeb6d2de4684b788eeaec1b07e38)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:15.077796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d2844-a3d6-41cc-aa16-cb0dee16b5be None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:15.079930 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 82/162] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/users/0c72aeb6d2de4684b788eeaec1b07e38 => generated 275 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:15.083088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211d1b3-e61f-4af7-9a41-35a296397716 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.083501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211d1b3-e61f-4af7-9a41-35a296397716 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.083870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211d1b3-e61f-4af7-9a41-35a296397716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.101350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e669b-44b4-43bf-a6bf-e0f7bdd981c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:15.102035 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e669b-44b4-43bf-a6bf-e0f7bdd981c1 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.102321 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e669b-44b4-43bf-a6bf-e0f7bdd981c1 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.102584 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e669b-44b4-43bf-a6bf-e0f7bdd981c1 None admin] PATH_INFO: `/v3/users/f94fa0cb98ca4b9e80781353d561ab11` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.104135 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e669b-44b4-43bf-a6bf-e0f7bdd981c1 None admin] RBAC: Authorizing `identity:get_user(user_id=f94fa0cb98ca4b9e80781353d561ab11)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:15.105784 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e669b-44b4-43bf-a6bf-e0f7bdd981c1 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:15.107864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 81/163] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/users/f94fa0cb98ca4b9e80781353d561ab11 => generated 289 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:15.108455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e669b-44b4-43bf-a6bf-e0f7bdd981c1 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:15.108561 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-d211d1b3-e61f-4af7-9a41-35a296397716 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:15.110184 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d211d1b3-e61f-4af7-9a41-35a296397716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:15.243256 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 83/164] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:15.244104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211d1b3-e61f-4af7-9a41-35a296397716 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:15.263106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:15.305471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e669b-44b4-43bf-a6bf-e0f7bdd981c1 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:15.419123 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166c217-1194-4907-9d0d-ab3b24f50838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:15.422861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c217-1194-4907-9d0d-ab3b24f50838 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.423948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c217-1194-4907-9d0d-ab3b24f50838 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.427379 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c217-1194-4907-9d0d-ab3b24f50838 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.429059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166c217-1194-4907-9d0d-ab3b24f50838 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:15.430260 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166c217-1194-4907-9d0d-ab3b24f50838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:15.434700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166c217-1194-4907-9d0d-ab3b24f50838 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:15.453062 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 82/165] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:15.453959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166c217-1194-4907-9d0d-ab3b24f50838 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:15.495134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211d1b3-e61f-4af7-9a41-35a296397716 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:15.556972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:15.629517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949566e7-f3e2-42a4-8c1c-b4a629e29922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:15.630528 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949566e7-f3e2-42a4-8c1c-b4a629e29922 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.631015 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949566e7-f3e2-42a4-8c1c-b4a629e29922 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.631359 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949566e7-f3e2-42a4-8c1c-b4a629e29922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.783486 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166c217-1194-4907-9d0d-ab3b24f50838 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:15.857660 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949566e7-f3e2-42a4-8c1c-b4a629e29922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:15.858202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e83d5-785e-4a9f-9ec5-4e3ace17a281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:15.859502 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949566e7-f3e2-42a4-8c1c-b4a629e29922 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:15.859982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e83d5-785e-4a9f-9ec5-4e3ace17a281 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.860760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e83d5-785e-4a9f-9ec5-4e3ace17a281 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.861382 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e83d5-785e-4a9f-9ec5-4e3ace17a281 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.863857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e83d5-785e-4a9f-9ec5-4e3ace17a281 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:15.866932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e83d5-785e-4a9f-9ec5-4e3ace17a281 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:15.876550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 83/166] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:15 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:15.880905 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e83d5-785e-4a9f-9ec5-4e3ace17a281 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:15.884804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:16.098118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e83d5-785e-4a9f-9ec5-4e3ace17a281 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:16.100918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:16.149384 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f751d-d954-4643-b2e5-30e39a4a253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:16.150664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f751d-d954-4643-b2e5-30e39a4a253b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:16.151372 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f751d-d954-4643-b2e5-30e39a4a253b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:16.152061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f751d-d954-4643-b2e5-30e39a4a253b None admin] PATH_INFO: `/v3/users/28cc602f739f4f2fbcd0f584e9147da4` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:16.154712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f751d-d954-4643-b2e5-30e39a4a253b None admin] RBAC: Authorizing `identity:get_user(user_id=28cc602f739f4f2fbcd0f584e9147da4)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:16.157035 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f751d-d954-4643-b2e5-30e39a4a253b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:16.161573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 84/167] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:15 2022] GET /identity/v3/users/28cc602f739f4f2fbcd0f584e9147da4 => generated 247 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:16.163384 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f751d-d954-4643-b2e5-30e39a4a253b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:16.210464 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 84/168] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 967 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:16.212130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949566e7-f3e2-42a4-8c1c-b4a629e29922 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:16.305218 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f751d-d954-4643-b2e5-30e39a4a253b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:16.374398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d242ed-56c3-4296-b19d-53bdd1beedbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:16.377685 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d242ed-56c3-4296-b19d-53bdd1beedbd None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:16.379722 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d242ed-56c3-4296-b19d-53bdd1beedbd None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:16.380582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d242ed-56c3-4296-b19d-53bdd1beedbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:16.409681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d242ed-56c3-4296-b19d-53bdd1beedbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-b7d242ed-56c3-4296-b19d-53bdd1beedbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:16.417914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:16.419449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:16.420417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:16.420417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:16.420417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:16.420417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:16.420417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:16.420417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:16.420417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:16.420417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:16.420417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:16.420417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:16.420417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:16.420417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:53:16.424863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 85/169] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:16.426831 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d242ed-56c3-4296-b19d-53bdd1beedbd None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:16.475734 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:16.584622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949566e7-f3e2-42a4-8c1c-b4a629e29922 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:16.604816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d242ed-56c3-4296-b19d-53bdd1beedbd None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:16.618550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:16.706827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc603491-7e80-4fa6-91a7-3254f2f9ee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:16.707437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc603491-7e80-4fa6-91a7-3254f2f9ee82 None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:16.707931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc603491-7e80-4fa6-91a7-3254f2f9ee82 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:16.708437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc603491-7e80-4fa6-91a7-3254f2f9ee82 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05/users/f94fa0cb98ca4b9e80781353d561ab11/roles/ad483fe996284752ae36cd0fcfcbf503` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:16.712478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc603491-7e80-4fa6-91a7-3254f2f9ee82 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2ad57e577854d67ae2401564821ce05, user_id=f94fa0cb98ca4b9e80781353d561ab11, role_id=ad483fe996284752ae36cd0fcfcbf503)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:16.715442 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc603491-7e80-4fa6-91a7-3254f2f9ee82 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:16.721462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f56dce-9bb0-4bea-bc7c-7f980666a3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:16.722152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f56dce-9bb0-4bea-bc7c-7f980666a3b5 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:16.723187 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f56dce-9bb0-4bea-bc7c-7f980666a3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:16.723442 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f56dce-9bb0-4bea-bc7c-7f980666a3b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:16.752334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 85/170] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:53:16 2022] PUT /identity/v3/projects/d2ad57e577854d67ae2401564821ce05/users/f94fa0cb98ca4b9e80781353d561ab11/roles/ad483fe996284752ae36cd0fcfcbf503 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:16.754831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc603491-7e80-4fa6-91a7-3254f2f9ee82 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:16.950034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc603491-7e80-4fa6-91a7-3254f2f9ee82 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:17.002991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca1db2-bc9b-4ec0-8248-63dd790f6050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:17.003769 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca1db2-bc9b-4ec0-8248-63dd790f6050 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.004040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca1db2-bc9b-4ec0-8248-63dd790f6050 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.004330 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca1db2-bc9b-4ec0-8248-63dd790f6050 None admin] PATH_INFO: `/v3/projects/dfc25c361bd14e4d8d7abe0ab2d8ad41` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:17.005404 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f56dce-9bb0-4bea-bc7c-7f980666a3b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:17.005789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca1db2-bc9b-4ec0-8248-63dd790f6050 None admin] RBAC: Authorizing `identity:get_project(project_id=dfc25c361bd14e4d8d7abe0ab2d8ad41)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:17.007077 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f56dce-9bb0-4bea-bc7c-7f980666a3b5 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:17.007329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca1db2-bc9b-4ec0-8248-63dd790f6050 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:17.009400 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 86/171] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:16 2022] GET /identity/v3/projects/dfc25c361bd14e4d8d7abe0ab2d8ad41 => generated 312 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:17.010649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca1db2-bc9b-4ec0-8248-63dd790f6050 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:17.083924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:17.114737 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:17.183167 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca1db2-bc9b-4ec0-8248-63dd790f6050 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:17.240677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071edd1-34c8-4067-9ae3-4a3afe09c8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:17.241326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071edd1-34c8-4067-9ae3-4a3afe09c8be None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.241614 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071edd1-34c8-4067-9ae3-4a3afe09c8be None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.242025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071edd1-34c8-4067-9ae3-4a3afe09c8be None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:17.242934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071edd1-34c8-4067-9ae3-4a3afe09c8be None admin] RBAC: Adding query filter params (name=member) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:17.243362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071edd1-34c8-4067-9ae3-4a3afe09c8be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:17.245909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071edd1-34c8-4067-9ae3-4a3afe09c8be None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:17.262872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 87/172] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:17.264211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071edd1-34c8-4067-9ae3-4a3afe09c8be None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:17.338129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 86/173] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 912 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:17.338733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f56dce-9bb0-4bea-bc7c-7f980666a3b5 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:17.435199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071edd1-34c8-4067-9ae3-4a3afe09c8be None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:17.447104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:17.479997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566e778-3b77-449c-a3f8-1d84c341a551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:17.480668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566e778-3b77-449c-a3f8-1d84c341a551 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.480950 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566e778-3b77-449c-a3f8-1d84c341a551 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.481219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566e778-3b77-449c-a3f8-1d84c341a551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:17.482340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566e778-3b77-449c-a3f8-1d84c341a551 None admin] RBAC: Adding query filter params (role.id=30891346cde644e7bd9ae90a3876efc8, scope.project.id=dfc25c361bd14e4d8d7abe0ab2d8ad41, user.id=0c72aeb6d2de4684b788eeaec1b07e38) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:17.482790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566e778-3b77-449c-a3f8-1d84c341a551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:17.485325 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566e778-3b77-449c-a3f8-1d84c341a551 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:17.512295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 88/174] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:17 2022] GET /identity/v3/role_assignments?user.id=0c72aeb6d2de4684b788eeaec1b07e38&scope.project.id=dfc25c361bd14e4d8d7abe0ab2d8ad41&role.id=30891346cde644e7bd9ae90a3876efc8 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:17.512974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566e778-3b77-449c-a3f8-1d84c341a551 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:17.660746 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f56dce-9bb0-4bea-bc7c-7f980666a3b5 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:17.743082 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:17.746102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566e778-3b77-449c-a3f8-1d84c341a551 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:17.765773 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55431ec2-7719-4b91-817f-010bbb4fb5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:17.766760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55431ec2-7719-4b91-817f-010bbb4fb5a1 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.767222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55431ec2-7719-4b91-817f-010bbb4fb5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.767692 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55431ec2-7719-4b91-817f-010bbb4fb5a1 None admin] PATH_INFO: `/v3/users/0c72aeb6d2de4684b788eeaec1b07e38` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:17.773681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55431ec2-7719-4b91-817f-010bbb4fb5a1 None admin] RBAC: Authorizing `identity:get_user(user_id=0c72aeb6d2de4684b788eeaec1b07e38)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:17.776702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55431ec2-7719-4b91-817f-010bbb4fb5a1 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:17.780046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 87/175] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:17 2022] GET /identity/v3/users/0c72aeb6d2de4684b788eeaec1b07e38 => generated 275 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:17.794098 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55431ec2-7719-4b91-817f-010bbb4fb5a1 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:17.795231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59299c7b-efd2-4f39-a9fd-3c50ef1e6411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:17.795898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59299c7b-efd2-4f39-a9fd-3c50ef1e6411 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.796181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59299c7b-efd2-4f39-a9fd-3c50ef1e6411 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.796495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59299c7b-efd2-4f39-a9fd-3c50ef1e6411 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:17.797789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59299c7b-efd2-4f39-a9fd-3c50ef1e6411 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:17.800305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59299c7b-efd2-4f39-a9fd-3c50ef1e6411 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:17.802510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 89/176] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:17 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:17.808812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59299c7b-efd2-4f39-a9fd-3c50ef1e6411 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:17.871270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:17.965294 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59299c7b-efd2-4f39-a9fd-3c50ef1e6411 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:18.051426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed648b11-5434-4428-a430-520c2ec64c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:18.051984 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed648b11-5434-4428-a430-520c2ec64c4d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:18.052269 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed648b11-5434-4428-a430-520c2ec64c4d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:18.052570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed648b11-5434-4428-a430-520c2ec64c4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:18.053443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed648b11-5434-4428-a430-520c2ec64c4d None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=d2ad57e577854d67ae2401564821ce05, user.id=28cc602f739f4f2fbcd0f584e9147da4) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:18.053766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed648b11-5434-4428-a430-520c2ec64c4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:18.056033 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed648b11-5434-4428-a430-520c2ec64c4d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:18.071418 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 90/177] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:17 2022] GET /identity/v3/role_assignments?user.id=28cc602f739f4f2fbcd0f584e9147da4&scope.project.id=d2ad57e577854d67ae2401564821ce05&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:18.187462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55431ec2-7719-4b91-817f-010bbb4fb5a1 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:18.269845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e3b27-1484-4b08-9392-e4ca9b041ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:18.270830 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e3b27-1484-4b08-9392-e4ca9b041ddf None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:18.271260 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e3b27-1484-4b08-9392-e4ca9b041ddf None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:18.271678 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e3b27-1484-4b08-9392-e4ca9b041ddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:18.435208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:18.442816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e3b27-1484-4b08-9392-e4ca9b041ddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:18.445975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e3b27-1484-4b08-9392-e4ca9b041ddf None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:18.686182 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 88/178] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 893 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:18.695107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed648b11-5434-4428-a430-520c2ec64c4d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:18.713598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4be635-9897-4047-b4bb-a53adef858fb None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:18.714051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4be635-9897-4047-b4bb-a53adef858fb None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:18.714506 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4be635-9897-4047-b4bb-a53adef858fb None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:18.716942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 89/179] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:18.726110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b25c6-726d-4d5c-a339-f3eb143205ad None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:18.726559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b25c6-726d-4d5c-a339-f3eb143205ad None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:18.727032 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b25c6-726d-4d5c-a339-f3eb143205ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:18.758466 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-9b0b25c6-726d-4d5c-a339-f3eb143205ad None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:18.760558 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-9b0b25c6-726d-4d5c-a339-f3eb143205ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:18.930921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 90/180] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:18.938102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:18.960982 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed648b11-5434-4428-a430-520c2ec64c4d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:19.041689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa759871-367e-421f-808a-83a5f59c345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:19.043074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa759871-367e-421f-808a-83a5f59c345e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:19.043759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa759871-367e-421f-808a-83a5f59c345e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:19.044478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa759871-367e-421f-808a-83a5f59c345e None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:19.046811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa759871-367e-421f-808a-83a5f59c345e None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:19.049811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa759871-367e-421f-808a-83a5f59c345e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:19.053494 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 91/181] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:18 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:19.063029 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b25c6-726d-4d5c-a339-f3eb143205ad None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:19.128064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:19.248227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b25c6-726d-4d5c-a339-f3eb143205ad None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:19.304353 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bf9fb-4dab-4128-b2c7-9d2943556841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:19.305277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bf9fb-4dab-4128-b2c7-9d2943556841 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:19.305646 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bf9fb-4dab-4128-b2c7-9d2943556841 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:19.305930 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bf9fb-4dab-4128-b2c7-9d2943556841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:19.306821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bf9fb-4dab-4128-b2c7-9d2943556841 None admin] RBAC: Adding query filter params (role.id=30891346cde644e7bd9ae90a3876efc8, scope.project.id=d2ad57e577854d67ae2401564821ce05, user.id=0c72aeb6d2de4684b788eeaec1b07e38) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:19.307259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bf9fb-4dab-4128-b2c7-9d2943556841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:19.309867 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bf9fb-4dab-4128-b2c7-9d2943556841 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:19.329624 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 91/182] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:19 2022] GET /identity/v3/role_assignments?user.id=0c72aeb6d2de4684b788eeaec1b07e38&scope.project.id=d2ad57e577854d67ae2401564821ce05&role.id=30891346cde644e7bd9ae90a3876efc8 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:19.450951 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a58dd3-5bd5-41e0-b3cc-6ff50f6e3b26 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:19.451904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a58dd3-5bd5-41e0-b3cc-6ff50f6e3b26 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:19.452643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a58dd3-5bd5-41e0-b3cc-6ff50f6e3b26 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:19.455936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 92/183] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:19.463548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6846b-a5d9-4582-a5f8-102fa7ab3515 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:19.463962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6846b-a5d9-4582-a5f8-102fa7ab3515 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:19.464567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6846b-a5d9-4582-a5f8-102fa7ab3515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:19.502070 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-aea6846b-a5d9-4582-a5f8-102fa7ab3515 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:19.504203 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-aea6846b-a5d9-4582-a5f8-102fa7ab3515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:19.565060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a58dd3-5bd5-41e0-b3cc-6ff50f6e3b26 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:19.693197 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 92/184] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:19.701635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc6dd3-b887-4994-9025-c03e11f0549d None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:19.702128 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc6dd3-b887-4994-9025-c03e11f0549d None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:19.702611 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc6dd3-b887-4994-9025-c03e11f0549d None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:19.706434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 93/185] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:19.715532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b91f9-fd42-4fc4-acc5-b5bdcab4293b None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:19.716023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b91f9-fd42-4fc4-acc5-b5bdcab4293b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:19.716550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b91f9-fd42-4fc4-acc5-b5bdcab4293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:19.756179 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-869b91f9-fd42-4fc4-acc5-b5bdcab4293b None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:19.758130 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-869b91f9-fd42-4fc4-acc5-b5bdcab4293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:19.792670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:19.819331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a58dd3-5bd5-41e0-b3cc-6ff50f6e3b26 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:19.886132 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 94/186] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:19.905159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34602b75-8d33-40c5-9484-7506b8090fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:19.906377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34602b75-8d33-40c5-9484-7506b8090fb2 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:19.906928 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34602b75-8d33-40c5-9484-7506b8090fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:19.907405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34602b75-8d33-40c5-9484-7506b8090fb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:19.930701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34602b75-8d33-40c5-9484-7506b8090fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-34602b75-8d33-40c5-9484-7506b8090fb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:19.941105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:19.942483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:19.943270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:19.943270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:19.943270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:19.943270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:19.943270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:19.943270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:19.943270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:19.943270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:19.943270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:19.943270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:19.943270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:19.943270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:19.947550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 93/187] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:19.953258 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b91f9-fd42-4fc4-acc5-b5bdcab4293b None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:20.099382 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b91f9-fd42-4fc4-acc5-b5bdcab4293b None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:20.122858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34602b75-8d33-40c5-9484-7506b8090fb2 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:20.157582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:20.164514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b35ded-66fd-4d56-9891-f6ea554bd182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:20.165546 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b35ded-66fd-4d56-9891-f6ea554bd182 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:20.165976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b35ded-66fd-4d56-9891-f6ea554bd182 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:20.166399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b35ded-66fd-4d56-9891-f6ea554bd182 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:20.167543 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b35ded-66fd-4d56-9891-f6ea554bd182 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:20.167994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b35ded-66fd-4d56-9891-f6ea554bd182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:20.170317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b35ded-66fd-4d56-9891-f6ea554bd182 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:20.186021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 95/188] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:20.195253 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b35ded-66fd-4d56-9891-f6ea554bd182 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:20.222884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:20.323497 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34602b75-8d33-40c5-9484-7506b8090fb2 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:20.380494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b35ded-66fd-4d56-9891-f6ea554bd182 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:20.389082 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b23013-4733-402c-b9e9-71cca0670329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:20.390170 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b23013-4733-402c-b9e9-71cca0670329 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:20.390673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b23013-4733-402c-b9e9-71cca0670329 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:20.391208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b23013-4733-402c-b9e9-71cca0670329 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:20.408917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b23013-4733-402c-b9e9-71cca0670329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-e6b23013-4733-402c-b9e9-71cca0670329 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:20.415653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:20.416656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:20.417496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:20.417496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:20.417496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:20.417496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:20.417496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:20.417496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:20.417496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:20.417496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:20.417496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:20.417496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:20.417496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:20.417496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:20.418377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 94/189] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:20.419911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b23013-4733-402c-b9e9-71cca0670329 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:20.444041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aeaa8-27c6-4e57-bd41-91f2c6ed5003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:20.444747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aeaa8-27c6-4e57-bd41-91f2c6ed5003 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:20.445029 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aeaa8-27c6-4e57-bd41-91f2c6ed5003 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:20.445299 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aeaa8-27c6-4e57-bd41-91f2c6ed5003 None admin] PATH_INFO: `/v3/users/4070eb98867b4f37bc5ff742831756af` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:20.462261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0aeaa8-27c6-4e57-bd41-91f2c6ed5003 None admin] RBAC: Authorizing `identity:get_user(user_id=4070eb98867b4f37bc5ff742831756af)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:20.464390 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0aeaa8-27c6-4e57-bd41-91f2c6ed5003 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:20.466834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 96/190] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:20 2022] GET /identity/v3/users/4070eb98867b4f37bc5ff742831756af => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:20.467890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aeaa8-27c6-4e57-bd41-91f2c6ed5003 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:20.571750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:20.600567 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b23013-4733-402c-b9e9-71cca0670329 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:20.607118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:20.656876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aeaa8-27c6-4e57-bd41-91f2c6ed5003 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:20.658468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae904c-4175-4d93-bc9c-4d008ea31c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:20.659522 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae904c-4175-4d93-bc9c-4d008ea31c2a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:20.660590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae904c-4175-4d93-bc9c-4d008ea31c2a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:20.660776 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae904c-4175-4d93-bc9c-4d008ea31c2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:20.662547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae904c-4175-4d93-bc9c-4d008ea31c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:20.664582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae904c-4175-4d93-bc9c-4d008ea31c2a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:20.666701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 95/191] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:20.667555 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae904c-4175-4d93-bc9c-4d008ea31c2a None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:20.744159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef67303-1000-4992-9518-4ac1c6069d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:20.745202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef67303-1000-4992-9518-4ac1c6069d79 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:20.745623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef67303-1000-4992-9518-4ac1c6069d79 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:20.746028 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef67303-1000-4992-9518-4ac1c6069d79 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:20.747204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef67303-1000-4992-9518-4ac1c6069d79 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:20.747928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef67303-1000-4992-9518-4ac1c6069d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:20.750327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef67303-1000-4992-9518-4ac1c6069d79 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:20.772163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 97/192] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:20.772163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef67303-1000-4992-9518-4ac1c6069d79 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:20.864924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae904c-4175-4d93-bc9c-4d008ea31c2a None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:20.916262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b5136-c10e-4a94-9234-a161200c2bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:20.917071 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b5136-c10e-4a94-9234-a161200c2bff None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:20.917462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b5136-c10e-4a94-9234-a161200c2bff None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:20.917773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b5136-c10e-4a94-9234-a161200c2bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:20.932881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef67303-1000-4992-9518-4ac1c6069d79 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:20.949092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:20.991652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d277829-17c9-4df8-8287-c99ed3a3cd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:20.992090 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d277829-17c9-4df8-8287-c99ed3a3cd77 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:20.992307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d277829-17c9-4df8-8287-c99ed3a3cd77 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:20.992602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d277829-17c9-4df8-8287-c99ed3a3cd77 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:20.993518 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d277829-17c9-4df8-8287-c99ed3a3cd77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:20.995340 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d277829-17c9-4df8-8287-c99ed3a3cd77 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:21.005482 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:21.025054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b5136-c10e-4a94-9234-a161200c2bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:21.032985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b5136-c10e-4a94-9234-a161200c2bff None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:21.033240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 98/193] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:53:20 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:21.033240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d277829-17c9-4df8-8287-c99ed3a3cd77 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:21.219056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d277829-17c9-4df8-8287-c99ed3a3cd77 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:21.222845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 96/194] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:21.228484 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b3491-f062-4f03-adb9-b8f2de2f41c5 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.228484 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b3491-f062-4f03-adb9-b8f2de2f41c5 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.228484 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b3491-f062-4f03-adb9-b8f2de2f41c5 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.228484 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 97/195] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:21.233653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b3491-f062-4f03-adb9-b8f2de2f41c5 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:21.300898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d1419-bc2c-44f9-a6c5-c613adf157ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:21.302045 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d1419-bc2c-44f9-a6c5-c613adf157ab None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.302637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d1419-bc2c-44f9-a6c5-c613adf157ab None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.303358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d1419-bc2c-44f9-a6c5-c613adf157ab None admin] PATH_INFO: `/v3/users/4070eb98867b4f37bc5ff742831756af` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.305205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d1419-bc2c-44f9-a6c5-c613adf157ab None admin] RBAC: Authorizing `identity:get_user(user_id=4070eb98867b4f37bc5ff742831756af)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:21.307404 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d1419-bc2c-44f9-a6c5-c613adf157ab None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:21.310320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 99/196] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:21 2022] GET /identity/v3/users/4070eb98867b4f37bc5ff742831756af => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:21.312356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fa562-fc0a-447a-87d2-2168d220b5bc None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.317088 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fa562-fc0a-447a-87d2-2168d220b5bc None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.317431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fa562-fc0a-447a-87d2-2168d220b5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.334181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:21.353786 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-fc1fa562-fc0a-447a-87d2-2168d220b5bc None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:21.355189 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fc1fa562-fc0a-447a-87d2-2168d220b5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:21.430878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b3491-f062-4f03-adb9-b8f2de2f41c5 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:21.483609 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:21.505495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 100/197] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:21.507688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fa562-fc0a-447a-87d2-2168d220b5bc None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:21.510852 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357693c-30da-4055-88ec-a23f610552eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:21.511611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357693c-30da-4055-88ec-a23f610552eb None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.511952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357693c-30da-4055-88ec-a23f610552eb None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.512289 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357693c-30da-4055-88ec-a23f610552eb None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.515348 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357693c-30da-4055-88ec-a23f610552eb None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:21.518141 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357693c-30da-4055-88ec-a23f610552eb None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:21.522854 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 98/198] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:21 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:21.528167 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357693c-30da-4055-88ec-a23f610552eb None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:21.703473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fa562-fc0a-447a-87d2-2168d220b5bc None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:21.719446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357693c-30da-4055-88ec-a23f610552eb None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:21.778793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:21.784588 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc237fbb-9728-45bd-ad93-8fb77f954567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:21.786034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc237fbb-9728-45bd-ad93-8fb77f954567 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.786186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc237fbb-9728-45bd-ad93-8fb77f954567 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.786588 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc237fbb-9728-45bd-ad93-8fb77f954567 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.833992 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34901e-acfe-44d7-9250-b6fda92b9941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:21.835033 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34901e-acfe-44d7-9250-b6fda92b9941 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.835516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34901e-acfe-44d7-9250-b6fda92b9941 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.835983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34901e-acfe-44d7-9250-b6fda92b9941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.837413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34901e-acfe-44d7-9250-b6fda92b9941 None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=f2c27767fad842abb753f50c28758062, user.id=4070eb98867b4f37bc5ff742831756af) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:21.838841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34901e-acfe-44d7-9250-b6fda92b9941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:21.842904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34901e-acfe-44d7-9250-b6fda92b9941 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:21.868462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 99/199] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:21 2022] GET /identity/v3/role_assignments?user.id=4070eb98867b4f37bc5ff742831756af&scope.project.id=f2c27767fad842abb753f50c28758062&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 259 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:21.963662 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:21.996478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc237fbb-9728-45bd-ad93-8fb77f954567 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:21.999457 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc237fbb-9728-45bd-ad93-8fb77f954567 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:22.056806 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34901e-acfe-44d7-9250-b6fda92b9941 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:22.232712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 101/200] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 726 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:22.254436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc237fbb-9728-45bd-ad93-8fb77f954567 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:22.274740 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34901e-acfe-44d7-9250-b6fda92b9941 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:22.351516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89943bc-b350-462b-a843-9db2195c74f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:22.352499 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89943bc-b350-462b-a843-9db2195c74f4 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:22.352970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89943bc-b350-462b-a843-9db2195c74f4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:22.353419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89943bc-b350-462b-a843-9db2195c74f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:22.398281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89943bc-b350-462b-a843-9db2195c74f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-e89943bc-b350-462b-a843-9db2195c74f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:22.412919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:22.414470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:22.415350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:22.415350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:22.415350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:22.415350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:22.415350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:22.415350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:22.415350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:22.415350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:22.415350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:22.415350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:22.415350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:22.415350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:22.419351 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 100/201] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:22.429504 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89943bc-b350-462b-a843-9db2195c74f4 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:22.523941 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:22.536525 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:22.556889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc237fbb-9728-45bd-ad93-8fb77f954567 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:22.654459 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab09f09-7066-4d73-a349-07ec907be1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:22.655028 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab09f09-7066-4d73-a349-07ec907be1b9 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:22.655406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab09f09-7066-4d73-a349-07ec907be1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:22.655686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab09f09-7066-4d73-a349-07ec907be1b9 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:22.658343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab09f09-7066-4d73-a349-07ec907be1b9 None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:22.661783 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab09f09-7066-4d73-a349-07ec907be1b9 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:22.668394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 102/202] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:22 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:22.672673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89943bc-b350-462b-a843-9db2195c74f4 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:22.674777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab09f09-7066-4d73-a349-07ec907be1b9 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:22.740793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d8c68-416e-4627-8970-68686ea1fc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:22.741498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d8c68-416e-4627-8970-68686ea1fc4a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:22.741770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d8c68-416e-4627-8970-68686ea1fc4a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:22.742094 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d8c68-416e-4627-8970-68686ea1fc4a None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:22.742952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d8c68-416e-4627-8970-68686ea1fc4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:22.743258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d8c68-416e-4627-8970-68686ea1fc4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:22.744714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d8c68-416e-4627-8970-68686ea1fc4a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:22.763798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 101/203] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:22.773642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d8c68-416e-4627-8970-68686ea1fc4a None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:22.895999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab09f09-7066-4d73-a349-07ec907be1b9 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:22.942373 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef5317-67a9-46ae-a4b1-b62719b92c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:22.942911 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef5317-67a9-46ae-a4b1-b62719b92c0b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:22.943241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef5317-67a9-46ae-a4b1-b62719b92c0b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:22.943503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef5317-67a9-46ae-a4b1-b62719b92c0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:22.944825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef5317-67a9-46ae-a4b1-b62719b92c0b None admin] RBAC: Adding query filter params (role.id=0560a82175224c8e86d1b430212748d4, scope.project.id=f2c27767fad842abb753f50c28758062, user.id=4070eb98867b4f37bc5ff742831756af) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:22.945329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef5317-67a9-46ae-a4b1-b62719b92c0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:22.947858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef5317-67a9-46ae-a4b1-b62719b92c0b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:22.970927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 103/204] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:22 2022] GET /identity/v3/role_assignments?user.id=4070eb98867b4f37bc5ff742831756af&scope.project.id=f2c27767fad842abb753f50c28758062&role.id=0560a82175224c8e86d1b430212748d4 => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:23.005313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d8c68-416e-4627-8970-68686ea1fc4a None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:23.008073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:23.054619 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7c49d-3a86-42c7-9458-3dd2af0f36f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:23.055326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7c49d-3a86-42c7-9458-3dd2af0f36f9 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:23.055609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7c49d-3a86-42c7-9458-3dd2af0f36f9 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:23.055869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7c49d-3a86-42c7-9458-3dd2af0f36f9 None admin] PATH_INFO: `/v3/users/f94fa0cb98ca4b9e80781353d561ab11` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:23.059474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7c49d-3a86-42c7-9458-3dd2af0f36f9 None admin] RBAC: Authorizing `identity:get_user(user_id=f94fa0cb98ca4b9e80781353d561ab11)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:23.061228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7c49d-3a86-42c7-9458-3dd2af0f36f9 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:23.063173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 102/205] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:22 2022] GET /identity/v3/users/f94fa0cb98ca4b9e80781353d561ab11 => generated 289 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:23.069581 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef5317-67a9-46ae-a4b1-b62719b92c0b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:23.099286 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:23.245127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef5317-67a9-46ae-a4b1-b62719b92c0b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:23.316666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7290cf-8c63-4b3f-9c00-0b8a001d72ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:23.317734 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7290cf-8c63-4b3f-9c00-0b8a001d72ce None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:23.318164 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7290cf-8c63-4b3f-9c00-0b8a001d72ce None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:23.318598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7290cf-8c63-4b3f-9c00-0b8a001d72ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:23.495740 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7290cf-8c63-4b3f-9c00-0b8a001d72ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:23.499157 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7290cf-8c63-4b3f-9c00-0b8a001d72ce None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:23.537668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:23.681670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 104/206] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:23.690837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7c49d-3a86-42c7-9458-3dd2af0f36f9 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:23.836362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7c49d-3a86-42c7-9458-3dd2af0f36f9 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:23.914648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52dfaf-2c87-44e1-83ed-f21f5a6250c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:23.915770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52dfaf-2c87-44e1-83ed-f21f5a6250c2 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:23.916261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52dfaf-2c87-44e1-83ed-f21f5a6250c2 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:23.916763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52dfaf-2c87-44e1-83ed-f21f5a6250c2 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:23.918907 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52dfaf-2c87-44e1-83ed-f21f5a6250c2 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:23.921867 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52dfaf-2c87-44e1-83ed-f21f5a6250c2 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:23.934158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 103/207] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:23 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:23.940264 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7290cf-8c63-4b3f-9c00-0b8a001d72ce None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:24.089873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7290cf-8c63-4b3f-9c00-0b8a001d72ce None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:24.129774 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:24.169691 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455329c-c66b-4c65-98d5-437b2b4a19be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:24.170727 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455329c-c66b-4c65-98d5-437b2b4a19be None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:24.171217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455329c-c66b-4c65-98d5-437b2b4a19be None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:24.171695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455329c-c66b-4c65-98d5-437b2b4a19be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:24.173102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455329c-c66b-4c65-98d5-437b2b4a19be None admin] RBAC: Adding query filter params (role.id=ad483fe996284752ae36cd0fcfcbf503, scope.project.id=d2ad57e577854d67ae2401564821ce05, user.id=f94fa0cb98ca4b9e80781353d561ab11) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:24.173619 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455329c-c66b-4c65-98d5-437b2b4a19be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:24.176403 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455329c-c66b-4c65-98d5-437b2b4a19be None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:24.187932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 105/208] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:23 2022] GET /identity/v3/role_assignments?user.id=f94fa0cb98ca4b9e80781353d561ab11&scope.project.id=d2ad57e577854d67ae2401564821ce05&role.id=ad483fe996284752ae36cd0fcfcbf503 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:24.423642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efdb3d-0291-4280-b80f-4c808d0e115d None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:24.424433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efdb3d-0291-4280-b80f-4c808d0e115d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:24.424590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efdb3d-0291-4280-b80f-4c808d0e115d None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:24.427594 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 104/209] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:24.434629 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bc980-7dcd-46c5-8354-694f09d27806 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:24.434907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bc980-7dcd-46c5-8354-694f09d27806 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:24.435243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bc980-7dcd-46c5-8354-694f09d27806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:24.458591 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-635bc980-7dcd-46c5-8354-694f09d27806 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:24.459850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-635bc980-7dcd-46c5-8354-694f09d27806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:24.555608 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 106/210] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:24.625073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f1b62-be73-46ea-9124-2b25cfd630bc None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:24.625354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f1b62-be73-46ea-9124-2b25cfd630bc None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:24.625740 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f1b62-be73-46ea-9124-2b25cfd630bc None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:24.627332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 105/211] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:24.634847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd7864-f86d-4d48-8ca3-0b5ddfe1bf53 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:24.635804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd7864-f86d-4d48-8ca3-0b5ddfe1bf53 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:24.636673 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd7864-f86d-4d48-8ca3-0b5ddfe1bf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:24.672466 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-11cd7864-f86d-4d48-8ca3-0b5ddfe1bf53 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:24.675128 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-11cd7864-f86d-4d48-8ca3-0b5ddfe1bf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:24.821481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 107/212] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:24.948645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f1b62-be73-46ea-9124-2b25cfd630bc None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:25.016587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:25.107053 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f1b62-be73-46ea-9124-2b25cfd630bc None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:25.153980 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730164f-cf25-4318-8a68-34794b2f6440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:25.154664 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730164f-cf25-4318-8a68-34794b2f6440 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:25.154945 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730164f-cf25-4318-8a68-34794b2f6440 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:25.155217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730164f-cf25-4318-8a68-34794b2f6440 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:25.156537 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730164f-cf25-4318-8a68-34794b2f6440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:25.158119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730164f-cf25-4318-8a68-34794b2f6440 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:25.160575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 106/213] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:25.175123 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd7864-f86d-4d48-8ca3-0b5ddfe1bf53 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:25.209817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730164f-cf25-4318-8a68-34794b2f6440 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:25.260915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:25.330231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730164f-cf25-4318-8a68-34794b2f6440 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:25.341050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:25.370647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d3dbf-daa8-4745-b1d3-52374df5f3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:25.371369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d3dbf-daa8-4745-b1d3-52374df5f3b7 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:25.371651 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d3dbf-daa8-4745-b1d3-52374df5f3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:25.371950 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d3dbf-daa8-4745-b1d3-52374df5f3b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:25.374762 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd7864-f86d-4d48-8ca3-0b5ddfe1bf53 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:25.391200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d3dbf-daa8-4745-b1d3-52374df5f3b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-c63d3dbf-daa8-4745-b1d3-52374df5f3b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:25.399369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:25.401500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:25.403091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:25.403091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:25.403091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:25.403091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:25.403091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:25.403091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:25.403091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:25.403091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:25.403091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:25.403091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:25.403091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:25.403091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:25.403091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 107/214] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:25.414419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d3dbf-daa8-4745-b1d3-52374df5f3b7 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:25.452894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae6ea4-1176-4db0-bd74-676b0ddffa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:25.453845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6ea4-1176-4db0-bd74-676b0ddffa7c None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:25.454290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6ea4-1176-4db0-bd74-676b0ddffa7c None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:25.455026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6ea4-1176-4db0-bd74-676b0ddffa7c None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:25.456688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae6ea4-1176-4db0-bd74-676b0ddffa7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:25.458716 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae6ea4-1176-4db0-bd74-676b0ddffa7c None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:25.495136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 108/215] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:53:25 2022] POST /identity/v3/users => generated 297 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:25.533825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacde63-bdb1-4690-82fe-b9234bc9edc8 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:25.533825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacde63-bdb1-4690-82fe-b9234bc9edc8 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:25.534279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacde63-bdb1-4690-82fe-b9234bc9edc8 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:25.536583 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 109/216] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:25.542731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e9ba1-e5b2-42c7-9fe3-96625cf2d699 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:25.543210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e9ba1-e5b2-42c7-9fe3-96625cf2d699 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:25.543588 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e9ba1-e5b2-42c7-9fe3-96625cf2d699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:25.566725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-1e1e9ba1-e5b2-42c7-9fe3-96625cf2d699 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:25.568417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-1e1e9ba1-e5b2-42c7-9fe3-96625cf2d699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:25.580069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d3dbf-daa8-4745-b1d3-52374df5f3b7 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:25.652288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9513a3-5254-4314-8540-95273a28e402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:25.653440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9513a3-5254-4314-8540-95273a28e402 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:25.654046 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9513a3-5254-4314-8540-95273a28e402 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:25.654533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9513a3-5254-4314-8540-95273a28e402 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:25.655938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9513a3-5254-4314-8540-95273a28e402 None admin] RBAC: Adding query filter params (name=member) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:25.656474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9513a3-5254-4314-8540-95273a28e402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:25.659416 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9513a3-5254-4314-8540-95273a28e402 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:25.679218 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 108/217] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:25.689435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9513a3-5254-4314-8540-95273a28e402 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:25.708541 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 110/218] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:25.754415 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:25.851590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9513a3-5254-4314-8540-95273a28e402 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:25.919786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d318491-cbea-4ac7-a239-1a614608cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:25.921424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d318491-cbea-4ac7-a239-1a614608cf36 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:25.922209 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d318491-cbea-4ac7-a239-1a614608cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:25.922915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d318491-cbea-4ac7-a239-1a614608cf36 None admin] PATH_INFO: `/v3/users/dab81acabf5c4da2ab84c742ef2e7ea7` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:25.953255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d318491-cbea-4ac7-a239-1a614608cf36 None admin] RBAC: Authorizing `identity:get_user(user_id=dab81acabf5c4da2ab84c742ef2e7ea7)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:25.956592 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d318491-cbea-4ac7-a239-1a614608cf36 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:25.960006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 109/219] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:25 2022] GET /identity/v3/users/dab81acabf5c4da2ab84c742ef2e7ea7 => generated 297 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:25.969447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e9ba1-e5b2-42c7-9fe3-96625cf2d699 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:26.031320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:26.099719 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d318491-cbea-4ac7-a239-1a614608cf36 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:26.179399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e9ba1-e5b2-42c7-9fe3-96625cf2d699 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:26.248175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193be4be-5d4c-4040-9516-2aaf0eecaa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:26.249993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193be4be-5d4c-4040-9516-2aaf0eecaa50 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:26.250272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193be4be-5d4c-4040-9516-2aaf0eecaa50 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:26.250540 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193be4be-5d4c-4040-9516-2aaf0eecaa50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:26.268933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:26.314957 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d318491-cbea-4ac7-a239-1a614608cf36 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:26.424465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193be4be-5d4c-4040-9516-2aaf0eecaa50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:26.426417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193be4be-5d4c-4040-9516-2aaf0eecaa50 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:26.433440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30051d99-8039-4438-a406-d1232a737879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:26.434118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30051d99-8039-4438-a406-d1232a737879 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:26.434442 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30051d99-8039-4438-a406-d1232a737879 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:26.434884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30051d99-8039-4438-a406-d1232a737879 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:26.465713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30051d99-8039-4438-a406-d1232a737879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-30051d99-8039-4438-a406-d1232a737879 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:26.471458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:26.472802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:26.473780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:26.473780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:26.473780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:26.473780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:26.473780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:26.473780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:26.473780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:26.473780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:26.473780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:26.473780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:26.473780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:26.473780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:26.476966 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 110/220] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:26.480607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:26.490373 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30051d99-8039-4438-a406-d1232a737879 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:26.600492 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 111/221] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:26.605139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5a24f-8f45-4fbc-a341-134e512de89f None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:26.605546 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5a24f-8f45-4fbc-a341-134e512de89f None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:26.606086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5a24f-8f45-4fbc-a341-134e512de89f None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:26.607843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 112/222] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:26.613468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5a24f-8f45-4fbc-a341-134e512de89f None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:26.637845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30051d99-8039-4438-a406-d1232a737879 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:26.686269 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f469b2-6f5c-498b-a5a7-8dd30b0960e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:26.687387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f469b2-6f5c-498b-a5a7-8dd30b0960e2 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:26.687612 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f469b2-6f5c-498b-a5a7-8dd30b0960e2 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:26.688054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f469b2-6f5c-498b-a5a7-8dd30b0960e2 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:26.688971 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f469b2-6f5c-498b-a5a7-8dd30b0960e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:26.689478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f469b2-6f5c-498b-a5a7-8dd30b0960e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:26.691480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f469b2-6f5c-498b-a5a7-8dd30b0960e2 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:26.707254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 111/223] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:26.710113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5257f-201d-4f38-a6c6-ded228f3e17e None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:26.710380 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5257f-201d-4f38-a6c6-ded228f3e17e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:26.710859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5257f-201d-4f38-a6c6-ded228f3e17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:26.741739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-3bb5257f-201d-4f38-a6c6-ded228f3e17e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:26.743651 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-3bb5257f-201d-4f38-a6c6-ded228f3e17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:26.749753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:26.781214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5a24f-8f45-4fbc-a341-134e512de89f None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:26.839726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:26.860153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 112/224] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:26.863251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ac47c-028c-4b0d-9c57-54b023b6a1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:26.864836 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ac47c-028c-4b0d-9c57-54b023b6a1e7 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:26.865553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ac47c-028c-4b0d-9c57-54b023b6a1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:26.866238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ac47c-028c-4b0d-9c57-54b023b6a1e7 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:26.868693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ac47c-028c-4b0d-9c57-54b023b6a1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:26.869563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5257f-201d-4f38-a6c6-ded228f3e17e None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:26.872694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ac47c-028c-4b0d-9c57-54b023b6a1e7 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:26.876883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 113/225] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:26 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:26.887194 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ac47c-028c-4b0d-9c57-54b023b6a1e7 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:27.071694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ac47c-028c-4b0d-9c57-54b023b6a1e7 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:27.130413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860214a4-beb0-4081-9a61-55bd7b421557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:27.137657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860214a4-beb0-4081-9a61-55bd7b421557 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:27.138524 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860214a4-beb0-4081-9a61-55bd7b421557 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:27.139249 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860214a4-beb0-4081-9a61-55bd7b421557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:27.141030 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860214a4-beb0-4081-9a61-55bd7b421557 None admin] RBAC: Adding query filter params (role.id=30891346cde644e7bd9ae90a3876efc8, scope.project.id=f2c27767fad842abb753f50c28758062, user.id=dab81acabf5c4da2ab84c742ef2e7ea7) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:27.141901 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860214a4-beb0-4081-9a61-55bd7b421557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:27.145153 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860214a4-beb0-4081-9a61-55bd7b421557 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:27.163997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 114/226] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:26 2022] GET /identity/v3/role_assignments?user.id=dab81acabf5c4da2ab84c742ef2e7ea7&scope.project.id=f2c27767fad842abb753f50c28758062&role.id=30891346cde644e7bd9ae90a3876efc8 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:27.185342 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5257f-201d-4f38-a6c6-ded228f3e17e None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:27.258815 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db25a10-6ecc-40ad-8b92-0338c10d2cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:27.259489 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db25a10-6ecc-40ad-8b92-0338c10d2cd7 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:27.259769 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db25a10-6ecc-40ad-8b92-0338c10d2cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:27.260043 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db25a10-6ecc-40ad-8b92-0338c10d2cd7 None admin] PATH_INFO: `/v3/users/4070eb98867b4f37bc5ff742831756af` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:27.261259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db25a10-6ecc-40ad-8b92-0338c10d2cd7 None admin] RBAC: Authorizing `identity:get_user(user_id=4070eb98867b4f37bc5ff742831756af)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:27.263075 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db25a10-6ecc-40ad-8b92-0338c10d2cd7 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:27.265585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 113/227] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:26 2022] GET /identity/v3/users/4070eb98867b4f37bc5ff742831756af => generated 283 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:27.272308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860214a4-beb0-4081-9a61-55bd7b421557 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:27.309532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db25a10-6ecc-40ad-8b92-0338c10d2cd7 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:27.324870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:27.443572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:27.506285 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db25a10-6ecc-40ad-8b92-0338c10d2cd7 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:27.550022 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860214a4-beb0-4081-9a61-55bd7b421557 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:27.585211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9280c-f3f6-4ee2-b8e1-6013c222d295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:27.586302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9280c-f3f6-4ee2-b8e1-6013c222d295 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:27.586787 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9280c-f3f6-4ee2-b8e1-6013c222d295 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:27.588819 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9280c-f3f6-4ee2-b8e1-6013c222d295 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:27.609612 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9280c-f3f6-4ee2-b8e1-6013c222d295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-51b9280c-f3f6-4ee2-b8e1-6013c222d295 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:27.621254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:27.622653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:27.623573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:27.623573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:27.623573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:27.623573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:27.623573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:27.623573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:27.623573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:27.623573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:27.623573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:27.623573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:27.623573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:27.623573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:27.631903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 114/228] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:27.638790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9280c-f3f6-4ee2-b8e1-6013c222d295 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:27.643574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb69413-39ea-4794-8ecd-e55664663e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:27.644750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb69413-39ea-4794-8ecd-e55664663e85 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:27.645213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb69413-39ea-4794-8ecd-e55664663e85 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:27.645694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb69413-39ea-4794-8ecd-e55664663e85 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:27.653375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb69413-39ea-4794-8ecd-e55664663e85 None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:27.655336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb69413-39ea-4794-8ecd-e55664663e85 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:27.657578 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 115/229] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:27 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:27.664273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb69413-39ea-4794-8ecd-e55664663e85 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:27.758472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:27.806600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9280c-f3f6-4ee2-b8e1-6013c222d295 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:27.854973 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfa14b-0287-451f-9e93-7d0b7a0e696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:27.856657 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfa14b-0287-451f-9e93-7d0b7a0e696d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:27.856657 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfa14b-0287-451f-9e93-7d0b7a0e696d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:27.856941 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfa14b-0287-451f-9e93-7d0b7a0e696d None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:27.858274 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfa14b-0287-451f-9e93-7d0b7a0e696d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:27.858988 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfa14b-0287-451f-9e93-7d0b7a0e696d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:27.861754 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfa14b-0287-451f-9e93-7d0b7a0e696d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:27.880851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 115/230] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:27.882711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfa14b-0287-451f-9e93-7d0b7a0e696d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:28.006890 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfa14b-0287-451f-9e93-7d0b7a0e696d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:28.046985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:28.059281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6583cc1-a421-4684-bba1-a410538048d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:28.060246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6583cc1-a421-4684-bba1-a410538048d8 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.060649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6583cc1-a421-4684-bba1-a410538048d8 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.061478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6583cc1-a421-4684-bba1-a410538048d8 None admin] PATH_INFO: `/v3/users/4070eb98867b4f37bc5ff742831756af` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.063605 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6583cc1-a421-4684-bba1-a410538048d8 None admin] RBAC: Authorizing `identity:get_user(user_id=4070eb98867b4f37bc5ff742831756af)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:28.066402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6583cc1-a421-4684-bba1-a410538048d8 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:28.068000 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb69413-39ea-4794-8ecd-e55664663e85 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:28.069631 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 116/231] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:27 2022] GET /identity/v3/users/4070eb98867b4f37bc5ff742831756af => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:28.076414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6583cc1-a421-4684-bba1-a410538048d8 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:28.105756 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:28.129242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b1e2a-9d9b-4988-bdbd-3d9e734d00a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:28.130208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b1e2a-9d9b-4988-bdbd-3d9e734d00a6 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.130498 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b1e2a-9d9b-4988-bdbd-3d9e734d00a6 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.130774 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b1e2a-9d9b-4988-bdbd-3d9e734d00a6 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062/users/4070eb98867b4f37bc5ff742831756af/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.138474 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b1e2a-9d9b-4988-bdbd-3d9e734d00a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2c27767fad842abb753f50c28758062, user_id=4070eb98867b4f37bc5ff742831756af, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:28.140049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b1e2a-9d9b-4988-bdbd-3d9e734d00a6 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:28.163367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 116/232] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:53:27 2022] PUT /identity/v3/projects/f2c27767fad842abb753f50c28758062/users/4070eb98867b4f37bc5ff742831756af/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:28.276411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6583cc1-a421-4684-bba1-a410538048d8 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:28.334955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa25ba-60bd-4022-afa1-1ed4f7518f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:28.335539 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa25ba-60bd-4022-afa1-1ed4f7518f27 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.335818 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa25ba-60bd-4022-afa1-1ed4f7518f27 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.336092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa25ba-60bd-4022-afa1-1ed4f7518f27 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.337393 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa25ba-60bd-4022-afa1-1ed4f7518f27 None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:28.338964 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa25ba-60bd-4022-afa1-1ed4f7518f27 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:28.341335 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 117/233] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:28 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:28.353023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b1e2a-9d9b-4988-bdbd-3d9e734d00a6 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:28.564506 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b1e2a-9d9b-4988-bdbd-3d9e734d00a6 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:28.639680 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf2fb2-0d54-43b6-8169-c65deabba5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:28.640805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf2fb2-0d54-43b6-8169-c65deabba5a2 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.641286 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf2fb2-0d54-43b6-8169-c65deabba5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.641770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf2fb2-0d54-43b6-8169-c65deabba5a2 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062/users/4070eb98867b4f37bc5ff742831756af/roles/0560a82175224c8e86d1b430212748d4` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.649007 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf2fb2-0d54-43b6-8169-c65deabba5a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2c27767fad842abb753f50c28758062, user_id=4070eb98867b4f37bc5ff742831756af, role_id=0560a82175224c8e86d1b430212748d4)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:28.651623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf2fb2-0d54-43b6-8169-c65deabba5a2 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:28.680176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 117/234] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:53:28 2022] PUT /identity/v3/projects/f2c27767fad842abb753f50c28758062/users/4070eb98867b4f37bc5ff742831756af/roles/0560a82175224c8e86d1b430212748d4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:28.899326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70bb54-54c9-41a3-96bf-24f0f4672e43 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.900295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70bb54-54c9-41a3-96bf-24f0f4672e43 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.900295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70bb54-54c9-41a3-96bf-24f0f4672e43 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.902717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 118/235] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:28.912169 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d585aab-7d10-4f07-ae6d-f50d84656fd5 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.912646 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d585aab-7d10-4f07-ae6d-f50d84656fd5 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.913100 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d585aab-7d10-4f07-ae6d-f50d84656fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.960526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-5d585aab-7d10-4f07-ae6d-f50d84656fd5 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:28.962845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5d585aab-7d10-4f07-ae6d-f50d84656fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:29.074098 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:29.114747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 118/236] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:29.454579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24281d-fb97-48d9-9ceb-42409fe79028 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:29.455103 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24281d-fb97-48d9-9ceb-42409fe79028 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:29.455504 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24281d-fb97-48d9-9ceb-42409fe79028 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:29.458268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 119/237] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:29.471441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5b4f5-038f-489f-8afa-508ceb7705c6 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:29.472290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5b4f5-038f-489f-8afa-508ceb7705c6 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:29.472796 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5b4f5-038f-489f-8afa-508ceb7705c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:29.512894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-07b5b4f5-038f-489f-8afa-508ceb7705c6 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:29.515069 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-07b5b4f5-038f-489f-8afa-508ceb7705c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:29.690123 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 119/238] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:29.823509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24281d-fb97-48d9-9ceb-42409fe79028 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:29.945755 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:30.008456 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24281d-fb97-48d9-9ceb-42409fe79028 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:30.071896 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ba2b3-29ac-4b3e-a327-1d0632e51173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:30.072966 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ba2b3-29ac-4b3e-a327-1d0632e51173 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:30.073452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ba2b3-29ac-4b3e-a327-1d0632e51173 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:30.073983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ba2b3-29ac-4b3e-a327-1d0632e51173 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:30.075423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ba2b3-29ac-4b3e-a327-1d0632e51173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:30.077249 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ba2b3-29ac-4b3e-a327-1d0632e51173 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:30.079761 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 120/239] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:30.086655 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5b4f5-038f-489f-8afa-508ceb7705c6 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:30.267451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ba2b3-29ac-4b3e-a327-1d0632e51173 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:30.295603 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5b4f5-038f-489f-8afa-508ceb7705c6 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:30.325353 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:30.421429 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61838a29-c7ea-4248-8fbb-9727a47a40bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:30.425037 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838a29-c7ea-4248-8fbb-9727a47a40bc None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:30.427738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838a29-c7ea-4248-8fbb-9727a47a40bc None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:30.428452 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838a29-c7ea-4248-8fbb-9727a47a40bc None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:30.429989 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61838a29-c7ea-4248-8fbb-9727a47a40bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:30.432944 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61838a29-c7ea-4248-8fbb-9727a47a40bc None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:30.469898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ba2b3-29ac-4b3e-a327-1d0632e51173 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:30.479465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 120/240] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:53:30 2022] POST /identity/v3/users => generated 293 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:30.525396 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffe7ee-003c-460c-8b20-a706a05539c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:30.526065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffe7ee-003c-460c-8b20-a706a05539c0 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:30.526348 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffe7ee-003c-460c-8b20-a706a05539c0 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:30.530395 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffe7ee-003c-460c-8b20-a706a05539c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:30.533210 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:30.545749 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffe7ee-003c-460c-8b20-a706a05539c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-e0ffe7ee-003c-460c-8b20-a706a05539c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:30.551952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:30.554389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:30.556233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:30.556233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:30.556233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:30.556233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:30.556233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:30.556233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:30.556233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:30.556233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:30.556233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:30.556233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:30.556233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:30.556233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:30.556233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 121/241] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:30.561516 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61838a29-c7ea-4248-8fbb-9727a47a40bc None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:30.853655 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61838a29-c7ea-4248-8fbb-9727a47a40bc None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:30.919254 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de125e8-4fea-4800-ac45-2d9b8d380772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:30.920308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de125e8-4fea-4800-ac45-2d9b8d380772 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:30.920840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de125e8-4fea-4800-ac45-2d9b8d380772 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:30.921400 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de125e8-4fea-4800-ac45-2d9b8d380772 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:30.922314 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de125e8-4fea-4800-ac45-2d9b8d380772 None admin] RBAC: Adding query filter params (name=reader) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:30.922695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de125e8-4fea-4800-ac45-2d9b8d380772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:30.927502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de125e8-4fea-4800-ac45-2d9b8d380772 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:30.942915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 121/242] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:30.951206 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffe7ee-003c-460c-8b20-a706a05539c0 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:31.170065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c773312-4846-4f9c-936f-a71114c65306 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:31.170494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c773312-4846-4f9c-936f-a71114c65306 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:31.170947 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c773312-4846-4f9c-936f-a71114c65306 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:31.177144 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 122/243] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:31.189889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c75a2-1590-4ced-bead-948e9dabddbd None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:31.190616 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c75a2-1590-4ced-bead-948e9dabddbd None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:31.191711 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c75a2-1590-4ced-bead-948e9dabddbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:31.197779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffe7ee-003c-460c-8b20-a706a05539c0 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:31.225752 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-b47c75a2-1590-4ced-bead-948e9dabddbd None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:31.227685 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b47c75a2-1590-4ced-bead-948e9dabddbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:31.265070 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b376a-44af-474c-a616-39c9ee868d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:31.266646 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b376a-44af-474c-a616-39c9ee868d03 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:31.267118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b376a-44af-474c-a616-39c9ee868d03 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:31.267538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b376a-44af-474c-a616-39c9ee868d03 None admin] PATH_INFO: `/v3/users/1d75d4fe5f5141d98cba8342e0679b08` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:31.280461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:31.303365 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b376a-44af-474c-a616-39c9ee868d03 None admin] RBAC: Authorizing `identity:get_user(user_id=1d75d4fe5f5141d98cba8342e0679b08)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:31.306239 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b376a-44af-474c-a616-39c9ee868d03 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:31.313616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 122/244] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:30 2022] GET /identity/v3/users/1d75d4fe5f5141d98cba8342e0679b08 => generated 297 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:31.322493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b376a-44af-474c-a616-39c9ee868d03 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:31.381300 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 123/245] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:31.432089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:31.505213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b376a-44af-474c-a616-39c9ee868d03 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:31.549264 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a92fe-273c-44a6-990e-06cb59393d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:31.550022 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a92fe-273c-44a6-990e-06cb59393d74 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:31.550299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a92fe-273c-44a6-990e-06cb59393d74 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:31.550574 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a92fe-273c-44a6-990e-06cb59393d74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:31.651672 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a92fe-273c-44a6-990e-06cb59393d74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:31.654068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a92fe-273c-44a6-990e-06cb59393d74 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:31.735411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:31.798798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 123/246] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:31.808633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c75a2-1590-4ced-bead-948e9dabddbd None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:32.017989 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c75a2-1590-4ced-bead-948e9dabddbd None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:32.075756 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be64f4-c121-4975-9c66-a6d15f89af88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:32.076745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be64f4-c121-4975-9c66-a6d15f89af88 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.077171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be64f4-c121-4975-9c66-a6d15f89af88 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.078197 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be64f4-c121-4975-9c66-a6d15f89af88 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.080665 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be64f4-c121-4975-9c66-a6d15f89af88 None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:32.082551 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be64f4-c121-4975-9c66-a6d15f89af88 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:32.084975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 124/247] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:31 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:32.092411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a92fe-273c-44a6-990e-06cb59393d74 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:32.108859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016052f-3d29-47c7-9e8f-f927e7595661 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.109388 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016052f-3d29-47c7-9e8f-f927e7595661 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.109921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016052f-3d29-47c7-9e8f-f927e7595661 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.112102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 125/248] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:32.136651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508442d0-c7e7-4e1e-a259-df87639b7a3a None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.137398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508442d0-c7e7-4e1e-a259-df87639b7a3a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.138031 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508442d0-c7e7-4e1e-a259-df87639b7a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.185487 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-508442d0-c7e7-4e1e-a259-df87639b7a3a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:32.186724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-508442d0-c7e7-4e1e-a259-df87639b7a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:32.224602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:32.276194 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a92fe-273c-44a6-990e-06cb59393d74 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:32.296489 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 126/249] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:32.298237 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508442d0-c7e7-4e1e-a259-df87639b7a3a None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:32.357780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dca4d9-a8bb-4d20-8739-f327270bd94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:32.358495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dca4d9-a8bb-4d20-8739-f327270bd94b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.358889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dca4d9-a8bb-4d20-8739-f327270bd94b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.359167 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dca4d9-a8bb-4d20-8739-f327270bd94b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.359964 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dca4d9-a8bb-4d20-8739-f327270bd94b None admin] RBAC: Adding query filter params (role.id=ad483fe996284752ae36cd0fcfcbf503, scope.project.id=f2c27767fad842abb753f50c28758062, user.id=1d75d4fe5f5141d98cba8342e0679b08) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:32.360284 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dca4d9-a8bb-4d20-8739-f327270bd94b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:32.364577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dca4d9-a8bb-4d20-8739-f327270bd94b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:32.379888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 124/250] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:32 2022] GET /identity/v3/role_assignments?user.id=1d75d4fe5f5141d98cba8342e0679b08&scope.project.id=f2c27767fad842abb753f50c28758062&role.id=ad483fe996284752ae36cd0fcfcbf503 => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:32.382917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bccbb1-7dd8-4310-99c7-55eef3a7cfb7 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.384882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bccbb1-7dd8-4310-99c7-55eef3a7cfb7 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.385323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bccbb1-7dd8-4310-99c7-55eef3a7cfb7 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.393136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 125/251] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:32.396872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f84dff-297f-4566-836b-6f1c3eeb4da2 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.399888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f84dff-297f-4566-836b-6f1c3eeb4da2 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.400192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f84dff-297f-4566-836b-6f1c3eeb4da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.445608 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-f2f84dff-297f-4566-836b-6f1c3eeb4da2 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:32.446881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f2f84dff-297f-4566-836b-6f1c3eeb4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:32.462968 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:32.546420 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 126/252] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:32.547422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508442d0-c7e7-4e1e-a259-df87639b7a3a None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:32.625183 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bddaa5-32b4-4f97-ba8b-2cc3093a1a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:32.626183 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bddaa5-32b4-4f97-ba8b-2cc3093a1a4a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.626669 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bddaa5-32b4-4f97-ba8b-2cc3093a1a4a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.626996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bddaa5-32b4-4f97-ba8b-2cc3093a1a4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.648319 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bddaa5-32b4-4f97-ba8b-2cc3093a1a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-63bddaa5-32b4-4f97-ba8b-2cc3093a1a4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:32.653689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:32.654634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:32.656212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:32.656212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:32.656212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:32.656212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:32.656212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:32.656212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:32.656212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:32.656212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:32.656212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:32.656212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:32.656212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:32.656212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:53:32.656212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 127/253] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:32.664869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f84dff-297f-4566-836b-6f1c3eeb4da2 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:32.739339 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bddaa5-32b4-4f97-ba8b-2cc3093a1a4a None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:32.772786 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:32.875768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f84dff-297f-4566-836b-6f1c3eeb4da2 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:32.939211 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bddaa5-32b4-4f97-ba8b-2cc3093a1a4a None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:32.957232 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482aae1-eedc-4a0e-a24b-d0d1889796c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:32.958286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482aae1-eedc-4a0e-a24b-d0d1889796c0 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.958760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482aae1-eedc-4a0e-a24b-d0d1889796c0 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.959226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482aae1-eedc-4a0e-a24b-d0d1889796c0 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.960110 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482aae1-eedc-4a0e-a24b-d0d1889796c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:32.960644 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482aae1-eedc-4a0e-a24b-d0d1889796c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:32.962412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482aae1-eedc-4a0e-a24b-d0d1889796c0 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:32.972863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 127/254] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:32.982118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482aae1-eedc-4a0e-a24b-d0d1889796c0 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.002960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:33.061714 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a904a14-c769-434b-aeef-19cc28d21db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.062754 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a904a14-c769-434b-aeef-19cc28d21db5 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.063221 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a904a14-c769-434b-aeef-19cc28d21db5 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.063670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a904a14-c769-434b-aeef-19cc28d21db5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.117607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a904a14-c769-434b-aeef-19cc28d21db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:33.127311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482aae1-eedc-4a0e-a24b-d0d1889796c0 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-0a904a14-c769-434b-aeef-19cc28d21db5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:33.127894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:33.128840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:33.129670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:33.129670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:33.129670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:33.129670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:33.129670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:33.129670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:33.129670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:33.129670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:33.129670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:33.129670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:33.129670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:33.129670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:53:33.138714 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 128/255] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:33.148446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a904a14-c769-434b-aeef-19cc28d21db5 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.174632 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd232dcc-b1f5-4c51-817e-763be3f1508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.175953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd232dcc-b1f5-4c51-817e-763be3f1508c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.176629 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd232dcc-b1f5-4c51-817e-763be3f1508c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.177107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd232dcc-b1f5-4c51-817e-763be3f1508c None admin] PATH_INFO: `/v3/users/dab81acabf5c4da2ab84c742ef2e7ea7` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.178790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd232dcc-b1f5-4c51-817e-763be3f1508c None admin] RBAC: Authorizing `identity:get_user(user_id=dab81acabf5c4da2ab84c742ef2e7ea7)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:33.180711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd232dcc-b1f5-4c51-817e-763be3f1508c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:33.183782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 128/256] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:32 2022] GET /identity/v3/users/dab81acabf5c4da2ab84c742ef2e7ea7 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:33.192419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd232dcc-b1f5-4c51-817e-763be3f1508c None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.325149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:33.373421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd232dcc-b1f5-4c51-817e-763be3f1508c None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:33.421363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92672e-297a-402b-89ae-414145e45315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.422990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92672e-297a-402b-89ae-414145e45315 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.423718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92672e-297a-402b-89ae-414145e45315 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.424651 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92672e-297a-402b-89ae-414145e45315 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.426801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92672e-297a-402b-89ae-414145e45315 None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:33.429789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92672e-297a-402b-89ae-414145e45315 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:33.432809 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 129/257] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:33 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:33.434336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92672e-297a-402b-89ae-414145e45315 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.460790 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:33.546789 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a904a14-c769-434b-aeef-19cc28d21db5 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:33.588957 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92672e-297a-402b-89ae-414145e45315 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:33.635369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac3f28-22c2-4ae4-8ca3-e71ed5e15654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.636466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac3f28-22c2-4ae4-8ca3-e71ed5e15654 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.636955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac3f28-22c2-4ae4-8ca3-e71ed5e15654 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.637418 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac3f28-22c2-4ae4-8ca3-e71ed5e15654 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.654081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac3f28-22c2-4ae4-8ca3-e71ed5e15654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-95ac3f28-22c2-4ae4-8ca3-e71ed5e15654 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:33.661203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:33.662271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:33.663305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:33.663305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:33.663305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:33.663305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:33.663305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:33.663305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:33.663305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:33.663305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:33.663305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:33.663305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:33.663305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:33.663305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:33.666211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 130/258] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:33.667527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac3f28-22c2-4ae4-8ca3-e71ed5e15654 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.672778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:33.673290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be6b6a-59e1-4102-9d97-a7216d6eaf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.674282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be6b6a-59e1-4102-9d97-a7216d6eaf31 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.674806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be6b6a-59e1-4102-9d97-a7216d6eaf31 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.675248 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be6b6a-59e1-4102-9d97-a7216d6eaf31 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.676446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be6b6a-59e1-4102-9d97-a7216d6eaf31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:33.676946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be6b6a-59e1-4102-9d97-a7216d6eaf31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:33.685228 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be6b6a-59e1-4102-9d97-a7216d6eaf31 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:33.704888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 129/259] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 558 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:33.705853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be6b6a-59e1-4102-9d97-a7216d6eaf31 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.809508 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac3f28-22c2-4ae4-8ca3-e71ed5e15654 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:33.856408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa2606-6444-4410-9a4b-4a07faa688d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.856408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa2606-6444-4410-9a4b-4a07faa688d3 None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.857034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa2606-6444-4410-9a4b-4a07faa688d3 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.857408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa2606-6444-4410-9a4b-4a07faa688d3 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062/users/dab81acabf5c4da2ab84c742ef2e7ea7/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.864433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa2606-6444-4410-9a4b-4a07faa688d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2c27767fad842abb753f50c28758062, user_id=dab81acabf5c4da2ab84c742ef2e7ea7, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:33.864433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa2606-6444-4410-9a4b-4a07faa688d3 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:33.882227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 131/260] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:53:33 2022] PUT /identity/v3/projects/f2c27767fad842abb753f50c28758062/users/dab81acabf5c4da2ab84c742ef2e7ea7/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:33.883321 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa2606-6444-4410-9a4b-4a07faa688d3 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.993016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:34.040602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa2606-6444-4410-9a4b-4a07faa688d3 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:34.091297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15f30b-e89c-4b15-9525-9f935d2527c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:34.092166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15f30b-e89c-4b15-9525-9f935d2527c4 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:34.092592 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15f30b-e89c-4b15-9525-9f935d2527c4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:34.092963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15f30b-e89c-4b15-9525-9f935d2527c4 None admin] PATH_INFO: `/v3/users/4070eb98867b4f37bc5ff742831756af` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:34.094412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15f30b-e89c-4b15-9525-9f935d2527c4 None admin] RBAC: Authorizing `identity:get_user(user_id=4070eb98867b4f37bc5ff742831756af)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:34.096196 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15f30b-e89c-4b15-9525-9f935d2527c4 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:34.100121 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 132/261] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:33 2022] GET /identity/v3/users/4070eb98867b4f37bc5ff742831756af => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:34.110440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15f30b-e89c-4b15-9525-9f935d2527c4 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:34.179907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be6b6a-59e1-4102-9d97-a7216d6eaf31 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:34.311451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15f30b-e89c-4b15-9525-9f935d2527c4 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:34.315120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280ea7d-85f0-4f07-b5a1-f5acd3fe1717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:34.316165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280ea7d-85f0-4f07-b5a1-f5acd3fe1717 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:34.316705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280ea7d-85f0-4f07-b5a1-f5acd3fe1717 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:34.317353 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280ea7d-85f0-4f07-b5a1-f5acd3fe1717 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:34.318585 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280ea7d-85f0-4f07-b5a1-f5acd3fe1717 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:34.319294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280ea7d-85f0-4f07-b5a1-f5acd3fe1717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:34.321932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280ea7d-85f0-4f07-b5a1-f5acd3fe1717 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:34.342653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:34.352812 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 130/262] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 647 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:34.361817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:34.363303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280ea7d-85f0-4f07-b5a1-f5acd3fe1717 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:34.373312 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b077ddb-5601-4593-9726-c34c607d4fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:34.374444 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b077ddb-5601-4593-9726-c34c607d4fe5 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:34.375011 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b077ddb-5601-4593-9726-c34c607d4fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:34.377038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b077ddb-5601-4593-9726-c34c607d4fe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:34.493368 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b077ddb-5601-4593-9726-c34c607d4fe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:34.495486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b077ddb-5601-4593-9726-c34c607d4fe5 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:34.628799 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 133/263] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:34.653155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b077ddb-5601-4593-9726-c34c607d4fe5 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:34.688614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280ea7d-85f0-4f07-b5a1-f5acd3fe1717 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:34.709475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:34.767270 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ead80a-0899-482e-92de-e870b5b2dade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:34.768792 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ead80a-0899-482e-92de-e870b5b2dade None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:34.769879 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ead80a-0899-482e-92de-e870b5b2dade None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:34.770543 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ead80a-0899-482e-92de-e870b5b2dade None admin] PATH_INFO: `/v3/users/4070eb98867b4f37bc5ff742831756af` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:34.772851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ead80a-0899-482e-92de-e870b5b2dade None admin] RBAC: Authorizing `identity:get_user(user_id=4070eb98867b4f37bc5ff742831756af)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:34.775907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ead80a-0899-482e-92de-e870b5b2dade None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:34.779440 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 131/264] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:34 2022] GET /identity/v3/users/4070eb98867b4f37bc5ff742831756af => generated 283 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:34.789088 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ead80a-0899-482e-92de-e870b5b2dade None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:34.897302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b077ddb-5601-4593-9726-c34c607d4fe5 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:34.919484 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:34.962246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391d76f-6c95-4083-b538-361f955851ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:34.962960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391d76f-6c95-4083-b538-361f955851ae None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:34.963287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391d76f-6c95-4083-b538-361f955851ae None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:34.963504 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391d76f-6c95-4083-b538-361f955851ae None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:34.964759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391d76f-6c95-4083-b538-361f955851ae None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:34.966279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391d76f-6c95-4083-b538-361f955851ae None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:34.968266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 134/265] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:34 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:34.977424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391d76f-6c95-4083-b538-361f955851ae None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:34.993281 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ead80a-0899-482e-92de-e870b5b2dade None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:35.060533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764d896-dd1d-443e-84f1-2d5aafd61e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:35.062051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764d896-dd1d-443e-84f1-2d5aafd61e6b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:35.062822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764d896-dd1d-443e-84f1-2d5aafd61e6b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:35.063649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764d896-dd1d-443e-84f1-2d5aafd61e6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:35.167843 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391d76f-6c95-4083-b538-361f955851ae None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:35.172955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:35.201071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764d896-dd1d-443e-84f1-2d5aafd61e6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:35.204905 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764d896-dd1d-443e-84f1-2d5aafd61e6b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:35.242019 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c2987-3584-4196-ab22-9087640e5805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:35.242684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c2987-3584-4196-ab22-9087640e5805 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:35.242963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c2987-3584-4196-ab22-9087640e5805 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:35.243245 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c2987-3584-4196-ab22-9087640e5805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:35.244800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c2987-3584-4196-ab22-9087640e5805 None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=f2c27767fad842abb753f50c28758062, user.id=4070eb98867b4f37bc5ff742831756af) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:35.245533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c2987-3584-4196-ab22-9087640e5805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:35.247602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c2987-3584-4196-ab22-9087640e5805 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:35.263575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 135/266] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:34 2022] GET /identity/v3/role_assignments?user.id=4070eb98867b4f37bc5ff742831756af&scope.project.id=f2c27767fad842abb753f50c28758062&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:35.370791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:35.453690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 132/267] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:35.462881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c2987-3584-4196-ab22-9087640e5805 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:35.616843 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c2987-3584-4196-ab22-9087640e5805 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:35.672896 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eec7aa-6943-448c-82b7-91d21dcf455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:35.673967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eec7aa-6943-448c-82b7-91d21dcf455b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:35.674599 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eec7aa-6943-448c-82b7-91d21dcf455b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:35.675108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eec7aa-6943-448c-82b7-91d21dcf455b None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:35.679167 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eec7aa-6943-448c-82b7-91d21dcf455b None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:35.681187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eec7aa-6943-448c-82b7-91d21dcf455b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:35.684472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 136/268] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:35 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:35.698244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764d896-dd1d-443e-84f1-2d5aafd61e6b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:35.806972 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2835ba-3ae6-4dbf-919f-b828b056e9bc None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:35.807698 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2835ba-3ae6-4dbf-919f-b828b056e9bc None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:35.808174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2835ba-3ae6-4dbf-919f-b828b056e9bc None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:35.810876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 137/269] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:35.819446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f074b49-ae67-4eaf-b3ab-24c7a682d4c3 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:35.820134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f074b49-ae67-4eaf-b3ab-24c7a682d4c3 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:35.820634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f074b49-ae67-4eaf-b3ab-24c7a682d4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:35.876117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-8f074b49-ae67-4eaf-b3ab-24c7a682d4c3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:35.883782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8f074b49-ae67-4eaf-b3ab-24c7a682d4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:35.979907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764d896-dd1d-443e-84f1-2d5aafd61e6b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:35.984815 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:36.038276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99597630-24c6-484a-b3ba-e181bd8f59f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:36.039305 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99597630-24c6-484a-b3ba-e181bd8f59f3 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:36.039800 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99597630-24c6-484a-b3ba-e181bd8f59f3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:36.040284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99597630-24c6-484a-b3ba-e181bd8f59f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:36.041762 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99597630-24c6-484a-b3ba-e181bd8f59f3 None admin] RBAC: Adding query filter params (role.id=0560a82175224c8e86d1b430212748d4, scope.project.id=f2c27767fad842abb753f50c28758062, user.id=4070eb98867b4f37bc5ff742831756af) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:36.042167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99597630-24c6-484a-b3ba-e181bd8f59f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:36.043798 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99597630-24c6-484a-b3ba-e181bd8f59f3 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:36.051279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 133/270] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:35 2022] GET /identity/v3/role_assignments?user.id=4070eb98867b4f37bc5ff742831756af&scope.project.id=f2c27767fad842abb753f50c28758062&role.id=0560a82175224c8e86d1b430212748d4 => generated 608 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:36.052673 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cd844-24b7-432d-b636-451938774bb4 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:36.053021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cd844-24b7-432d-b636-451938774bb4 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:36.053297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cd844-24b7-432d-b636-451938774bb4 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:36.061474 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 134/271] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:36.068442 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01e1a4-94b5-45a5-996d-6fb9363a8165 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:36.068730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01e1a4-94b5-45a5-996d-6fb9363a8165 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:36.069015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01e1a4-94b5-45a5-996d-6fb9363a8165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:36.070886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 138/272] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:36.097915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-1b01e1a4-94b5-45a5-996d-6fb9363a8165 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:36.100071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-1b01e1a4-94b5-45a5-996d-6fb9363a8165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:36.155621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:36.261462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 135/273] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:36.620693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f074b49-ae67-4eaf-b3ab-24c7a682d4c3 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:36.682515 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c39917-61b9-40e1-b305-78980e344f3c None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:36.682851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c39917-61b9-40e1-b305-78980e344f3c None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:36.683104 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c39917-61b9-40e1-b305-78980e344f3c None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:36.684935 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 136/274] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:36.690696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791183af-1e81-4862-80b9-d60b86c0646e None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:36.691018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791183af-1e81-4862-80b9-d60b86c0646e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:36.691242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791183af-1e81-4862-80b9-d60b86c0646e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:36.723470 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-791183af-1e81-4862-80b9-d60b86c0646e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:36.725606 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-791183af-1e81-4862-80b9-d60b86c0646e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:36.777586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f074b49-ae67-4eaf-b3ab-24c7a682d4c3 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:36.817817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205940be-e488-41b8-85fb-a934e07315fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:36.818487 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205940be-e488-41b8-85fb-a934e07315fb None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:36.818764 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205940be-e488-41b8-85fb-a934e07315fb None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:36.819034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205940be-e488-41b8-85fb-a934e07315fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:36.820236 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205940be-e488-41b8-85fb-a934e07315fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:36.821964 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205940be-e488-41b8-85fb-a934e07315fb None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:36.823902 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 139/275] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:36.824564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205940be-e488-41b8-85fb-a934e07315fb None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:36.868409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 137/276] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:36.868409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791183af-1e81-4862-80b9-d60b86c0646e None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:36.889134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:36.967633 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205940be-e488-41b8-85fb-a934e07315fb None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:36.974866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:36.985876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791183af-1e81-4862-80b9-d60b86c0646e None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:37.010910 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a62f7f-768b-42d2-8fbb-3871f0d3e56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.011685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a62f7f-768b-42d2-8fbb-3871f0d3e56a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.011878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a62f7f-768b-42d2-8fbb-3871f0d3e56a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.012151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a62f7f-768b-42d2-8fbb-3871f0d3e56a None admin] PATH_INFO: `/v3/roles/member` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.025523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a62f7f-768b-42d2-8fbb-3871f0d3e56a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:37.026843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1bbd0-9b41-4731-861d-7536081eeab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.027682 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1bbd0-9b41-4731-861d-7536081eeab6 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.028146 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1bbd0-9b41-4731-861d-7536081eeab6 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.028692 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1bbd0-9b41-4731-861d-7536081eeab6 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.029547 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1bbd0-9b41-4731-861d-7536081eeab6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-29a62f7f-768b-42d2-8fbb-3871f0d3e56a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:37.030606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:37.031607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:37.032486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:37.032486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:37.032486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:37.032486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:37.032486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:37.032486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:37.032486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:37.032486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:37.032486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:37.032486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:37.032486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:37.032486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:37.032486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 140/277] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:37.033956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1bbd0-9b41-4731-861d-7536081eeab6 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:37.043330 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a62f7f-768b-42d2-8fbb-3871f0d3e56a None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:37.071278 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 138/278] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:53:36 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:37.194016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:37.209364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a62f7f-768b-42d2-8fbb-3871f0d3e56a None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:37.260580 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbd218-79c1-46cf-bf34-c6402fa44b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.261334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbd218-79c1-46cf-bf34-c6402fa44b42 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.261782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbd218-79c1-46cf-bf34-c6402fa44b42 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.262084 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbd218-79c1-46cf-bf34-c6402fa44b42 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.262798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbd218-79c1-46cf-bf34-c6402fa44b42 None admin] RBAC: Adding query filter params (name=member) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:37.263100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbd218-79c1-46cf-bf34-c6402fa44b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:37.264635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbd218-79c1-46cf-bf34-c6402fa44b42 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:37.276347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 141/279] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:37.284362 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1bbd0-9b41-4731-861d-7536081eeab6 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:37.321571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbd218-79c1-46cf-bf34-c6402fa44b42 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:37.441982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1bbd0-9b41-4731-861d-7536081eeab6 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:37.481225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbd218-79c1-46cf-bf34-c6402fa44b42 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:37.495488 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f60539-5ce3-418e-a88a-46ea11b12917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.495912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f60539-5ce3-418e-a88a-46ea11b12917 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.496419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f60539-5ce3-418e-a88a-46ea11b12917 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.496958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f60539-5ce3-418e-a88a-46ea11b12917 None admin] PATH_INFO: `/v3/users/6627e69a192c4d98a8384f22f089d815` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.524623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f60539-5ce3-418e-a88a-46ea11b12917 None admin] RBAC: Authorizing `identity:get_user(user_id=6627e69a192c4d98a8384f22f089d815)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:37.527648 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f60539-5ce3-418e-a88a-46ea11b12917 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:37.531765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2ca81-a0fc-4290-bbe6-16e002526c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.532486 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 139/280] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:37 2022] GET /identity/v3/users/6627e69a192c4d98a8384f22f089d815 => generated 293 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:37.533042 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2ca81-a0fc-4290-bbe6-16e002526c33 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.533352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2ca81-a0fc-4290-bbe6-16e002526c33 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.533604 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2ca81-a0fc-4290-bbe6-16e002526c33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.542193 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f60539-5ce3-418e-a88a-46ea11b12917 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:37.557844 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2ca81-a0fc-4290-bbe6-16e002526c33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:37.563013 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-d3e2ca81-a0fc-4290-bbe6-16e002526c33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:37.569436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:37.570383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:37.571240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:37.571240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:37.571240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:37.571240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:37.571240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:37.571240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:37.571240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:37.571240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:37.571240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:37.571240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:37.571240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:37.571240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:37.572763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 142/281] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:37.578485 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2ca81-a0fc-4290-bbe6-16e002526c33 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:37.600934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:37.702858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f60539-5ce3-418e-a88a-46ea11b12917 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:37.713119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2ca81-a0fc-4290-bbe6-16e002526c33 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:37.748936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2453a-53e4-41d2-a10f-7a3e7a310fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.749982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2453a-53e4-41d2-a10f-7a3e7a310fa6 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.750507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2453a-53e4-41d2-a10f-7a3e7a310fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.750985 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2453a-53e4-41d2-a10f-7a3e7a310fa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.752178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2453a-53e4-41d2-a10f-7a3e7a310fa6 None admin] RBAC: Adding query filter params (role.id=30891346cde644e7bd9ae90a3876efc8, user.id=6627e69a192c4d98a8384f22f089d815, scope.system=all) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:37.752835 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2453a-53e4-41d2-a10f-7a3e7a310fa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:37.752979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45109af6-6ac6-484a-9195-53ceae4c6b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.753702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45109af6-6ac6-484a-9195-53ceae4c6b54 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.754061 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45109af6-6ac6-484a-9195-53ceae4c6b54 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.754431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45109af6-6ac6-484a-9195-53ceae4c6b54 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.755225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45109af6-6ac6-484a-9195-53ceae4c6b54 None admin] RBAC: Adding query filter params (name=reader) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:37.755623 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45109af6-6ac6-484a-9195-53ceae4c6b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:37.756177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2453a-53e4-41d2-a10f-7a3e7a310fa6 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:37.758327 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45109af6-6ac6-484a-9195-53ceae4c6b54 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:37.763608 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 140/282] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Sep 7 12:53:37 2022] GET /identity/v3/role_assignments?user.id=6627e69a192c4d98a8384f22f089d815&scope.system=all&role.id=30891346cde644e7bd9ae90a3876efc8 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:37.768442 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 143/283] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:37.777596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2453a-53e4-41d2-a10f-7a3e7a310fa6 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:37.833886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e36ab1-5100-4344-81ac-967423f7b7fe None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.834570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e36ab1-5100-4344-81ac-967423f7b7fe None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.835060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e36ab1-5100-4344-81ac-967423f7b7fe None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.837304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 144/284] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:37.843517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b44ec2-3b98-4aff-9ef1-9cc453e3deef None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.844172 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b44ec2-3b98-4aff-9ef1-9cc453e3deef None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.844669 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b44ec2-3b98-4aff-9ef1-9cc453e3deef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.882582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:37.884189 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-27b44ec2-3b98-4aff-9ef1-9cc453e3deef None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:37.885957 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-27b44ec2-3b98-4aff-9ef1-9cc453e3deef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:37.946569 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2453a-53e4-41d2-a10f-7a3e7a310fa6 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:38.022994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc1a2e-7efc-4692-afb6-0e32cee6ed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:38.025220 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc1a2e-7efc-4692-afb6-0e32cee6ed4f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:38.027357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc1a2e-7efc-4692-afb6-0e32cee6ed4f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:38.027817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc1a2e-7efc-4692-afb6-0e32cee6ed4f None admin] PATH_INFO: `/v3/users/1d75d4fe5f5141d98cba8342e0679b08` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:38.030979 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc1a2e-7efc-4692-afb6-0e32cee6ed4f None admin] RBAC: Authorizing `identity:get_user(user_id=1d75d4fe5f5141d98cba8342e0679b08)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:38.038065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc1a2e-7efc-4692-afb6-0e32cee6ed4f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:38.040210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 141/285] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:37 2022] GET /identity/v3/users/1d75d4fe5f5141d98cba8342e0679b08 => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:38.045946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc1a2e-7efc-4692-afb6-0e32cee6ed4f None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:38.053021 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 145/286] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:38.203759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc1a2e-7efc-4692-afb6-0e32cee6ed4f None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:38.262738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cfcd9-e432-4a51-9224-5fc7f4f6f1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:38.263713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cfcd9-e432-4a51-9224-5fc7f4f6f1b1 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:38.264195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cfcd9-e432-4a51-9224-5fc7f4f6f1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:38.264705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cfcd9-e432-4a51-9224-5fc7f4f6f1b1 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:38.266263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cfcd9-e432-4a51-9224-5fc7f4f6f1b1 None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:38.267778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cfcd9-e432-4a51-9224-5fc7f4f6f1b1 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:38.270099 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 142/287] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:38 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:38.276688 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b44ec2-3b98-4aff-9ef1-9cc453e3deef None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:38.291242 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:38.436619 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cfcd9-e432-4a51-9224-5fc7f4f6f1b1 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:38.447335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:38.485722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b44ec2-3b98-4aff-9ef1-9cc453e3deef None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:38.575073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406d53e-8c84-4ea8-891c-b3022604f72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:38.575676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406d53e-8c84-4ea8-891c-b3022604f72a None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:38.575948 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406d53e-8c84-4ea8-891c-b3022604f72a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:38.576217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406d53e-8c84-4ea8-891c-b3022604f72a None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062/users/1d75d4fe5f5141d98cba8342e0679b08/roles/ad483fe996284752ae36cd0fcfcbf503` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:38.579491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406d53e-8c84-4ea8-891c-b3022604f72a None admin] RBAC: Authorizing `identity:create_grant(project_id=f2c27767fad842abb753f50c28758062, user_id=1d75d4fe5f5141d98cba8342e0679b08, role_id=ad483fe996284752ae36cd0fcfcbf503)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:38.581104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406d53e-8c84-4ea8-891c-b3022604f72a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:38.609181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 146/288] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:53:38 2022] PUT /identity/v3/projects/f2c27767fad842abb753f50c28758062/users/1d75d4fe5f5141d98cba8342e0679b08/roles/ad483fe996284752ae36cd0fcfcbf503 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:53:38.611092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cfcd9-e432-4a51-9224-5fc7f4f6f1b1 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:38.690471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334574d-30fe-4842-8ab3-eacebe3afada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:38.691570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334574d-30fe-4842-8ab3-eacebe3afada None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:38.692118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334574d-30fe-4842-8ab3-eacebe3afada None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:38.692614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334574d-30fe-4842-8ab3-eacebe3afada None admin] PATH_INFO: `/v3/roles/member` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:38.722682 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334574d-30fe-4842-8ab3-eacebe3afada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-1334574d-30fe-4842-8ab3-eacebe3afada None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:38.738399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:38.740014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:38.741767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:38.741767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:38.741767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:38.741767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:38.741767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:38.741767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:38.741767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:38.741767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:38.741767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:38.741767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:38.741767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:38.741767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:53:38.741767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 143/289] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:38.750313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406d53e-8c84-4ea8-891c-b3022604f72a None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:38.874631 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:38.943173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406d53e-8c84-4ea8-891c-b3022604f72a None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:38.986101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08718646-c0bd-406b-8f1d-8a4f637e3b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:38.986753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08718646-c0bd-406b-8f1d-8a4f637e3b32 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:38.987388 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08718646-c0bd-406b-8f1d-8a4f637e3b32 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:38.988120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08718646-c0bd-406b-8f1d-8a4f637e3b32 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:38.988262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08718646-c0bd-406b-8f1d-8a4f637e3b32 None admin] RBAC: Adding query filter params (name=member) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:38.988655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08718646-c0bd-406b-8f1d-8a4f637e3b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:38.990129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08718646-c0bd-406b-8f1d-8a4f637e3b32 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:39.000727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 147/290] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:39.007938 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334574d-30fe-4842-8ab3-eacebe3afada None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:39.185816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:39.273895 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334574d-30fe-4842-8ab3-eacebe3afada None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:39.356040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46539f48-52bd-418a-9aae-cd52f1a93103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:39.357394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46539f48-52bd-418a-9aae-cd52f1a93103 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:39.357888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46539f48-52bd-418a-9aae-cd52f1a93103 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:39.358394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46539f48-52bd-418a-9aae-cd52f1a93103 None admin] PATH_INFO: `/v3/users/dab81acabf5c4da2ab84c742ef2e7ea7` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:39.363732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46539f48-52bd-418a-9aae-cd52f1a93103 None admin] RBAC: Authorizing `identity:get_user(user_id=dab81acabf5c4da2ab84c742ef2e7ea7)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:39.366455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46539f48-52bd-418a-9aae-cd52f1a93103 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:39.368892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 144/291] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:39 2022] GET /identity/v3/users/dab81acabf5c4da2ab84c742ef2e7ea7 => generated 297 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:39.375889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08718646-c0bd-406b-8f1d-8a4f637e3b32 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:39.558009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08718646-c0bd-406b-8f1d-8a4f637e3b32 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:39.587870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:39.598381 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4acc0-ee84-49a2-aa27-f74562332214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:39.599258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4acc0-ee84-49a2-aa27-f74562332214 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:39.599576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4acc0-ee84-49a2-aa27-f74562332214 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:39.600004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4acc0-ee84-49a2-aa27-f74562332214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:39.712840 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4acc0-ee84-49a2-aa27-f74562332214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:39.714362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4acc0-ee84-49a2-aa27-f74562332214 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:39.887278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 148/292] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:39.894127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46539f48-52bd-418a-9aae-cd52f1a93103 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:40.087689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46539f48-52bd-418a-9aae-cd52f1a93103 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:40.152706 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881edf8a-2aec-41ce-818d-b96918fab844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:40.153724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881edf8a-2aec-41ce-818d-b96918fab844 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:40.154211 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881edf8a-2aec-41ce-818d-b96918fab844 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:40.154695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881edf8a-2aec-41ce-818d-b96918fab844 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:40.157218 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881edf8a-2aec-41ce-818d-b96918fab844 None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:40.159353 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881edf8a-2aec-41ce-818d-b96918fab844 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:40.161354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 145/293] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:39 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:40.169600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4acc0-ee84-49a2-aa27-f74562332214 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:40.223023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:40.356831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4acc0-ee84-49a2-aa27-f74562332214 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:40.427325 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0446650-75c4-4530-b094-6b63fb9b5c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:40.427876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0446650-75c4-4530-b094-6b63fb9b5c11 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:40.428156 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0446650-75c4-4530-b094-6b63fb9b5c11 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:40.428448 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0446650-75c4-4530-b094-6b63fb9b5c11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:40.429204 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0446650-75c4-4530-b094-6b63fb9b5c11 None admin] RBAC: Adding query filter params (role.id=30891346cde644e7bd9ae90a3876efc8, scope.project.id=f2c27767fad842abb753f50c28758062, user.id=dab81acabf5c4da2ab84c742ef2e7ea7) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:40.429512 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0446650-75c4-4530-b094-6b63fb9b5c11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:40.431020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0446650-75c4-4530-b094-6b63fb9b5c11 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:40.442435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 149/294] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:40 2022] GET /identity/v3/role_assignments?user.id=dab81acabf5c4da2ab84c742ef2e7ea7&scope.project.id=f2c27767fad842abb753f50c28758062&role.id=30891346cde644e7bd9ae90a3876efc8 => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:40.763051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9cf81-5097-4fb4-bfd5-57c22c7fb6ca None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:40.763051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9cf81-5097-4fb4-bfd5-57c22c7fb6ca None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:40.763051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9cf81-5097-4fb4-bfd5-57c22c7fb6ca None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:40.765598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 146/295] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:40.773300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e78b4-55d5-4a2a-8495-674eef6a96ba None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:40.774080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e78b4-55d5-4a2a-8495-674eef6a96ba None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:40.774611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e78b4-55d5-4a2a-8495-674eef6a96ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:40.804241 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-a24e78b4-55d5-4a2a-8495-674eef6a96ba None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:40.806004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a24e78b4-55d5-4a2a-8495-674eef6a96ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:40.904076 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 150/296] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:40.939775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f34217-ec16-4e67-9e7c-ef120de9fd7c None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:40.940463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f34217-ec16-4e67-9e7c-ef120de9fd7c None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:40.940809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f34217-ec16-4e67-9e7c-ef120de9fd7c None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:40.945573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 147/297] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:40.951744 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fb132-ade1-4f21-9284-33a2d2290a8d None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:40.952453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fb132-ade1-4f21-9284-33a2d2290a8d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:40.953190 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fb132-ade1-4f21-9284-33a2d2290a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:40.985747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-a36fb132-ade1-4f21-9284-33a2d2290a8d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:40.988301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a36fb132-ade1-4f21-9284-33a2d2290a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:41.011825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:41.101955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 151/298] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:41.401683 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e873c94-6069-4698-807e-c3618443ce60 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:41.402095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e873c94-6069-4698-807e-c3618443ce60 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:41.402466 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e873c94-6069-4698-807e-c3618443ce60 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:41.405064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 148/299] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:41.414168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3973c6-f908-4b97-bf98-dbd3fd15be75 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:41.414611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3973c6-f908-4b97-bf98-dbd3fd15be75 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:41.415074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3973c6-f908-4b97-bf98-dbd3fd15be75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:41.445375 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-ac3973c6-f908-4b97-bf98-dbd3fd15be75 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:41.447194 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e873c94-6069-4698-807e-c3618443ce60 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:41.448001 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ac3973c6-f908-4b97-bf98-dbd3fd15be75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:41.452267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:41.546272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 152/300] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:41.547338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3973c6-f908-4b97-bf98-dbd3fd15be75 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:41.615521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e873c94-6069-4698-807e-c3618443ce60 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:41.659513 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9706af6-594e-44f0-bceb-768f42afbd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:41.660605 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9706af6-594e-44f0-bceb-768f42afbd51 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:41.661152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9706af6-594e-44f0-bceb-768f42afbd51 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:41.661888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9706af6-594e-44f0-bceb-768f42afbd51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:41.679378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9706af6-594e-44f0-bceb-768f42afbd51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-d9706af6-594e-44f0-bceb-768f42afbd51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:41.684990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:41.685971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:41.686745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:41.686745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:41.686745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:41.686745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:41.686745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:41.686745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:41.686745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:41.686745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:41.686745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:41.686745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:41.686745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:41.686745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:53:41.689631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 149/301] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:41.696121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9706af6-594e-44f0-bceb-768f42afbd51 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:41.709914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:41.736599 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3973c6-f908-4b97-bf98-dbd3fd15be75 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:41.780267 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10b6e7-1931-41a3-ad2b-9cc0bcb751c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:41.781068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10b6e7-1931-41a3-ad2b-9cc0bcb751c4 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:41.781350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10b6e7-1931-41a3-ad2b-9cc0bcb751c4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:41.781734 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10b6e7-1931-41a3-ad2b-9cc0bcb751c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:41.782906 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10b6e7-1931-41a3-ad2b-9cc0bcb751c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:41.784791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:41.784923 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10b6e7-1931-41a3-ad2b-9cc0bcb751c4 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:41.786745 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 153/302] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:41.787893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40932a-2be9-40b6-967f-378500cc8ac7 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:41.788183 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40932a-2be9-40b6-967f-378500cc8ac7 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:41.792664 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40932a-2be9-40b6-967f-378500cc8ac7 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:41.792664 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 154/303] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:41.795527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39f58f-148e-48a4-b32a-e2d86990f71f None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:41.795815 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39f58f-148e-48a4-b32a-e2d86990f71f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:41.796093 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39f58f-148e-48a4-b32a-e2d86990f71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:41.822028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-fd39f58f-148e-48a4-b32a-e2d86990f71f None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:41.823980 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-fd39f58f-148e-48a4-b32a-e2d86990f71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:41.856280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9706af6-594e-44f0-bceb-768f42afbd51 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:41.908803 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e002dc-c582-46c8-875f-92c7dd6cc0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:41.909642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e002dc-c582-46c8-875f-92c7dd6cc0d9 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:41.909963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e002dc-c582-46c8-875f-92c7dd6cc0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:41.910327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e002dc-c582-46c8-875f-92c7dd6cc0d9 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:41.911111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e002dc-c582-46c8-875f-92c7dd6cc0d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:41.911498 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e002dc-c582-46c8-875f-92c7dd6cc0d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:41.913111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e002dc-c582-46c8-875f-92c7dd6cc0d9 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:41.922809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 150/304] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:41.923519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e002dc-c582-46c8-875f-92c7dd6cc0d9 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:41.939683 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 155/305] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:41.945413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39f58f-148e-48a4-b32a-e2d86990f71f None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:42.057242 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:42.082595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e002dc-c582-46c8-875f-92c7dd6cc0d9 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:42.086937 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39f58f-148e-48a4-b32a-e2d86990f71f None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:42.116265 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:42.132973 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7efa4d-3615-4566-a050-bfa0aafa8a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:42.133619 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7efa4d-3615-4566-a050-bfa0aafa8a0d None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:42.133873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7efa4d-3615-4566-a050-bfa0aafa8a0d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:42.134146 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7efa4d-3615-4566-a050-bfa0aafa8a0d None admin] PATH_INFO: `/v3/groups` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:42.134944 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7efa4d-3615-4566-a050-bfa0aafa8a0d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:42.136745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7efa4d-3615-4566-a050-bfa0aafa8a0d None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:42.149403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3f7a8-aa64-4101-8133-88a0accbc314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:42.150300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3f7a8-aa64-4101-8133-88a0accbc314 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:42.150585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3f7a8-aa64-4101-8133-88a0accbc314 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:42.150947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3f7a8-aa64-4101-8133-88a0accbc314 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:42.160687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 151/306] 10.222.0.30 () {60 vars in 1134 bytes} [Wed Sep 7 12:53:41 2022] POST /identity/v3/groups => generated 229 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:42.161631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7efa4d-3615-4566-a050-bfa0aafa8a0d None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:42.169670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3f7a8-aa64-4101-8133-88a0accbc314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-90d3f7a8-aa64-4101-8133-88a0accbc314 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:42.180068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:42.181302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:42.182147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:42.182147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:42.182147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:42.182147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:42.182147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:42.182147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:42.182147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:42.182147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:42.182147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:42.182147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:42.182147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:42.182147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:42.182147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 156/307] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:42.192994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3f7a8-aa64-4101-8133-88a0accbc314 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:42.342097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7efa4d-3615-4566-a050-bfa0aafa8a0d None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:42.373412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3f7a8-aa64-4101-8133-88a0accbc314 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:42.404990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1317ce-d235-46bb-b671-455a4cdf797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:42.406497 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1317ce-d235-46bb-b671-455a4cdf797b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:42.407044 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1317ce-d235-46bb-b671-455a4cdf797b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:42.407496 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1317ce-d235-46bb-b671-455a4cdf797b None admin] PATH_INFO: `/v3/users/8e3fb153d609496c8580d9f3148dd829` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:42.429608 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1317ce-d235-46bb-b671-455a4cdf797b None admin] RBAC: Authorizing `identity:get_user(user_id=8e3fb153d609496c8580d9f3148dd829)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:42.431462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1317ce-d235-46bb-b671-455a4cdf797b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:42.433939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3cb24-9009-4d24-8ab4-401ce08602bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:42.434404 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 152/308] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:42 2022] GET /identity/v3/users/8e3fb153d609496c8580d9f3148dd829 => generated 293 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:42.434825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1317ce-d235-46bb-b671-455a4cdf797b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:42.435297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3cb24-9009-4d24-8ab4-401ce08602bc None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:42.435791 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3cb24-9009-4d24-8ab4-401ce08602bc None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:42.436518 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3cb24-9009-4d24-8ab4-401ce08602bc None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:42.437318 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3cb24-9009-4d24-8ab4-401ce08602bc None admin] RBAC: Adding query filter params (name=member) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:42.437627 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3cb24-9009-4d24-8ab4-401ce08602bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:42.439081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3cb24-9009-4d24-8ab4-401ce08602bc None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:42.449046 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:42.460871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 157/309] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:42.460871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3cb24-9009-4d24-8ab4-401ce08602bc None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:42.501681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:42.582250 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1317ce-d235-46bb-b671-455a4cdf797b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:42.603472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3cb24-9009-4d24-8ab4-401ce08602bc None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:42.637183 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbc685-edd4-47f9-b767-43a8fe74e23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:42.638056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbc685-edd4-47f9-b767-43a8fe74e23c None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:42.638467 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbc685-edd4-47f9-b767-43a8fe74e23c None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:42.638869 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbc685-edd4-47f9-b767-43a8fe74e23c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:42.645336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fcea8-4dbe-4923-a73c-1f48559aa7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:42.645953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fcea8-4dbe-4923-a73c-1f48559aa7e4 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:42.646229 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fcea8-4dbe-4923-a73c-1f48559aa7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:42.646503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fcea8-4dbe-4923-a73c-1f48559aa7e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:42.647364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fcea8-4dbe-4923-a73c-1f48559aa7e4 None admin] RBAC: Adding query filter params (role.id=ad483fe996284752ae36cd0fcfcbf503, user.id=8e3fb153d609496c8580d9f3148dd829, scope.system=all) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:42.647902 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fcea8-4dbe-4923-a73c-1f48559aa7e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:42.649547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fcea8-4dbe-4923-a73c-1f48559aa7e4 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:42.657283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbc685-edd4-47f9-b767-43a8fe74e23c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:42.657478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 158/310] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Sep 7 12:53:42 2022] GET /identity/v3/role_assignments?user.id=8e3fb153d609496c8580d9f3148dd829&scope.system=all&role.id=ad483fe996284752ae36cd0fcfcbf503 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:42.658837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fcea8-4dbe-4923-a73c-1f48559aa7e4 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-2fcbc685-edd4-47f9-b767-43a8fe74e23c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:42.672042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:42.673826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:42.675507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:42.675507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:42.675507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:42.675507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:42.675507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:42.675507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:42.675507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:42.675507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:42.675507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:42.675507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:42.675507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:42.675507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:53:42.675507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 153/311] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:42.675507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbc685-edd4-47f9-b767-43a8fe74e23c None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:42.796799 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:42.853819 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fcea8-4dbe-4923-a73c-1f48559aa7e4 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:42.872876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbc685-edd4-47f9-b767-43a8fe74e23c None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:42.875912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:42.921048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ef77-0050-44bf-b9ed-4aa5b036fc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:42.922073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ef77-0050-44bf-b9ed-4aa5b036fc19 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:42.922540 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ef77-0050-44bf-b9ed-4aa5b036fc19 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:42.923007 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ef77-0050-44bf-b9ed-4aa5b036fc19 None admin] PATH_INFO: `/v3/users/6627e69a192c4d98a8384f22f089d815` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:42.925216 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868ef77-0050-44bf-b9ed-4aa5b036fc19 None admin] RBAC: Authorizing `identity:get_user(user_id=6627e69a192c4d98a8384f22f089d815)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:42.927724 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868ef77-0050-44bf-b9ed-4aa5b036fc19 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:42.931131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 159/312] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:42 2022] GET /identity/v3/users/6627e69a192c4d98a8384f22f089d815 => generated 293 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:42.937450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ef77-0050-44bf-b9ed-4aa5b036fc19 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:42.939802 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3f64b-9302-4d32-8e1a-da22c116ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:42.940718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3f64b-9302-4d32-8e1a-da22c116ce89 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:42.941227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3f64b-9302-4d32-8e1a-da22c116ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:42.941613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3f64b-9302-4d32-8e1a-da22c116ce89 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:42.942310 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3f64b-9302-4d32-8e1a-da22c116ce89 None admin] RBAC: Adding query filter params (name=reader) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:42.942639 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3f64b-9302-4d32-8e1a-da22c116ce89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:42.944074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3f64b-9302-4d32-8e1a-da22c116ce89 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:42.963494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 154/313] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:42.963494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3f64b-9302-4d32-8e1a-da22c116ce89 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:43.074149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ef77-0050-44bf-b9ed-4aa5b036fc19 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:43.125403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:43.131778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3f64b-9302-4d32-8e1a-da22c116ce89 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:43.134821 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d4aa2-9da4-48c7-a7ac-52688a4187a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:43.136006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d4aa2-9da4-48c7-a7ac-52688a4187a0 None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:43.136581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d4aa2-9da4-48c7-a7ac-52688a4187a0 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:43.137047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d4aa2-9da4-48c7-a7ac-52688a4187a0 None admin] PATH_INFO: `/v3/system/users/6627e69a192c4d98a8384f22f089d815/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:43.139565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d4aa2-9da4-48c7-a7ac-52688a4187a0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6627e69a192c4d98a8384f22f089d815, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:43.144411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d4aa2-9da4-48c7-a7ac-52688a4187a0 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:43.161351 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 160/314] 10.222.0.30 () {58 vars in 1334 bytes} [Wed Sep 7 12:53:42 2022] PUT /identity/v3/system/users/6627e69a192c4d98a8384f22f089d815/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:43.202895 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9c9ab-eeb3-49c0-9cbc-a5ee540166ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:43.203709 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9c9ab-eeb3-49c0-9cbc-a5ee540166ca None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:43.204033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9c9ab-eeb3-49c0-9cbc-a5ee540166ca None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:43.204311 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9c9ab-eeb3-49c0-9cbc-a5ee540166ca None admin] PATH_INFO: `/v3/users/1d75d4fe5f5141d98cba8342e0679b08` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:43.205964 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9c9ab-eeb3-49c0-9cbc-a5ee540166ca None admin] RBAC: Authorizing `identity:get_user(user_id=1d75d4fe5f5141d98cba8342e0679b08)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:43.207672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9c9ab-eeb3-49c0-9cbc-a5ee540166ca None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:43.210231 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 155/315] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:42 2022] GET /identity/v3/users/1d75d4fe5f5141d98cba8342e0679b08 => generated 297 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:43.220718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d4aa2-9da4-48c7-a7ac-52688a4187a0 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:43.368677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d4aa2-9da4-48c7-a7ac-52688a4187a0 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:43.421969 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cfbfd-965c-462d-bda1-7162d197d45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:43.423012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cfbfd-965c-462d-bda1-7162d197d45e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:43.423492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cfbfd-965c-462d-bda1-7162d197d45e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:43.423960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cfbfd-965c-462d-bda1-7162d197d45e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:43.509458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cfbfd-965c-462d-bda1-7162d197d45e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:43.513577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:43.520956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cfbfd-965c-462d-bda1-7162d197d45e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:43.669357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 161/316] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:43.675771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9c9ab-eeb3-49c0-9cbc-a5ee540166ca None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:43.722430 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:43.817980 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9c9ab-eeb3-49c0-9cbc-a5ee540166ca None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:43.857622 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11482e35-5eed-469b-b6eb-28637dd7cd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:43.858434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11482e35-5eed-469b-b6eb-28637dd7cd2c None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:43.858726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11482e35-5eed-469b-b6eb-28637dd7cd2c None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:43.858996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11482e35-5eed-469b-b6eb-28637dd7cd2c None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:43.860238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11482e35-5eed-469b-b6eb-28637dd7cd2c None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:43.861758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11482e35-5eed-469b-b6eb-28637dd7cd2c None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:43.863883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 156/317] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:43 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:43.874054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cfbfd-965c-462d-bda1-7162d197d45e None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:44.005637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:44.013051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cfbfd-965c-462d-bda1-7162d197d45e None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:44.059528 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff851d9-0673-4ebe-81e5-bf0c76d01ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:44.060268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff851d9-0673-4ebe-81e5-bf0c76d01ab1 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:44.060752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff851d9-0673-4ebe-81e5-bf0c76d01ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:44.061201 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff851d9-0673-4ebe-81e5-bf0c76d01ab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:44.062357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff851d9-0673-4ebe-81e5-bf0c76d01ab1 None admin] RBAC: Adding query filter params (role.id=ad483fe996284752ae36cd0fcfcbf503, scope.project.id=f2c27767fad842abb753f50c28758062, user.id=1d75d4fe5f5141d98cba8342e0679b08) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:44.062863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff851d9-0673-4ebe-81e5-bf0c76d01ab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:44.065509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff851d9-0673-4ebe-81e5-bf0c76d01ab1 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:44.076164 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 162/318] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:43 2022] GET /identity/v3/role_assignments?user.id=1d75d4fe5f5141d98cba8342e0679b08&scope.project.id=f2c27767fad842abb753f50c28758062&role.id=ad483fe996284752ae36cd0fcfcbf503 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:44.764695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b37dd9-e1ce-48a6-8f4c-df7ba4c485b7 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:44.765284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b37dd9-e1ce-48a6-8f4c-df7ba4c485b7 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:44.765284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b37dd9-e1ce-48a6-8f4c-df7ba4c485b7 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:44.766936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 157/319] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:44.773013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c3c98-318d-419d-b3ff-fd26be9de3e9 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:44.773411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c3c98-318d-419d-b3ff-fd26be9de3e9 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:44.773560 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c3c98-318d-419d-b3ff-fd26be9de3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:44.794071 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-d00c3c98-318d-419d-b3ff-fd26be9de3e9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:44.795354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d00c3c98-318d-419d-b3ff-fd26be9de3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:44.887146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 163/320] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:45.171469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b37dd9-e1ce-48a6-8f4c-df7ba4c485b7 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:45.294581 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:45.298687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b37dd9-e1ce-48a6-8f4c-df7ba4c485b7 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:45.300692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f03a6-b050-477d-981b-091c0d4e06ed None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:45.301170 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f03a6-b050-477d-981b-091c0d4e06ed None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:45.301600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f03a6-b050-477d-981b-091c0d4e06ed None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:45.304172 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 164/321] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:45.312224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19f0e5-1baf-4f26-a2f3-df2174b2747f None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:45.312802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19f0e5-1baf-4f26-a2f3-df2174b2747f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:45.313321 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19f0e5-1baf-4f26-a2f3-df2174b2747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:45.341509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-1a19f0e5-1baf-4f26-a2f3-df2174b2747f None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:45.343686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1a19f0e5-1baf-4f26-a2f3-df2174b2747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:45.352626 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69656da9-2d8e-4f5f-889f-6f42044dc1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:45.353259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69656da9-2d8e-4f5f-889f-6f42044dc1a4 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:45.353527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69656da9-2d8e-4f5f-889f-6f42044dc1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:45.353790 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69656da9-2d8e-4f5f-889f-6f42044dc1a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:45.354935 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69656da9-2d8e-4f5f-889f-6f42044dc1a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:45.356406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69656da9-2d8e-4f5f-889f-6f42044dc1a4 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:45.358006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 158/322] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:45.364396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69656da9-2d8e-4f5f-889f-6f42044dc1a4 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:45.473576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 165/323] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:45.507414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69656da9-2d8e-4f5f-889f-6f42044dc1a4 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:45.552081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cda763-8129-4397-9321-6c6ec2bf9fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:45.552734 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cda763-8129-4397-9321-6c6ec2bf9fbc None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:45.553008 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cda763-8129-4397-9321-6c6ec2bf9fbc None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:45.553282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cda763-8129-4397-9321-6c6ec2bf9fbc None admin] PATH_INFO: `/v3/groups` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:45.553999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cda763-8129-4397-9321-6c6ec2bf9fbc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:45.555477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cda763-8129-4397-9321-6c6ec2bf9fbc None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:45.573939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 159/324] 10.222.0.30 () {60 vars in 1134 bytes} [Wed Sep 7 12:53:45 2022] POST /identity/v3/groups => generated 226 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:53:45.780999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19f0e5-1baf-4f26-a2f3-df2174b2747f None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:45.809181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:45.818654 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a407d0d-3768-4e55-a57f-8101c43bfb6a None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:45.819217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a407d0d-3768-4e55-a57f-8101c43bfb6a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:45.819217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a407d0d-3768-4e55-a57f-8101c43bfb6a None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:45.820840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 160/325] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:45.828452 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13316b4e-6759-44dc-9a73-35bead5c2afe None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:45.828962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13316b4e-6759-44dc-9a73-35bead5c2afe None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:45.829536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13316b4e-6759-44dc-9a73-35bead5c2afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:45.857841 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-13316b4e-6759-44dc-9a73-35bead5c2afe None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:45.859291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-13316b4e-6759-44dc-9a73-35bead5c2afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:45.899008 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:45.933514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19f0e5-1baf-4f26-a2f3-df2174b2747f None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:45.978770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 161/326] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:45.991627 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a32f58-bcf9-43cf-9bd3-12b45ae72c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:45.992720 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a32f58-bcf9-43cf-9bd3-12b45ae72c6c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:45.992958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a32f58-bcf9-43cf-9bd3-12b45ae72c6c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:45.993234 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a32f58-bcf9-43cf-9bd3-12b45ae72c6c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:46.008395 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a32f58-bcf9-43cf-9bd3-12b45ae72c6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-25a32f58-bcf9-43cf-9bd3-12b45ae72c6c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:46.013750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:46.014705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:46.015503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:46.015503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:46.015503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:46.015503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:46.015503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:46.015503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:46.015503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:46.015503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:46.015503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:46.015503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:46.015503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:46.015503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:46.018303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 166/327] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:46.024853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13316b4e-6759-44dc-9a73-35bead5c2afe None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:46.167708 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13316b4e-6759-44dc-9a73-35bead5c2afe None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:46.221227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87feac4c-9028-437b-b2fc-60c0d972056a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:46.222186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feac4c-9028-437b-b2fc-60c0d972056a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:46.222637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feac4c-9028-437b-b2fc-60c0d972056a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:46.223071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feac4c-9028-437b-b2fc-60c0d972056a None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:46.223957 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87feac4c-9028-437b-b2fc-60c0d972056a None admin] RBAC: Adding query filter params (name=reader) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:46.224450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87feac4c-9028-437b-b2fc-60c0d972056a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:46.226032 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87feac4c-9028-437b-b2fc-60c0d972056a None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:46.237928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 162/328] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:46.245678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a32f58-bcf9-43cf-9bd3-12b45ae72c6c None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:46.253148 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87feac4c-9028-437b-b2fc-60c0d972056a None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:46.296744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:46.394327 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:46.401288 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87feac4c-9028-437b-b2fc-60c0d972056a None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:46.421967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a32f58-bcf9-43cf-9bd3-12b45ae72c6c None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:46.483943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986d469-a5e9-43c3-b55c-6c1a87ce5dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:46.484988 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986d469-a5e9-43c3-b55c-6c1a87ce5dd9 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:46.485431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986d469-a5e9-43c3-b55c-6c1a87ce5dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:46.485868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986d469-a5e9-43c3-b55c-6c1a87ce5dd9 None admin] PATH_INFO: `/v3/users/8e3fb153d609496c8580d9f3148dd829` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:46.487349 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a3b9-ac83-4c11-bf4b-543a318cada3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:46.487867 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986d469-a5e9-43c3-b55c-6c1a87ce5dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=8e3fb153d609496c8580d9f3148dd829)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:46.488913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a3b9-ac83-4c11-bf4b-543a318cada3 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:46.489392 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a3b9-ac83-4c11-bf4b-543a318cada3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:46.489902 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a3b9-ac83-4c11-bf4b-543a318cada3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:46.490458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986d469-a5e9-43c3-b55c-6c1a87ce5dd9 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:46.492777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 167/329] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:46 2022] GET /identity/v3/users/8e3fb153d609496c8580d9f3148dd829 => generated 293 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:46.499037 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986d469-a5e9-43c3-b55c-6c1a87ce5dd9 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:46.508998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09a3b9-ac83-4c11-bf4b-543a318cada3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-ae09a3b9-ac83-4c11-bf4b-543a318cada3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:46.516087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:46.517081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:46.518125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:46.518125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:46.518125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:46.518125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:46.518125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:46.518125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:46.518125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:46.518125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:46.518125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:46.518125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:46.518125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:46.518125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:53:46.521477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 163/330] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:46.536934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a3b9-ac83-4c11-bf4b-543a318cada3 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:46.636283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986d469-a5e9-43c3-b55c-6c1a87ce5dd9 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:46.674739 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:46.697986 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af778e9-b6df-4a1f-835a-8404d3dea87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:46.698714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af778e9-b6df-4a1f-835a-8404d3dea87c None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:46.699019 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af778e9-b6df-4a1f-835a-8404d3dea87c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:46.699394 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af778e9-b6df-4a1f-835a-8404d3dea87c None admin] PATH_INFO: `/v3/system/users/8e3fb153d609496c8580d9f3148dd829/roles/ad483fe996284752ae36cd0fcfcbf503` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:46.701220 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af778e9-b6df-4a1f-835a-8404d3dea87c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8e3fb153d609496c8580d9f3148dd829, role_id=ad483fe996284752ae36cd0fcfcbf503)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:46.706732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af778e9-b6df-4a1f-835a-8404d3dea87c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:46.717407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 168/331] 10.222.0.30 () {58 vars in 1334 bytes} [Wed Sep 7 12:53:46 2022] PUT /identity/v3/system/users/8e3fb153d609496c8580d9f3148dd829/roles/ad483fe996284752ae36cd0fcfcbf503 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:46.734111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a3b9-ac83-4c11-bf4b-543a318cada3 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:46.799804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d32fa-8203-48f1-87e0-161e0acb28e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:46.800815 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d32fa-8203-48f1-87e0-161e0acb28e3 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:46.801314 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d32fa-8203-48f1-87e0-161e0acb28e3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:46.801754 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d32fa-8203-48f1-87e0-161e0acb28e3 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:46.802804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d32fa-8203-48f1-87e0-161e0acb28e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:46.803287 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d32fa-8203-48f1-87e0-161e0acb28e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:46.805489 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d32fa-8203-48f1-87e0-161e0acb28e3 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:46.823977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 164/332] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:46.832987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af778e9-b6df-4a1f-835a-8404d3dea87c None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:46.880760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:47.041472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af778e9-b6df-4a1f-835a-8404d3dea87c None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:47.090486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a0b42-7722-407e-9db9-3765cdb9ed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:47.091124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a0b42-7722-407e-9db9-3765cdb9ed4f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:47.091398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a0b42-7722-407e-9db9-3765cdb9ed4f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:47.091668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a0b42-7722-407e-9db9-3765cdb9ed4f None admin] PATH_INFO: `/v3/users/6627e69a192c4d98a8384f22f089d815` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:47.092921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a0b42-7722-407e-9db9-3765cdb9ed4f None admin] RBAC: Authorizing `identity:get_user(user_id=6627e69a192c4d98a8384f22f089d815)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:47.094411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a0b42-7722-407e-9db9-3765cdb9ed4f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:47.096396 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 169/333] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:46 2022] GET /identity/v3/users/6627e69a192c4d98a8384f22f089d815 => generated 293 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:47.103406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d32fa-8203-48f1-87e0-161e0acb28e3 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:47.258153 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d32fa-8203-48f1-87e0-161e0acb28e3 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:47.322893 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddf852-d1b7-4709-865d-a5040eab39cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:47.323438 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddf852-d1b7-4709-865d-a5040eab39cb None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:47.323711 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddf852-d1b7-4709-865d-a5040eab39cb None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:47.323980 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddf852-d1b7-4709-865d-a5040eab39cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:47.324793 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddf852-d1b7-4709-865d-a5040eab39cb None admin] RBAC: Adding query filter params (role.id=30891346cde644e7bd9ae90a3876efc8, user.id=6627e69a192c4d98a8384f22f089d815, scope.system=all) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:47.325097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddf852-d1b7-4709-865d-a5040eab39cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:47.326712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddf852-d1b7-4709-865d-a5040eab39cb None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:47.343370 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:47.350133 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 165/334] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Sep 7 12:53:47 2022] GET /identity/v3/role_assignments?user.id=6627e69a192c4d98a8384f22f089d815&scope.system=all&role.id=30891346cde644e7bd9ae90a3876efc8 => generated 510 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:48.571867 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b4f10-f4e3-4e17-8c78-fd4837e99eb8 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:48.572437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b4f10-f4e3-4e17-8c78-fd4837e99eb8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:48.572868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b4f10-f4e3-4e17-8c78-fd4837e99eb8 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:48.576235 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 170/335] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:48.584503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08303f1b-7d34-48d8-bd84-85f081d90d35 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:48.585831 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08303f1b-7d34-48d8-bd84-85f081d90d35 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:48.586299 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08303f1b-7d34-48d8-bd84-85f081d90d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:48.615684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-08303f1b-7d34-48d8-bd84-85f081d90d35 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:48.617276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-08303f1b-7d34-48d8-bd84-85f081d90d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:48.710028 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 166/336] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:49.140223 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b4f10-f4e3-4e17-8c78-fd4837e99eb8 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:49.245002 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:49.273728 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b4f10-f4e3-4e17-8c78-fd4837e99eb8 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:49.321276 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce2672-8e54-44c8-984c-a662447daaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:49.322319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce2672-8e54-44c8-984c-a662447daaab None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:49.322888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce2672-8e54-44c8-984c-a662447daaab None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:49.323360 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce2672-8e54-44c8-984c-a662447daaab None admin] PATH_INFO: `/v3/roles/member` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:49.338781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce2672-8e54-44c8-984c-a662447daaab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-afce2672-8e54-44c8-984c-a662447daaab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:49.344511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:49.345491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:49.346577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:49.346577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:49.346577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:49.346577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:49.346577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:49.346577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:49.346577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:49.346577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:49.346577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:49.346577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:49.346577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:49.346577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:49.353630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 171/337] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:49.356248 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08303f1b-7d34-48d8-bd84-85f081d90d35 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:49.478524 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08303f1b-7d34-48d8-bd84-85f081d90d35 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:49.524797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:49.531120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0a63d-c167-424c-b0f3-8f9fc46041cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:49.531882 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0a63d-c167-424c-b0f3-8f9fc46041cb None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:49.532637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0a63d-c167-424c-b0f3-8f9fc46041cb None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:49.532920 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0a63d-c167-424c-b0f3-8f9fc46041cb None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:49.533721 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0a63d-c167-424c-b0f3-8f9fc46041cb None admin] RBAC: Adding query filter params (name=member) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:49.534434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0a63d-c167-424c-b0f3-8f9fc46041cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:49.536407 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0a63d-c167-424c-b0f3-8f9fc46041cb None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:49.552747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 167/338] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:49.559370 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce2672-8e54-44c8-984c-a662447daaab None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:49.719341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce2672-8e54-44c8-984c-a662447daaab None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:49.765299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fbc09-f9d4-411d-a51e-f3334fb2cf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:49.765843 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fbc09-f9d4-411d-a51e-f3334fb2cf49 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:49.766125 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fbc09-f9d4-411d-a51e-f3334fb2cf49 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:49.766449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fbc09-f9d4-411d-a51e-f3334fb2cf49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:49.782066 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:49.800567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3f87b-fae9-4f80-84d0-8ead99d1bd5d None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:49.801073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3f87b-fae9-4f80-84d0-8ead99d1bd5d None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:49.801146 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3f87b-fae9-4f80-84d0-8ead99d1bd5d None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:49.802807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 168/339] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:49.812132 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6010617-0037-49bc-a658-4b4045c9c2f4 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:49.812452 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6010617-0037-49bc-a658-4b4045c9c2f4 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:49.812716 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6010617-0037-49bc-a658-4b4045c9c2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:49.847817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-d6010617-0037-49bc-a658-4b4045c9c2f4 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:49.851593 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d6010617-0037-49bc-a658-4b4045c9c2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:49.928354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fbc09-f9d4-411d-a51e-f3334fb2cf49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:49.929913 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fbc09-f9d4-411d-a51e-f3334fb2cf49 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:49.999600 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 169/340] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:50.138258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 172/341] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:50.147165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6010617-0037-49bc-a658-4b4045c9c2f4 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:50.278229 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6010617-0037-49bc-a658-4b4045c9c2f4 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:50.312121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:50.318031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a0f7d-6b83-4a80-a84a-825b4473b141 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.318404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a0f7d-6b83-4a80-a84a-825b4473b141 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.318640 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a0f7d-6b83-4a80-a84a-825b4473b141 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.319950 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 173/342] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:50.331771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5d289-f327-47ba-9bc6-6c50ab90f3d3 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.332098 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5d289-f327-47ba-9bc6-6c50ab90f3d3 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.332565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5d289-f327-47ba-9bc6-6c50ab90f3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.335324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858a466-23af-4d3e-bbd8-eed0d01afec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:50.335979 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858a466-23af-4d3e-bbd8-eed0d01afec3 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.336256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858a466-23af-4d3e-bbd8-eed0d01afec3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.336562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858a466-23af-4d3e-bbd8-eed0d01afec3 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.341210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858a466-23af-4d3e-bbd8-eed0d01afec3 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:50.345853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858a466-23af-4d3e-bbd8-eed0d01afec3 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:50.345853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 170/343] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:50 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:50.352736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858a466-23af-4d3e-bbd8-eed0d01afec3 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:50.369704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-a2f5d289-f327-47ba-9bc6-6c50ab90f3d3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:50.371288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a2f5d289-f327-47ba-9bc6-6c50ab90f3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:50.468888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:50.524224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 174/344] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:50.524495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858a466-23af-4d3e-bbd8-eed0d01afec3 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:50.561456 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5d289-f327-47ba-9bc6-6c50ab90f3d3 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:50.587713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c77adb-7b1b-4957-baf7-61487b6937de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:50.588405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c77adb-7b1b-4957-baf7-61487b6937de None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.588718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c77adb-7b1b-4957-baf7-61487b6937de None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.588991 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c77adb-7b1b-4957-baf7-61487b6937de None admin] PATH_INFO: `/v3/groups/01f0327c73994f0ba1adf7e907e46571` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.598080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c77adb-7b1b-4957-baf7-61487b6937de None admin] RBAC: Authorizing `identity:get_group(group_id=01f0327c73994f0ba1adf7e907e46571)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:50.599759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c77adb-7b1b-4957-baf7-61487b6937de None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:50.601629 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 171/345] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Sep 7 12:53:50 2022] GET /identity/v3/groups/01f0327c73994f0ba1adf7e907e46571 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:50.621529 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c77adb-7b1b-4957-baf7-61487b6937de None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:50.732900 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:50.801538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5d289-f327-47ba-9bc6-6c50ab90f3d3 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:50.802109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c77adb-7b1b-4957-baf7-61487b6937de None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:50.865714 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff11284-c73e-4d41-a11f-5b16470f770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:50.866453 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff11284-c73e-4d41-a11f-5b16470f770b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.867076 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff11284-c73e-4d41-a11f-5b16470f770b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.867875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff11284-c73e-4d41-a11f-5b16470f770b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.869610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff11284-c73e-4d41-a11f-5b16470f770b None admin] RBAC: Adding query filter params (group.id=01f0327c73994f0ba1adf7e907e46571, role.id=30891346cde644e7bd9ae90a3876efc8, scope.project.id=d2ad57e577854d67ae2401564821ce05) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:50.870391 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff11284-c73e-4d41-a11f-5b16470f770b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:50.872988 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741d588-eb79-4200-b43f-5f59213c81a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:50.873769 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741d588-eb79-4200-b43f-5f59213c81a1 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.874061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff11284-c73e-4d41-a11f-5b16470f770b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:50.874208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741d588-eb79-4200-b43f-5f59213c81a1 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.874570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741d588-eb79-4200-b43f-5f59213c81a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.885125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 172/346] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Sep 7 12:53:50 2022] GET /identity/v3/role_assignments?group.id=01f0327c73994f0ba1adf7e907e46571&scope.project.id=d2ad57e577854d67ae2401564821ce05&role.id=30891346cde644e7bd9ae90a3876efc8 => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:50.889686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fca1a-19a5-41de-8988-6cad7d3e3d79 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.890302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fca1a-19a5-41de-8988-6cad7d3e3d79 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.890758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fca1a-19a5-41de-8988-6cad7d3e3d79 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.892520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 173/347] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:50.897681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741d588-eb79-4200-b43f-5f59213c81a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:50.900136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64597d-25dc-4247-a163-90a8148d65f3 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.900699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64597d-25dc-4247-a163-90a8148d65f3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.901156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64597d-25dc-4247-a163-90a8148d65f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-3741d588-eb79-4200-b43f-5f59213c81a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:50.903721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:50.904911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:50.905726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:50.905726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:50.905726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:50.905726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:50.905726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:50.905726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:50.905726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:50.905726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:50.905726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:50.905726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:50.905726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:50.905726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:50.905726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 175/348] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:50.912081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741d588-eb79-4200-b43f-5f59213c81a1 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:50.939675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-eb64597d-25dc-4247-a163-90a8148d65f3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:50.942240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-eb64597d-25dc-4247-a163-90a8148d65f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:50.988950 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:51.091207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 174/349] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:51.114447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64597d-25dc-4247-a163-90a8148d65f3 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:51.145373 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741d588-eb79-4200-b43f-5f59213c81a1 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:51.260793 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:51.261718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cb722-3165-4ec1-bc26-6c43a4085b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:51.262373 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb722-3165-4ec1-bc26-6c43a4085b34 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:51.262819 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb722-3165-4ec1-bc26-6c43a4085b34 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:51.263254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb722-3165-4ec1-bc26-6c43a4085b34 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:51.264404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cb722-3165-4ec1-bc26-6c43a4085b34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:51.264948 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cb722-3165-4ec1-bc26-6c43a4085b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:51.268250 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cb722-3165-4ec1-bc26-6c43a4085b34 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:51.303404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 176/350] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:51.305647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67d189-27b3-447f-b3e7-8b86218bcdd9 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:51.306138 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67d189-27b3-447f-b3e7-8b86218bcdd9 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:51.306622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67d189-27b3-447f-b3e7-8b86218bcdd9 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:51.318538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 177/351] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:51 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:51.320022 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67d189-27b3-447f-b3e7-8b86218bcdd9 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:51.337374 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64597d-25dc-4247-a163-90a8148d65f3 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:51.396591 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78d075-0cda-4304-8747-41dfda4d228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:51.397292 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78d075-0cda-4304-8747-41dfda4d228d None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:51.397566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78d075-0cda-4304-8747-41dfda4d228d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:51.397882 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78d075-0cda-4304-8747-41dfda4d228d None admin] PATH_INFO: `/v3/roles/member` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:51.415175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78d075-0cda-4304-8747-41dfda4d228d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-ba78d075-0cda-4304-8747-41dfda4d228d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:51.422748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:51.424247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:51.426034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:51.426034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:51.426034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:51.426034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:51.426034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:51.426034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:51.426034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:51.426034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:51.426034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:51.426034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:51.426034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:51.426034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:53:51.429158 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 175/352] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:51.431243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc186c6-6aeb-45be-ac78-098bd61e36e3 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:51.431862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc186c6-6aeb-45be-ac78-098bd61e36e3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:51.436793 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc186c6-6aeb-45be-ac78-098bd61e36e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:51.464933 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-7bc186c6-6aeb-45be-ac78-098bd61e36e3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:51.466520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7bc186c6-6aeb-45be-ac78-098bd61e36e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:51.567228 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 176/353] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:51.568193 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc186c6-6aeb-45be-ac78-098bd61e36e3 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:51.581308 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:51.594885 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67d189-27b3-447f-b3e7-8b86218bcdd9 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:51.646393 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d9e14-f9d4-431d-8323-9b2a1faf6c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:51.647470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d9e14-f9d4-431d-8323-9b2a1faf6c9d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:51.647899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d9e14-f9d4-431d-8323-9b2a1faf6c9d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:51.648722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d9e14-f9d4-431d-8323-9b2a1faf6c9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:51.668686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:51.736938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d9e14-f9d4-431d-8323-9b2a1faf6c9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:51.738977 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d9e14-f9d4-431d-8323-9b2a1faf6c9d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:51.844638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc186c6-6aeb-45be-ac78-098bd61e36e3 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:51.865202 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:51.878218 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 178/354] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:51.879491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d9e14-f9d4-431d-8323-9b2a1faf6c9d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:51.975126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c4a57-82af-42a6-b57b-2219edafd27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:51.975794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c4a57-82af-42a6-b57b-2219edafd27c None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:51.976070 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c4a57-82af-42a6-b57b-2219edafd27c None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:51.976336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c4a57-82af-42a6-b57b-2219edafd27c None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:51.977622 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c4a57-82af-42a6-b57b-2219edafd27c None admin] RBAC: Adding query filter params (name=member) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:51.978427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c4a57-82af-42a6-b57b-2219edafd27c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:51.979897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c4a57-82af-42a6-b57b-2219edafd27c None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:51.998836 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 177/355] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:51.999723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c4a57-82af-42a6-b57b-2219edafd27c None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:52.035209 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d9e14-f9d4-431d-8323-9b2a1faf6c9d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:52.096078 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4ab50-02f5-46c4-b1b3-5db0f07acb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:52.097279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4ab50-02f5-46c4-b1b3-5db0f07acb40 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:52.097746 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4ab50-02f5-46c4-b1b3-5db0f07acb40 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:52.098519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4ab50-02f5-46c4-b1b3-5db0f07acb40 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:52.114032 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4ab50-02f5-46c4-b1b3-5db0f07acb40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-3ec4ab50-02f5-46c4-b1b3-5db0f07acb40 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:52.120877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:52.121931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:52.123045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:52.123045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:52.123045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:52.123045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:52.123045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:52.123045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:52.123045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:52.123045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:52.123045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:52.123045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:52.123045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:53:52.123045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:52.125808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 179/356] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:52.126876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4ab50-02f5-46c4-b1b3-5db0f07acb40 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:52.215828 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:52.221095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c4a57-82af-42a6-b57b-2219edafd27c None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:52.246703 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:52.277042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db1ec0-7abb-4a73-be5c-7c28c35c6cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:52.277961 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db1ec0-7abb-4a73-be5c-7c28c35c6cd7 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:52.278387 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db1ec0-7abb-4a73-be5c-7c28c35c6cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:52.279662 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db1ec0-7abb-4a73-be5c-7c28c35c6cd7 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:52.281866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db1ec0-7abb-4a73-be5c-7c28c35c6cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:52.284139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db1ec0-7abb-4a73-be5c-7c28c35c6cd7 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:52.286801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 178/357] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:51 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:52.288277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db1ec0-7abb-4a73-be5c-7c28c35c6cd7 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:52.324416 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4ab50-02f5-46c4-b1b3-5db0f07acb40 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:52.376671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62325c0e-ec82-4646-9709-eb52135f3571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:52.376920 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62325c0e-ec82-4646-9709-eb52135f3571 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:52.377587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62325c0e-ec82-4646-9709-eb52135f3571 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:52.378432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62325c0e-ec82-4646-9709-eb52135f3571 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:52.446654 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db1ec0-7abb-4a73-be5c-7c28c35c6cd7 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:52.504166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62325c0e-ec82-4646-9709-eb52135f3571 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:52.505886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62325c0e-ec82-4646-9709-eb52135f3571 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:52.524808 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f734a3-99d0-4433-8fa1-46a4ea906e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:52.525843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f734a3-99d0-4433-8fa1-46a4ea906e41 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:52.526126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f734a3-99d0-4433-8fa1-46a4ea906e41 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:52.526398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f734a3-99d0-4433-8fa1-46a4ea906e41 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:52.527434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f734a3-99d0-4433-8fa1-46a4ea906e41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:52.528791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f734a3-99d0-4433-8fa1-46a4ea906e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:52.531599 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f734a3-99d0-4433-8fa1-46a4ea906e41 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:52.544701 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 179/358] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:52.545990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f734a3-99d0-4433-8fa1-46a4ea906e41 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:52.589717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:52.599316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:52.677148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 180/359] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:52.678258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62325c0e-ec82-4646-9709-eb52135f3571 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:52.708859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f734a3-99d0-4433-8fa1-46a4ea906e41 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:52.770275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79db4-d95e-4aed-929c-dfd3bb49be0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:52.771180 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79db4-d95e-4aed-929c-dfd3bb49be0d None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:52.771602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79db4-d95e-4aed-929c-dfd3bb49be0d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:52.772038 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79db4-d95e-4aed-929c-dfd3bb49be0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:52.788809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b79db4-d95e-4aed-929c-dfd3bb49be0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-64b79db4-d95e-4aed-929c-dfd3bb49be0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:52.798121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:52.799823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:52.801448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:52.801448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:52.801448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:52.801448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:52.801448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:52.801448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:52.801448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:52.801448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:52.801448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:52.801448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:52.801448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:52.801448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:53:52.804634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 180/360] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:52.806779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7a2b2-c7a2-411a-aa85-395ead0bda38 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:52.807384 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7a2b2-c7a2-411a-aa85-395ead0bda38 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:52.807951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7a2b2-c7a2-411a-aa85-395ead0bda38 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:52.810247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 181/361] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:52.811586 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7a2b2-c7a2-411a-aa85-395ead0bda38 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:52.822380 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62325c0e-ec82-4646-9709-eb52135f3571 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:52.890568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf52549-0e1a-4d21-8fc8-9d6b4b57623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:52.891207 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf52549-0e1a-4d21-8fc8-9d6b4b57623b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:52.891868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf52549-0e1a-4d21-8fc8-9d6b4b57623b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:52.892151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf52549-0e1a-4d21-8fc8-9d6b4b57623b None admin] PATH_INFO: `/v3/groups/01f0327c73994f0ba1adf7e907e46571` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:52.895562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf52549-0e1a-4d21-8fc8-9d6b4b57623b None admin] RBAC: Authorizing `identity:get_group(group_id=01f0327c73994f0ba1adf7e907e46571)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:52.897524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf52549-0e1a-4d21-8fc8-9d6b4b57623b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:52.900676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 181/362] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Sep 7 12:53:52 2022] GET /identity/v3/groups/01f0327c73994f0ba1adf7e907e46571 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:52.901523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf52549-0e1a-4d21-8fc8-9d6b4b57623b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:52.949428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:52.962652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:52.978286 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7a2b2-c7a2-411a-aa85-395ead0bda38 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:53.046282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9348bd-6303-414b-955b-9e553ccbf865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:53.048098 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9348bd-6303-414b-955b-9e553ccbf865 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.048767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9348bd-6303-414b-955b-9e553ccbf865 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.050666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9348bd-6303-414b-955b-9e553ccbf865 None admin] PATH_INFO: `/v3/users/8e3fb153d609496c8580d9f3148dd829` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.054106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9348bd-6303-414b-955b-9e553ccbf865 None admin] RBAC: Authorizing `identity:get_user(user_id=8e3fb153d609496c8580d9f3148dd829)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:53.056724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9348bd-6303-414b-955b-9e553ccbf865 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:53.059839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 182/363] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:52 2022] GET /identity/v3/users/8e3fb153d609496c8580d9f3148dd829 => generated 293 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:53.064409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf52549-0e1a-4d21-8fc8-9d6b4b57623b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:53.064616 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9348bd-6303-414b-955b-9e553ccbf865 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:53.115100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b91001-5b4d-448f-8fd1-259ff5579708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:53.115762 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b91001-5b4d-448f-8fd1-259ff5579708 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.116047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b91001-5b4d-448f-8fd1-259ff5579708 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.116319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b91001-5b4d-448f-8fd1-259ff5579708 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.117570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b91001-5b4d-448f-8fd1-259ff5579708 None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:53.119095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b91001-5b4d-448f-8fd1-259ff5579708 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:53.121454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 182/364] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:52 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:53.124913 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47d57b-619d-418c-8b52-a61ad508bc00 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.125653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47d57b-619d-418c-8b52-a61ad508bc00 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.126493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47d57b-619d-418c-8b52-a61ad508bc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.151536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-ad47d57b-619d-418c-8b52-a61ad508bc00 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:53.153186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ad47d57b-619d-418c-8b52-a61ad508bc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:53.211436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9348bd-6303-414b-955b-9e553ccbf865 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:53.262459 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 183/365] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:53.262825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47d57b-619d-418c-8b52-a61ad508bc00 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:53.285123 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b76f3d-06a3-45b2-a68e-28b3534a75c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:53.285760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b76f3d-06a3-45b2-a68e-28b3534a75c3 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.286039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b76f3d-06a3-45b2-a68e-28b3534a75c3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.286313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b76f3d-06a3-45b2-a68e-28b3534a75c3 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.286999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b76f3d-06a3-45b2-a68e-28b3534a75c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:53.287303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b76f3d-06a3-45b2-a68e-28b3534a75c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:53.288784 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b76f3d-06a3-45b2-a68e-28b3534a75c3 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:53.292541 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:53.299969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 183/366] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:53.301340 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b76f3d-06a3-45b2-a68e-28b3534a75c3 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:53.344756 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:53.440541 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b76f3d-06a3-45b2-a68e-28b3534a75c3 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:53.441074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47d57b-619d-418c-8b52-a61ad508bc00 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:53.493530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd3fff-ffd8-4ca1-870e-a05c032b40c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:53.494944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd3fff-ffd8-4ca1-870e-a05c032b40c1 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.496749 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd3fff-ffd8-4ca1-870e-a05c032b40c1 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.497648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd3fff-ffd8-4ca1-870e-a05c032b40c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.498470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd3fff-ffd8-4ca1-870e-a05c032b40c1 None admin] RBAC: Adding query filter params (group.id=01f0327c73994f0ba1adf7e907e46571, role.id=0560a82175224c8e86d1b430212748d4, scope.project.id=d2ad57e577854d67ae2401564821ce05) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:53.498789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd3fff-ffd8-4ca1-870e-a05c032b40c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:53.500460 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd3fff-ffd8-4ca1-870e-a05c032b40c1 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:53.508582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 184/367] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Sep 7 12:53:53 2022] GET /identity/v3/role_assignments?group.id=01f0327c73994f0ba1adf7e907e46571&scope.project.id=d2ad57e577854d67ae2401564821ce05&role.id=0560a82175224c8e86d1b430212748d4 => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:53.509239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a1ec5-db05-4fd2-91d7-00b204d39424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:53.509527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd3fff-ffd8-4ca1-870e-a05c032b40c1 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:53.509888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1ec5-db05-4fd2-91d7-00b204d39424 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.510162 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1ec5-db05-4fd2-91d7-00b204d39424 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.510435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1ec5-db05-4fd2-91d7-00b204d39424 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.511193 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a1ec5-db05-4fd2-91d7-00b204d39424 None admin] RBAC: Adding query filter params (role.id=ad483fe996284752ae36cd0fcfcbf503, user.id=8e3fb153d609496c8580d9f3148dd829, scope.system=all) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:53.511507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a1ec5-db05-4fd2-91d7-00b204d39424 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:53.513045 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a1ec5-db05-4fd2-91d7-00b204d39424 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:53.563048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 184/368] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Sep 7 12:53:53 2022] GET /identity/v3/role_assignments?user.id=8e3fb153d609496c8580d9f3148dd829&scope.system=all&role.id=ad483fe996284752ae36cd0fcfcbf503 => generated 510 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:53.564466 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a1ec5-db05-4fd2-91d7-00b204d39424 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:53.638667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:53.663637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd3fff-ffd8-4ca1-870e-a05c032b40c1 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:53.710845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b70780-c478-49bb-aa38-9a2c9a9449a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:53.711511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b70780-c478-49bb-aa38-9a2c9a9449a7 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.711792 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b70780-c478-49bb-aa38-9a2c9a9449a7 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.712070 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b70780-c478-49bb-aa38-9a2c9a9449a7 None admin] PATH_INFO: `/v3/groups/01f0327c73994f0ba1adf7e907e46571` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.713363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b70780-c478-49bb-aa38-9a2c9a9449a7 None admin] RBAC: Authorizing `identity:get_group(group_id=01f0327c73994f0ba1adf7e907e46571)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:53.714940 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b70780-c478-49bb-aa38-9a2c9a9449a7 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:53.717020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 185/369] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Sep 7 12:53:53 2022] GET /identity/v3/groups/01f0327c73994f0ba1adf7e907e46571 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:53.717871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b70780-c478-49bb-aa38-9a2c9a9449a7 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:53.754690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a1ec5-db05-4fd2-91d7-00b204d39424 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:53.756800 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:53.806672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb0aa0-4d0f-4d62-afbc-39d519a07f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:53.807413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb0aa0-4d0f-4d62-afbc-39d519a07f35 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.807743 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb0aa0-4d0f-4d62-afbc-39d519a07f35 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.808046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb0aa0-4d0f-4d62-afbc-39d519a07f35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.872001 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b70780-c478-49bb-aa38-9a2c9a9449a7 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:53.902901 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb0aa0-4d0f-4d62-afbc-39d519a07f35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:53.904547 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb0aa0-4d0f-4d62-afbc-39d519a07f35 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:53.919802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca217d8-2732-4ca5-87e2-5e4c3f92066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:53.920507 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca217d8-2732-4ca5-87e2-5e4c3f92066d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.920784 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca217d8-2732-4ca5-87e2-5e4c3f92066d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.921057 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca217d8-2732-4ca5-87e2-5e4c3f92066d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.935690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca217d8-2732-4ca5-87e2-5e4c3f92066d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-fca217d8-2732-4ca5-87e2-5e4c3f92066d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:53.942526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:53.943909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:53.945639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:53.945639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:53.945639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:53.945639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:53.945639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:53.945639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:53.945639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:53.945639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:53.945639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:53.945639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:53.945639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:53.945639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:53.945639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 186/370] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:53.945639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca217d8-2732-4ca5-87e2-5e4c3f92066d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:53.965387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:54.046068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:54.074963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 185/371] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:54.076800 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d26f30-1a2b-413e-809d-b93e872d1f51 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.076800 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d26f30-1a2b-413e-809d-b93e872d1f51 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.077001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d26f30-1a2b-413e-809d-b93e872d1f51 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.078524 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 186/372] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:54.078999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d26f30-1a2b-413e-809d-b93e872d1f51 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:54.085672 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca217d8-2732-4ca5-87e2-5e4c3f92066d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:54.138336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f07b51-901d-41ce-b22c-7242bb367bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:54.139050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f07b51-901d-41ce-b22c-7242bb367bf7 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.139805 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f07b51-901d-41ce-b22c-7242bb367bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.140082 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f07b51-901d-41ce-b22c-7242bb367bf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.141281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f07b51-901d-41ce-b22c-7242bb367bf7 None admin] RBAC: Adding query filter params (group.id=01f0327c73994f0ba1adf7e907e46571, role.id=30891346cde644e7bd9ae90a3876efc8, scope.project.id=f2c27767fad842abb753f50c28758062) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:54.141779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f07b51-901d-41ce-b22c-7242bb367bf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:54.144430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f07b51-901d-41ce-b22c-7242bb367bf7 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:54.153329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 187/373] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Sep 7 12:53:53 2022] GET /identity/v3/role_assignments?group.id=01f0327c73994f0ba1adf7e907e46571&scope.project.id=f2c27767fad842abb753f50c28758062&role.id=30891346cde644e7bd9ae90a3876efc8 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:54.154878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd253f3-d012-4f53-b31d-9c593b57f64d None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.155366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd253f3-d012-4f53-b31d-9c593b57f64d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.155645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd253f3-d012-4f53-b31d-9c593b57f64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.182852 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-acd253f3-d012-4f53-b31d-9c593b57f64d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:54.184455 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-acd253f3-d012-4f53-b31d-9c593b57f64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:54.241948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d26f30-1a2b-413e-809d-b93e872d1f51 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:54.297278 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95495503-3841-434d-a955-a3f0ffc61d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:54.298455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95495503-3841-434d-a955-a3f0ffc61d22 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.299174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95495503-3841-434d-a955-a3f0ffc61d22 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.300496 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95495503-3841-434d-a955-a3f0ffc61d22 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.301509 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95495503-3841-434d-a955-a3f0ffc61d22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:54.302022 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95495503-3841-434d-a955-a3f0ffc61d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:54.302161 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 188/374] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:54.303933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd253f3-d012-4f53-b31d-9c593b57f64d None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:54.304285 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95495503-3841-434d-a955-a3f0ffc61d22 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:54.311206 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:54.319668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 187/375] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:54.326062 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95495503-3841-434d-a955-a3f0ffc61d22 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:54.383735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:54.434105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd253f3-d012-4f53-b31d-9c593b57f64d None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:54.465047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95495503-3841-434d-a955-a3f0ffc61d22 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:54.489944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cc567-94bf-4c39-949f-38a0a331cded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:54.491336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cc567-94bf-4c39-949f-38a0a331cded None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.492037 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cc567-94bf-4c39-949f-38a0a331cded None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.492743 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cc567-94bf-4c39-949f-38a0a331cded None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.494985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cc567-94bf-4c39-949f-38a0a331cded None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:54.497702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cc567-94bf-4c39-949f-38a0a331cded None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:54.500676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 189/376] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:54 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:54.506770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cc567-94bf-4c39-949f-38a0a331cded None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:54.510827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668aa30-032a-4e6e-8dfc-21a01a993427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:54.511457 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668aa30-032a-4e6e-8dfc-21a01a993427 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.511732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668aa30-032a-4e6e-8dfc-21a01a993427 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.511994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668aa30-032a-4e6e-8dfc-21a01a993427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.678351 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668aa30-032a-4e6e-8dfc-21a01a993427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:54.679845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668aa30-032a-4e6e-8dfc-21a01a993427 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:54.693040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:54.748672 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cc567-94bf-4c39-949f-38a0a331cded None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:54.769571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:54.813981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c2eec-7cc9-4879-8eb5-d7838077e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:54.814747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c2eec-7cc9-4879-8eb5-d7838077e525 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.818357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c2eec-7cc9-4879-8eb5-d7838077e525 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.818911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c2eec-7cc9-4879-8eb5-d7838077e525 None admin] PATH_INFO: `/v3/groups/01f0327c73994f0ba1adf7e907e46571` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.821227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c2eec-7cc9-4879-8eb5-d7838077e525 None admin] RBAC: Authorizing `identity:get_group(group_id=01f0327c73994f0ba1adf7e907e46571)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:54.823711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c2eec-7cc9-4879-8eb5-d7838077e525 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:54.826593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 190/377] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Sep 7 12:53:54 2022] GET /identity/v3/groups/01f0327c73994f0ba1adf7e907e46571 => generated 226 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:54.827816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c2eec-7cc9-4879-8eb5-d7838077e525 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:54.863297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 188/378] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:54.864431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668aa30-032a-4e6e-8dfc-21a01a993427 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:54.991798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c2eec-7cc9-4879-8eb5-d7838077e525 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:55.031378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668aa30-032a-4e6e-8dfc-21a01a993427 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:55.050051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71c32-bbce-4b5c-ad2c-f589793ba3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:55.051312 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71c32-bbce-4b5c-ad2c-f589793ba3f4 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:55.051803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71c32-bbce-4b5c-ad2c-f589793ba3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:55.052275 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71c32-bbce-4b5c-ad2c-f589793ba3f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:55.066712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:55.072757 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c71c32-bbce-4b5c-ad2c-f589793ba3f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-86c71c32-bbce-4b5c-ad2c-f589793ba3f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:55.081676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:55.082690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:55.083498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:55.083498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:55.083498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:55.083498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:55.083498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:55.083498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:55.083498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:55.083498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:55.083498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:55.083498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:55.083498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:55.083498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:55.084106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e787744-0aa0-42a3-830c-378df0f773dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:55.084106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e787744-0aa0-42a3-830c-378df0f773dd None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:55.084106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e787744-0aa0-42a3-830c-378df0f773dd None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:55.084106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e787744-0aa0-42a3-830c-378df0f773dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:55.085501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e787744-0aa0-42a3-830c-378df0f773dd None admin] RBAC: Adding query filter params (group.id=01f0327c73994f0ba1adf7e907e46571, role.id=0560a82175224c8e86d1b430212748d4, scope.project.id=f2c27767fad842abb753f50c28758062) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:55.085826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e787744-0aa0-42a3-830c-378df0f773dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:55.087300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 191/379] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:55.087422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e787744-0aa0-42a3-830c-378df0f773dd None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:55.088491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71c32-bbce-4b5c-ad2c-f589793ba3f4 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:55.094529 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 189/380] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Sep 7 12:53:54 2022] GET /identity/v3/role_assignments?group.id=01f0327c73994f0ba1adf7e907e46571&scope.project.id=f2c27767fad842abb753f50c28758062&role.id=0560a82175224c8e86d1b430212748d4 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:55.098376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e787744-0aa0-42a3-830c-378df0f773dd None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:55.111245 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:55.288991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71c32-bbce-4b5c-ad2c-f589793ba3f4 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:55.339090 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e787744-0aa0-42a3-830c-378df0f773dd None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:55.382712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ba83c-63c5-4d57-9824-9ca067b481a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:55.383949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ba83c-63c5-4d57-9824-9ca067b481a0 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:55.384476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ba83c-63c5-4d57-9824-9ca067b481a0 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:55.384984 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ba83c-63c5-4d57-9824-9ca067b481a0 None admin] PATH_INFO: `/v3/projects/e3af01406fe7484583db161921c3b6ee` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:55.387052 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ba83c-63c5-4d57-9824-9ca067b481a0 None admin] RBAC: Authorizing `identity:get_project(project_id=e3af01406fe7484583db161921c3b6ee)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:55.388979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ba83c-63c5-4d57-9824-9ca067b481a0 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:55.391346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 192/381] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:55 2022] GET /identity/v3/projects/e3af01406fe7484583db161921c3b6ee => generated 344 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:55.401668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ba83c-63c5-4d57-9824-9ca067b481a0 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:55.406986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac36b68-4227-455b-9d16-3d589785f603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:55.407639 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac36b68-4227-455b-9d16-3d589785f603 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:55.407924 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac36b68-4227-455b-9d16-3d589785f603 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:55.408196 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac36b68-4227-455b-9d16-3d589785f603 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:55.408973 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac36b68-4227-455b-9d16-3d589785f603 None admin] RBAC: Adding query filter params (name=member) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:55.409281 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac36b68-4227-455b-9d16-3d589785f603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:55.410814 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac36b68-4227-455b-9d16-3d589785f603 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:55.436332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 190/382] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:55.442988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac36b68-4227-455b-9d16-3d589785f603 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:55.540741 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:55.560808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:55.629901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ba83c-63c5-4d57-9824-9ca067b481a0 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:55.641870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac36b68-4227-455b-9d16-3d589785f603 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:55.704188 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163303fa-2bfa-4eb4-8255-9e4072558318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:55.705012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163303fa-2bfa-4eb4-8255-9e4072558318 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:55.705327 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163303fa-2bfa-4eb4-8255-9e4072558318 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:55.705746 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163303fa-2bfa-4eb4-8255-9e4072558318 None admin] PATH_INFO: `/v3/groups/96d61c67c4f9408e82c30f3c285c5074` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:55.708436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a85e5-962f-4278-acc8-9b6e5fa54f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:55.709153 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a85e5-962f-4278-acc8-9b6e5fa54f57 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:55.709499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a85e5-962f-4278-acc8-9b6e5fa54f57 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:55.709770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a85e5-962f-4278-acc8-9b6e5fa54f57 None admin] PATH_INFO: `/v3/groups/01f0327c73994f0ba1adf7e907e46571` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:55.711000 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a85e5-962f-4278-acc8-9b6e5fa54f57 None admin] RBAC: Authorizing `identity:get_group(group_id=01f0327c73994f0ba1adf7e907e46571)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:55.712519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a85e5-962f-4278-acc8-9b6e5fa54f57 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:55.714511 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 191/383] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Sep 7 12:53:55 2022] GET /identity/v3/groups/01f0327c73994f0ba1adf7e907e46571 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:55.717734 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163303fa-2bfa-4eb4-8255-9e4072558318 None admin] RBAC: Authorizing `identity:get_group(group_id=96d61c67c4f9408e82c30f3c285c5074)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:55.720621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a85e5-962f-4278-acc8-9b6e5fa54f57 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:55.721471 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163303fa-2bfa-4eb4-8255-9e4072558318 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:55.727094 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 193/384] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Sep 7 12:53:55 2022] GET /identity/v3/groups/96d61c67c4f9408e82c30f3c285c5074 => generated 229 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:55.731019 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163303fa-2bfa-4eb4-8255-9e4072558318 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:56.007000 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a85e5-962f-4278-acc8-9b6e5fa54f57 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:56.019134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163303fa-2bfa-4eb4-8255-9e4072558318 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:56.092912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb95f3-0a4a-4ddf-9b1c-03af4eeb8686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:56.094377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb95f3-0a4a-4ddf-9b1c-03af4eeb8686 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:56.095009 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb95f3-0a4a-4ddf-9b1c-03af4eeb8686 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:56.095432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb95f3-0a4a-4ddf-9b1c-03af4eeb8686 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:56.100965 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:56.102217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb95f3-0a4a-4ddf-9b1c-03af4eeb8686 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:56.104062 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb95f3-0a4a-4ddf-9b1c-03af4eeb8686 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:56.108269 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 192/385] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:55 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:56.116463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dd977-e113-4804-9e05-ff09ae422e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:56.117410 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dd977-e113-4804-9e05-ff09ae422e88 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:56.117899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dd977-e113-4804-9e05-ff09ae422e88 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:56.118347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dd977-e113-4804-9e05-ff09ae422e88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:56.119336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dd977-e113-4804-9e05-ff09ae422e88 None admin] RBAC: Adding query filter params (group.id=96d61c67c4f9408e82c30f3c285c5074, role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=e3af01406fe7484583db161921c3b6ee) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:56.119849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dd977-e113-4804-9e05-ff09ae422e88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:56.122126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dd977-e113-4804-9e05-ff09ae422e88 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:56.126373 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb95f3-0a4a-4ddf-9b1c-03af4eeb8686 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:56.130681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:56.135849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 194/386] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Sep 7 12:53:55 2022] GET /identity/v3/role_assignments?group.id=96d61c67c4f9408e82c30f3c285c5074&scope.project.id=e3af01406fe7484583db161921c3b6ee&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 260 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:56.266576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630604ae-79d0-41d4-8c50-371e51f35d40 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:56.267559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630604ae-79d0-41d4-8c50-371e51f35d40 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:56.268145 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630604ae-79d0-41d4-8c50-371e51f35d40 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:56.274378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 195/387] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:56.280027 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b884b95-07a4-4b7b-a8bd-53054a3e0ba9 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:56.280684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b884b95-07a4-4b7b-a8bd-53054a3e0ba9 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:56.281175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b884b95-07a4-4b7b-a8bd-53054a3e0ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:56.302661 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb95f3-0a4a-4ddf-9b1c-03af4eeb8686 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:56.326457 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-0b884b95-07a4-4b7b-a8bd-53054a3e0ba9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:56.329216 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0b884b95-07a4-4b7b-a8bd-53054a3e0ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:56.351853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d33f83-bcea-4799-b6af-3ced3322f3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:56.352575 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d33f83-bcea-4799-b6af-3ced3322f3c6 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:56.352858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d33f83-bcea-4799-b6af-3ced3322f3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:56.353130 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d33f83-bcea-4799-b6af-3ced3322f3c6 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05/groups/01f0327c73994f0ba1adf7e907e46571/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:56.357800 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d33f83-bcea-4799-b6af-3ced3322f3c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2ad57e577854d67ae2401564821ce05, group_id=01f0327c73994f0ba1adf7e907e46571, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:56.359407 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d33f83-bcea-4799-b6af-3ced3322f3c6 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:56.384420 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 193/388] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Sep 7 12:53:56 2022] PUT /identity/v3/projects/d2ad57e577854d67ae2401564821ce05/groups/01f0327c73994f0ba1adf7e907e46571/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:53:56.442817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 196/389] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:56.789713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d33f83-bcea-4799-b6af-3ced3322f3c6 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:56.894280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:56.955054 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d33f83-bcea-4799-b6af-3ced3322f3c6 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:57.009367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730bbae-6784-4118-a64b-a478e432ce28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:57.010031 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730bbae-6784-4118-a64b-a478e432ce28 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:57.010307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730bbae-6784-4118-a64b-a478e432ce28 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:57.010577 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730bbae-6784-4118-a64b-a478e432ce28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:57.027196 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730bbae-6784-4118-a64b-a478e432ce28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-6730bbae-6784-4118-a64b-a478e432ce28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:57.032837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:57.033842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:57.034653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:57.034653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:57.034653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:57.034653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:57.034653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:57.034653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:57.034653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:57.034653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:57.034653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:57.034653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:57.034653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:57.034653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:53:57.043722 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 194/390] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:57.043899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b884b95-07a4-4b7b-a8bd-53054a3e0ba9 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:57.138615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc48d27-3a39-4207-a067-f0630f50b577 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:57.139583 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc48d27-3a39-4207-a067-f0630f50b577 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:57.140077 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc48d27-3a39-4207-a067-f0630f50b577 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:57.142492 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 195/391] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:57.148903 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e949657-09b9-4054-8957-27f8f006fa38 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:57.149530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e949657-09b9-4054-8957-27f8f006fa38 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:57.150016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e949657-09b9-4054-8957-27f8f006fa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:57.190883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-4e949657-09b9-4054-8957-27f8f006fa38 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:57.192239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4e949657-09b9-4054-8957-27f8f006fa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:57.227332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b884b95-07a4-4b7b-a8bd-53054a3e0ba9 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:57.275762 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:57.294638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f2040-f0a0-4163-925a-46c9d724b0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:57.295173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f2040-f0a0-4163-925a-46c9d724b0dc None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:57.295450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f2040-f0a0-4163-925a-46c9d724b0dc None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:57.295719 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f2040-f0a0-4163-925a-46c9d724b0dc None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:57.296414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f2040-f0a0-4163-925a-46c9d724b0dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:57.296719 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f2040-f0a0-4163-925a-46c9d724b0dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:57.298134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f2040-f0a0-4163-925a-46c9d724b0dc None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:57.316631 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 197/392] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:57.322153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f2040-f0a0-4163-925a-46c9d724b0dc None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:57.341361 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 196/393] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:57.540643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f2040-f0a0-4163-925a-46c9d724b0dc None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:57.595624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef5b3d-9ce4-492e-b714-3f83d3fbee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:57.596243 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef5b3d-9ce4-492e-b714-3f83d3fbee23 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:57.596556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef5b3d-9ce4-492e-b714-3f83d3fbee23 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:57.596828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef5b3d-9ce4-492e-b714-3f83d3fbee23 None admin] PATH_INFO: `/v3/groups/01f0327c73994f0ba1adf7e907e46571` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:57.598070 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef5b3d-9ce4-492e-b714-3f83d3fbee23 None admin] RBAC: Authorizing `identity:get_group(group_id=01f0327c73994f0ba1adf7e907e46571)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:57.599602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef5b3d-9ce4-492e-b714-3f83d3fbee23 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:57.601351 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 198/394] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Sep 7 12:53:57 2022] GET /identity/v3/groups/01f0327c73994f0ba1adf7e907e46571 => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:57.607485 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e949657-09b9-4054-8957-27f8f006fa38 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:57.666320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef5b3d-9ce4-492e-b714-3f83d3fbee23 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:57.688893 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:57.777971 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:57.819298 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e949657-09b9-4054-8957-27f8f006fa38 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:57.837235 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef5b3d-9ce4-492e-b714-3f83d3fbee23 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:57.870632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef546c-76cc-400c-bcbb-7d09b8417e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:57.871575 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef546c-76cc-400c-bcbb-7d09b8417e77 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:57.872008 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef546c-76cc-400c-bcbb-7d09b8417e77 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:57.872740 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef546c-76cc-400c-bcbb-7d09b8417e77 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:57.874135 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef546c-76cc-400c-bcbb-7d09b8417e77 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:57.875770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef546c-76cc-400c-bcbb-7d09b8417e77 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:57.878139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 197/395] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:57 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:57.884308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f1e1e-9211-4896-a11f-0014a8db759a None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:57.885017 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f1e1e-9211-4896-a11f-0014a8db759a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:57.885122 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235182a-bf57-452d-937d-4e0fc8c3df48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:57.885575 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f1e1e-9211-4896-a11f-0014a8db759a None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:57.885674 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235182a-bf57-452d-937d-4e0fc8c3df48 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:57.886120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235182a-bf57-452d-937d-4e0fc8c3df48 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:57.886397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235182a-bf57-452d-937d-4e0fc8c3df48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:57.889017 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 198/396] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:57.890011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f1e1e-9211-4896-a11f-0014a8db759a None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:57.899667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235182a-bf57-452d-937d-4e0fc8c3df48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-4235182a-bf57-452d-937d-4e0fc8c3df48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:57.907581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:57.908855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:57.909914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:57.909914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:57.909914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:57.909914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:57.909914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:57.909914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:57.909914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:57.909914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:57.909914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:57.909914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:57.909914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:53:57.909914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:57.909914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 199/397] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:57.910642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f9fa4-6c25-46ed-afd6-ac22246f08da None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:57.910642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f9fa4-6c25-46ed-afd6-ac22246f08da None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:57.910900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f9fa4-6c25-46ed-afd6-ac22246f08da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:57.937279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-1a4f9fa4-6c25-46ed-afd6-ac22246f08da None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:57.938766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1a4f9fa4-6c25-46ed-afd6-ac22246f08da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:58.013612 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 200/398] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:58.014305 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f1e1e-9211-4896-a11f-0014a8db759a None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:58.015219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f9fa4-6c25-46ed-afd6-ac22246f08da None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:58.040141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:58.097912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4262ce-cd32-45e0-a14d-35ef560fea68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:58.099042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4262ce-cd32-45e0-a14d-35ef560fea68 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:58.099534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4262ce-cd32-45e0-a14d-35ef560fea68 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:58.100002 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4262ce-cd32-45e0-a14d-35ef560fea68 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05/groups/01f0327c73994f0ba1adf7e907e46571/roles/0560a82175224c8e86d1b430212748d4` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:58.113448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4262ce-cd32-45e0-a14d-35ef560fea68 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2ad57e577854d67ae2401564821ce05, group_id=01f0327c73994f0ba1adf7e907e46571, role_id=0560a82175224c8e86d1b430212748d4)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:58.114528 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:58.115396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4262ce-cd32-45e0-a14d-35ef560fea68 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:58.146727 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 199/399] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Sep 7 12:53:57 2022] PUT /identity/v3/projects/d2ad57e577854d67ae2401564821ce05/groups/01f0327c73994f0ba1adf7e907e46571/roles/0560a82175224c8e86d1b430212748d4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:58.149133 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f9fa4-6c25-46ed-afd6-ac22246f08da None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:58.196546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bdda4-bb22-49c9-aaf5-033575f7f37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:58.197477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bdda4-bb22-49c9-aaf5-033575f7f37a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:58.197892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bdda4-bb22-49c9-aaf5-033575f7f37a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:58.198298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bdda4-bb22-49c9-aaf5-033575f7f37a None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:58.199118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bdda4-bb22-49c9-aaf5-033575f7f37a None admin] RBAC: Adding query filter params (name=member) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:58.199581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bdda4-bb22-49c9-aaf5-033575f7f37a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:58.201243 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bdda4-bb22-49c9-aaf5-033575f7f37a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:58.210994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 201/400] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:58.217462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4262ce-cd32-45e0-a14d-35ef560fea68 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:58.353609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bdda4-bb22-49c9-aaf5-033575f7f37a None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:58.367470 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4262ce-cd32-45e0-a14d-35ef560fea68 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:58.425584 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c334d-d2a6-4bbf-bcd8-9668e8818790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:58.426252 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c334d-d2a6-4bbf-bcd8-9668e8818790 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:58.426533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c334d-d2a6-4bbf-bcd8-9668e8818790 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:58.426806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c334d-d2a6-4bbf-bcd8-9668e8818790 None admin] PATH_INFO: `/v3/groups/01f0327c73994f0ba1adf7e907e46571` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:58.432793 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c334d-d2a6-4bbf-bcd8-9668e8818790 None admin] RBAC: Authorizing `identity:get_group(group_id=01f0327c73994f0ba1adf7e907e46571)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:58.434381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c334d-d2a6-4bbf-bcd8-9668e8818790 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:58.436527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 200/401] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Sep 7 12:53:58 2022] GET /identity/v3/groups/01f0327c73994f0ba1adf7e907e46571 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:58.449239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c334d-d2a6-4bbf-bcd8-9668e8818790 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:58.521716 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:58.551717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bdda4-bb22-49c9-aaf5-033575f7f37a None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:58.565783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:58.594186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c334d-d2a6-4bbf-bcd8-9668e8818790 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:58.630767 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd0866-376f-4ec7-9149-9db247a53308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:58.631341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd0866-376f-4ec7-9149-9db247a53308 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:58.631623 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd0866-376f-4ec7-9149-9db247a53308 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:58.631900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd0866-376f-4ec7-9149-9db247a53308 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:58.655296 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85b1ca-d5e2-45a9-b66a-ce0ef8311927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:58.655957 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b1ca-d5e2-45a9-b66a-ce0ef8311927 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:58.656232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b1ca-d5e2-45a9-b66a-ce0ef8311927 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:58.656539 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b1ca-d5e2-45a9-b66a-ce0ef8311927 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:58.663767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85b1ca-d5e2-45a9-b66a-ce0ef8311927 None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:58.667221 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85b1ca-d5e2-45a9-b66a-ce0ef8311927 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:58.669753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd0866-376f-4ec7-9149-9db247a53308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:58.672627 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 201/402] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:58 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:58.676548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85b1ca-d5e2-45a9-b66a-ce0ef8311927 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-f7dd0866-376f-4ec7-9149-9db247a53308 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:58.679480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:58.680355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:58.681192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:58.681192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:58.681192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:58.681192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:58.681192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:58.681192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:58.681192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:58.681192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:58.681192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:58.681192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:58.681192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:53:58.681192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:53:58.686745 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 202/403] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:58.693466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd0866-376f-4ec7-9149-9db247a53308 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:58.837032 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85b1ca-d5e2-45a9-b66a-ce0ef8311927 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:58.859802 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:58.885635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5510789-c8bf-434e-aa5a-a33ba1a5fd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:58.886679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5510789-c8bf-434e-aa5a-a33ba1a5fd26 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:58.887163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5510789-c8bf-434e-aa5a-a33ba1a5fd26 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:58.887733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5510789-c8bf-434e-aa5a-a33ba1a5fd26 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062/groups/01f0327c73994f0ba1adf7e907e46571/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:58.891247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5510789-c8bf-434e-aa5a-a33ba1a5fd26 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2c27767fad842abb753f50c28758062, group_id=01f0327c73994f0ba1adf7e907e46571, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:58.895784 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5510789-c8bf-434e-aa5a-a33ba1a5fd26 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:58.918745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 202/404] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Sep 7 12:53:58 2022] PUT /identity/v3/projects/f2c27767fad842abb753f50c28758062/groups/01f0327c73994f0ba1adf7e907e46571/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:58.950535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd0866-376f-4ec7-9149-9db247a53308 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:59.070447 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e501427-293e-4229-a108-596e3ab1a50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:59.071102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e501427-293e-4229-a108-596e3ab1a50c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:59.071386 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e501427-293e-4229-a108-596e3ab1a50c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:59.071662 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e501427-293e-4229-a108-596e3ab1a50c None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:59.072427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e501427-293e-4229-a108-596e3ab1a50c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:59.072746 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e501427-293e-4229-a108-596e3ab1a50c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:59.074236 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e501427-293e-4229-a108-596e3ab1a50c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:59.092411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 203/405] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:59.098512 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5510789-c8bf-434e-aa5a-a33ba1a5fd26 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:59.228413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24d4ea-2ddc-45c7-bfbb-0478d558a3ab None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:59.228413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24d4ea-2ddc-45c7-bfbb-0478d558a3ab None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:59.228413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24d4ea-2ddc-45c7-bfbb-0478d558a3ab None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:59.230839 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 204/406] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:59.237542 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aa980-f65e-4148-aa4f-5480147b5246 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:59.238371 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aa980-f65e-4148-aa4f-5480147b5246 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:59.238851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aa980-f65e-4148-aa4f-5480147b5246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:59.273603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-733aa980-f65e-4148-aa4f-5480147b5246 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:59.275869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-733aa980-f65e-4148-aa4f-5480147b5246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:59.276201 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5510789-c8bf-434e-aa5a-a33ba1a5fd26 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:59.314401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c7723-18c9-4c14-b14f-daf485a80912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:59.315207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c7723-18c9-4c14-b14f-daf485a80912 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:59.315485 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c7723-18c9-4c14-b14f-daf485a80912 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:59.315758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c7723-18c9-4c14-b14f-daf485a80912 None admin] PATH_INFO: `/v3/groups/01f0327c73994f0ba1adf7e907e46571` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:59.317369 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c7723-18c9-4c14-b14f-daf485a80912 None admin] RBAC: Authorizing `identity:get_group(group_id=01f0327c73994f0ba1adf7e907e46571)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:59.318870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c7723-18c9-4c14-b14f-daf485a80912 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:59.320864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 203/407] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Sep 7 12:53:59 2022] GET /identity/v3/groups/01f0327c73994f0ba1adf7e907e46571 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:59.322403 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570e03c-e86e-42bd-9840-e9c78b85d33c None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:59.322676 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570e03c-e86e-42bd-9840-e9c78b85d33c None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:59.323014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570e03c-e86e-42bd-9840-e9c78b85d33c None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:59.323963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:59.324461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 204/408] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:59.328332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570e03c-e86e-42bd-9840-e9c78b85d33c None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:59.396044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 205/409] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:59.397994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f1991-6043-431d-8da1-709ac63261ca None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:59.398541 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f1991-6043-431d-8da1-709ac63261ca None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:59.399035 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f1991-6043-431d-8da1-709ac63261ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:59.428075 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-100f1991-6043-431d-8da1-709ac63261ca None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:59.430368 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-100f1991-6043-431d-8da1-709ac63261ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:59.461163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:59.530031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 206/410] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:59.606456 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570e03c-e86e-42bd-9840-e9c78b85d33c None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:59.650108 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b823fd4-281e-4f1f-a9a1-acd76fe115a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:59.651289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b823fd4-281e-4f1f-a9a1-acd76fe115a6 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:59.651768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b823fd4-281e-4f1f-a9a1-acd76fe115a6 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:59.652303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b823fd4-281e-4f1f-a9a1-acd76fe115a6 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:59.653840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b823fd4-281e-4f1f-a9a1-acd76fe115a6 None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:59.655518 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b823fd4-281e-4f1f-a9a1-acd76fe115a6 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:59.657769 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 205/411] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:59 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:59.665548 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f1991-6043-431d-8da1-709ac63261ca None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:59.791667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:59.798609 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b823fd4-281e-4f1f-a9a1-acd76fe115a6 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:59.823983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f1991-6043-431d-8da1-709ac63261ca None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:59.888965 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92e790-3ec8-4c97-aadc-d1af625ae212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:59.890585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92e790-3ec8-4c97-aadc-d1af625ae212 None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:59.891240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92e790-3ec8-4c97-aadc-d1af625ae212 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:59.891885 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92e790-3ec8-4c97-aadc-d1af625ae212 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062/groups/01f0327c73994f0ba1adf7e907e46571/roles/0560a82175224c8e86d1b430212748d4` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:59.896209 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92e790-3ec8-4c97-aadc-d1af625ae212 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2c27767fad842abb753f50c28758062, group_id=01f0327c73994f0ba1adf7e907e46571, role_id=0560a82175224c8e86d1b430212748d4)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:59.899514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92e790-3ec8-4c97-aadc-d1af625ae212 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:59.930360 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 207/412] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Sep 7 12:53:59 2022] PUT /identity/v3/projects/f2c27767fad842abb753f50c28758062/groups/01f0327c73994f0ba1adf7e907e46571/roles/0560a82175224c8e86d1b430212748d4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:54:00.012036 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b823fd4-281e-4f1f-a9a1-acd76fe115a6 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:00.044890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:00.071219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cdb3f-eb27-47e2-b643-087b4bf0747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:00.071896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cdb3f-eb27-47e2-b643-087b4bf0747e None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:00.072177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cdb3f-eb27-47e2-b643-087b4bf0747e None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:00.072519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cdb3f-eb27-47e2-b643-087b4bf0747e None admin] PATH_INFO: `/v3/roles/member` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:00.089124 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cdb3f-eb27-47e2-b643-087b4bf0747e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-f87cdb3f-eb27-47e2-b643-087b4bf0747e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:00.095059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:00.096126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:00.096987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:00.096987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:00.096987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:00.096987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:00.096987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:00.096987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:00.096987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:00.096987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:00.096987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:00.096987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:00.096987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:54:00.096987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:00.097812 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 206/413] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:54:00.105579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92e790-3ec8-4c97-aadc-d1af625ae212 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:00.105777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cdb3f-eb27-47e2-b643-087b4bf0747e None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:00.257721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92e790-3ec8-4c97-aadc-d1af625ae212 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:00.266397 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cdb3f-eb27-47e2-b643-087b4bf0747e None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:00.303261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54473141-0eef-4543-a98d-3ea7310b5680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:00.304071 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54473141-0eef-4543-a98d-3ea7310b5680 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:00.304472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54473141-0eef-4543-a98d-3ea7310b5680 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:00.304878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54473141-0eef-4543-a98d-3ea7310b5680 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:00.325033 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54473141-0eef-4543-a98d-3ea7310b5680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-54473141-0eef-4543-a98d-3ea7310b5680 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:00.330248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:00.331556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:00.332430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:00.332430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:00.332430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:00.332430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:00.332430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:00.332430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:00.332430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:00.332430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:00.332430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:00.332430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:00.332430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:00.332430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:00.336921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 208/414] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:00.342159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54473141-0eef-4543-a98d-3ea7310b5680 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:00.363240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3b783-81ba-4224-a025-07cd11e487ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:00.363937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3b783-81ba-4224-a025-07cd11e487ff None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:00.364216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3b783-81ba-4224-a025-07cd11e487ff None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:00.364515 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3b783-81ba-4224-a025-07cd11e487ff None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:00.365244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3b783-81ba-4224-a025-07cd11e487ff None admin] RBAC: Adding query filter params (name=member) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:00.365545 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3b783-81ba-4224-a025-07cd11e487ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:00.367023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3b783-81ba-4224-a025-07cd11e487ff None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:00.372130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:00.394764 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 207/415] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:54:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:00.411469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3b783-81ba-4224-a025-07cd11e487ff None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:00.503244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:00.608600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54473141-0eef-4543-a98d-3ea7310b5680 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:00.630882 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3b783-81ba-4224-a025-07cd11e487ff None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:00.697169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957af1f-f1be-4c01-8b1f-b1f3f1895976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:00.697814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957af1f-f1be-4c01-8b1f-b1f3f1895976 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:00.698131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957af1f-f1be-4c01-8b1f-b1f3f1895976 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:00.698404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957af1f-f1be-4c01-8b1f-b1f3f1895976 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:00.699146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957af1f-f1be-4c01-8b1f-b1f3f1895976 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:00.699451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957af1f-f1be-4c01-8b1f-b1f3f1895976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:00.701009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957af1f-f1be-4c01-8b1f-b1f3f1895976 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:00.712751 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a2bcd-8d74-409d-a279-d9df83ce364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:00.713391 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a2bcd-8d74-409d-a279-d9df83ce364f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:00.713671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a2bcd-8d74-409d-a279-d9df83ce364f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:00.713944 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a2bcd-8d74-409d-a279-d9df83ce364f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:00.716578 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 209/416] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:00.722778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957af1f-f1be-4c01-8b1f-b1f3f1895976 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:00.853751 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a2bcd-8d74-409d-a279-d9df83ce364f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:00.860898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a2bcd-8d74-409d-a279-d9df83ce364f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:00.880560 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:00.939302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:00.950803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957af1f-f1be-4c01-8b1f-b1f3f1895976 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:01.025125 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441406e-a047-4754-a2ff-99477e06af8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:01.025784 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441406e-a047-4754-a2ff-99477e06af8f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.026065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441406e-a047-4754-a2ff-99477e06af8f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.026410 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441406e-a047-4754-a2ff-99477e06af8f None admin] PATH_INFO: `/v3/groups/96d61c67c4f9408e82c30f3c285c5074` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.027665 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441406e-a047-4754-a2ff-99477e06af8f None admin] RBAC: Authorizing `identity:get_group(group_id=96d61c67c4f9408e82c30f3c285c5074)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:01.029173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441406e-a047-4754-a2ff-99477e06af8f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:01.031098 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 210/417] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Sep 7 12:54:00 2022] GET /identity/v3/groups/96d61c67c4f9408e82c30f3c285c5074 => generated 229 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:01.036515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441406e-a047-4754-a2ff-99477e06af8f None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:01.074788 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 208/418] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:01.082309 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a2bcd-8d74-409d-a279-d9df83ce364f None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:01.214468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441406e-a047-4754-a2ff-99477e06af8f None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:01.229306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a2bcd-8d74-409d-a279-d9df83ce364f None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:01.260252 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257b375-0bcf-4668-b46d-b2d68a37cf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:01.260972 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257b375-0bcf-4668-b46d-b2d68a37cf3c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.261209 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257b375-0bcf-4668-b46d-b2d68a37cf3c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.261479 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257b375-0bcf-4668-b46d-b2d68a37cf3c None admin] PATH_INFO: `/v3/projects/e3af01406fe7484583db161921c3b6ee` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.262900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257b375-0bcf-4668-b46d-b2d68a37cf3c None admin] RBAC: Authorizing `identity:get_project(project_id=e3af01406fe7484583db161921c3b6ee)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:01.264733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257b375-0bcf-4668-b46d-b2d68a37cf3c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:01.266634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 211/419] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:01 2022] GET /identity/v3/projects/e3af01406fe7484583db161921c3b6ee => generated 344 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:01.268023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818bda2-d479-4cc5-8da2-0f50ffa09cce None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.268450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818bda2-d479-4cc5-8da2-0f50ffa09cce None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.268927 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818bda2-d479-4cc5-8da2-0f50ffa09cce None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.274814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 212/420] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:01.275711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818bda2-d479-4cc5-8da2-0f50ffa09cce None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:01.275843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5466bb-87b4-4bed-b871-a9f6682713ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:01.276804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5466bb-87b4-4bed-b871-a9f6682713ed None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.277277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5466bb-87b4-4bed-b871-a9f6682713ed None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.277752 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5466bb-87b4-4bed-b871-a9f6682713ed None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.279435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5466bb-87b4-4bed-b871-a9f6682713ed None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:01.282042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5466bb-87b4-4bed-b871-a9f6682713ed None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:01.288553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 209/421] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:01 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:01.290411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd5fee-8dbf-46aa-a650-2c147bd25bb8 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.290411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd5fee-8dbf-46aa-a650-2c147bd25bb8 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.290674 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd5fee-8dbf-46aa-a650-2c147bd25bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.293186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:01.300402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:01.316041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-b7bd5fee-8dbf-46aa-a650-2c147bd25bb8 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:01.317464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b7bd5fee-8dbf-46aa-a650-2c147bd25bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:01.414192 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 210/422] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:01.421049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd5fee-8dbf-46aa-a650-2c147bd25bb8 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:01.428909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818bda2-d479-4cc5-8da2-0f50ffa09cce None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:01.478047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09445fe3-89f5-4092-8cf2-ffd4e5f94235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:01.479205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09445fe3-89f5-4092-8cf2-ffd4e5f94235 None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.479687 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09445fe3-89f5-4092-8cf2-ffd4e5f94235 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.480180 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09445fe3-89f5-4092-8cf2-ffd4e5f94235 None admin] PATH_INFO: `/v3/projects/e3af01406fe7484583db161921c3b6ee/groups/96d61c67c4f9408e82c30f3c285c5074/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.484163 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09445fe3-89f5-4092-8cf2-ffd4e5f94235 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3af01406fe7484583db161921c3b6ee, group_id=96d61c67c4f9408e82c30f3c285c5074, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:01.486127 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09445fe3-89f5-4092-8cf2-ffd4e5f94235 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:01.508472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 213/423] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Sep 7 12:54:01 2022] PUT /identity/v3/projects/e3af01406fe7484583db161921c3b6ee/groups/96d61c67c4f9408e82c30f3c285c5074/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:54:01.604049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd5fee-8dbf-46aa-a650-2c147bd25bb8 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:01.641302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:01.649374 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecb690-0b6a-4f24-a0dd-5fbb0cb3ada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:01.650459 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecb690-0b6a-4f24-a0dd-5fbb0cb3ada1 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.651010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecb690-0b6a-4f24-a0dd-5fbb0cb3ada1 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.651495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecb690-0b6a-4f24-a0dd-5fbb0cb3ada1 None admin] PATH_INFO: `/v3/groups/01f0327c73994f0ba1adf7e907e46571` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.652903 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecb690-0b6a-4f24-a0dd-5fbb0cb3ada1 None admin] RBAC: Authorizing `identity:get_group(group_id=01f0327c73994f0ba1adf7e907e46571)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:01.654618 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecb690-0b6a-4f24-a0dd-5fbb0cb3ada1 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:01.656693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 211/424] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Sep 7 12:54:01 2022] GET /identity/v3/groups/01f0327c73994f0ba1adf7e907e46571 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:01.664298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09445fe3-89f5-4092-8cf2-ffd4e5f94235 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:01.759530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:01.760807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecb690-0b6a-4f24-a0dd-5fbb0cb3ada1 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:01.815175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09445fe3-89f5-4092-8cf2-ffd4e5f94235 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:01.872792 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed852e0-4988-44b4-9bff-fdb67d8b574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:01.873689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed852e0-4988-44b4-9bff-fdb67d8b574f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.874304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed852e0-4988-44b4-9bff-fdb67d8b574f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.874716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed852e0-4988-44b4-9bff-fdb67d8b574f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.876358 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed852e0-4988-44b4-9bff-fdb67d8b574f None admin] RBAC: Adding query filter params (group.id=01f0327c73994f0ba1adf7e907e46571, role.id=30891346cde644e7bd9ae90a3876efc8, scope.project.id=d2ad57e577854d67ae2401564821ce05) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:01.876852 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed852e0-4988-44b4-9bff-fdb67d8b574f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:01.880254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed852e0-4988-44b4-9bff-fdb67d8b574f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:01.891053 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 214/425] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Sep 7 12:54:01 2022] GET /identity/v3/role_assignments?group.id=01f0327c73994f0ba1adf7e907e46571&scope.project.id=d2ad57e577854d67ae2401564821ce05&role.id=30891346cde644e7bd9ae90a3876efc8 => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:01.894622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175ec73-51d8-435d-8c0e-9ae22a154a80 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.895286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175ec73-51d8-435d-8c0e-9ae22a154a80 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.896354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175ec73-51d8-435d-8c0e-9ae22a154a80 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.898855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 215/426] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:01.905727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab512e37-baf4-4b1c-a490-3ed38b0e0944 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.906013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab512e37-baf4-4b1c-a490-3ed38b0e0944 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.906532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab512e37-baf4-4b1c-a490-3ed38b0e0944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.929056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-ab512e37-baf4-4b1c-a490-3ed38b0e0944 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:01.930556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ab512e37-baf4-4b1c-a490-3ed38b0e0944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:01.961075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecb690-0b6a-4f24-a0dd-5fbb0cb3ada1 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:02.011610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afb38a-a5d9-4538-a26b-828f2b8fee52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:02.012304 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afb38a-a5d9-4538-a26b-828f2b8fee52 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:02.012713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afb38a-a5d9-4538-a26b-828f2b8fee52 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:02.013053 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afb38a-a5d9-4538-a26b-828f2b8fee52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:02.025621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afb38a-a5d9-4538-a26b-828f2b8fee52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:02.030665 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 216/427] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-72afb38a-a5d9-4538-a26b-828f2b8fee52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:02.035177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:02.036109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:02.036988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:02.036988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:02.036988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:02.036988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:02.036988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:02.036988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:02.036988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:02.036988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:02.036988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:02.036988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:02.036988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:54:02.036988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:02.039254 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 212/428] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:54:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:54:02.045358 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab512e37-baf4-4b1c-a490-3ed38b0e0944 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:02.145034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:02.188461 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab512e37-baf4-4b1c-a490-3ed38b0e0944 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:02.229999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50699ec-de0e-4435-88de-339a54dd011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:02.230626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50699ec-de0e-4435-88de-339a54dd011c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:02.230905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50699ec-de0e-4435-88de-339a54dd011c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:02.231178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50699ec-de0e-4435-88de-339a54dd011c None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:02.231871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50699ec-de0e-4435-88de-339a54dd011c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:02.232175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50699ec-de0e-4435-88de-339a54dd011c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:02.233671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50699ec-de0e-4435-88de-339a54dd011c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:02.243264 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 217/429] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:02.249283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afb38a-a5d9-4538-a26b-828f2b8fee52 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:02.325863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:02.338405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50699ec-de0e-4435-88de-339a54dd011c None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:02.411691 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afb38a-a5d9-4538-a26b-828f2b8fee52 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:02.477775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71175741-091b-4d8e-b9bc-a22693d475da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:02.478825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71175741-091b-4d8e-b9bc-a22693d475da None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:02.479313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71175741-091b-4d8e-b9bc-a22693d475da None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:02.479798 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71175741-091b-4d8e-b9bc-a22693d475da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:02.500139 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50699ec-de0e-4435-88de-339a54dd011c None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:02.533570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:02.548035 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7d383-b9de-4ec3-a73a-b0d3eb104e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:02.548734 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7d383-b9de-4ec3-a73a-b0d3eb104e5c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:02.549037 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7d383-b9de-4ec3-a73a-b0d3eb104e5c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:02.549308 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7d383-b9de-4ec3-a73a-b0d3eb104e5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:02.562973 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7d383-b9de-4ec3-a73a-b0d3eb104e5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-23b7d383-b9de-4ec3-a73a-b0d3eb104e5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:02.568168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:02.569211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:02.569999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:02.569999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:02.569999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:02.569999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:02.569999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:02.569999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:02.569999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:02.569999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:02.569999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:02.569999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:02.569999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:54:02.569999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:02.574313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 218/430] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:54:02.576604 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7d383-b9de-4ec3-a73a-b0d3eb104e5c None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:02.596240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71175741-091b-4d8e-b9bc-a22693d475da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:02.598240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71175741-091b-4d8e-b9bc-a22693d475da None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:02.693761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:02.736766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7d383-b9de-4ec3-a73a-b0d3eb104e5c None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:02.771481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 213/431] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:02.776501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad790609-aec1-4921-8e7d-660b57de421f None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:02.776893 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad790609-aec1-4921-8e7d-660b57de421f None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:02.777716 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad790609-aec1-4921-8e7d-660b57de421f None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:02.783954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 214/432] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:02.783954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad790609-aec1-4921-8e7d-660b57de421f None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:02.797003 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334bb45-03b8-4b62-8907-31003bf3e0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:02.797621 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334bb45-03b8-4b62-8907-31003bf3e0e0 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:02.797903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334bb45-03b8-4b62-8907-31003bf3e0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:02.798175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334bb45-03b8-4b62-8907-31003bf3e0e0 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:02.798863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334bb45-03b8-4b62-8907-31003bf3e0e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:02.799342 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334bb45-03b8-4b62-8907-31003bf3e0e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:02.801573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334bb45-03b8-4b62-8907-31003bf3e0e0 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:02.815515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 219/433] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:54:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:02.817095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f75454-d5f3-4712-bf8d-95c7568d8e37 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:02.817527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f75454-d5f3-4712-bf8d-95c7568d8e37 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:02.817983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f75454-d5f3-4712-bf8d-95c7568d8e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:02.840739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-40f75454-d5f3-4712-bf8d-95c7568d8e37 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:02.842103 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-40f75454-d5f3-4712-bf8d-95c7568d8e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:02.898561 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:02.929556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 220/434] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:02.930645 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad790609-aec1-4921-8e7d-660b57de421f None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:02.933487 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f75454-d5f3-4712-bf8d-95c7568d8e37 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:02.969604 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3904f29-6453-4b60-9a46-29de57ee6da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:02.970251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904f29-6453-4b60-9a46-29de57ee6da9 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:02.970528 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904f29-6453-4b60-9a46-29de57ee6da9 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:02.970800 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904f29-6453-4b60-9a46-29de57ee6da9 None admin] PATH_INFO: `/v3/projects/d2ad57e577854d67ae2401564821ce05` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:02.972298 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3904f29-6453-4b60-9a46-29de57ee6da9 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ad57e577854d67ae2401564821ce05)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:02.973797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3904f29-6453-4b60-9a46-29de57ee6da9 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:02.975643 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 215/435] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:02 2022] GET /identity/v3/projects/d2ad57e577854d67ae2401564821ce05 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:02.983240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3904f29-6453-4b60-9a46-29de57ee6da9 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:03.017147 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:03.070142 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f75454-d5f3-4712-bf8d-95c7568d8e37 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:03.113483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f8f78-2290-4483-89fd-cbcdf5d53f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:03.113729 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3904f29-6453-4b60-9a46-29de57ee6da9 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:03.114095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8f78-2290-4483-89fd-cbcdf5d53f9d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:03.114343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8f78-2290-4483-89fd-cbcdf5d53f9d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:03.114583 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8f78-2290-4483-89fd-cbcdf5d53f9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:03.153340 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cd796-a4a9-4828-82d7-bf6d04ba866b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:03.154029 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cd796-a4a9-4828-82d7-bf6d04ba866b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:03.154308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cd796-a4a9-4828-82d7-bf6d04ba866b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:03.154579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cd796-a4a9-4828-82d7-bf6d04ba866b None admin] PATH_INFO: `/v3/groups/01f0327c73994f0ba1adf7e907e46571` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:03.155738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321cd796-a4a9-4828-82d7-bf6d04ba866b None admin] RBAC: Authorizing `identity:get_group(group_id=01f0327c73994f0ba1adf7e907e46571)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:03.157534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321cd796-a4a9-4828-82d7-bf6d04ba866b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:03.159823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 216/436] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Sep 7 12:54:02 2022] GET /identity/v3/groups/01f0327c73994f0ba1adf7e907e46571 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:03.165741 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cd796-a4a9-4828-82d7-bf6d04ba866b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:03.170053 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:03.211170 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f8f78-2290-4483-89fd-cbcdf5d53f9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:03.213802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f8f78-2290-4483-89fd-cbcdf5d53f9d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:03.292764 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:03.302469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cd796-a4a9-4828-82d7-bf6d04ba866b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:03.348645 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ec4e6-fb1a-45ce-a6eb-c6c63e61f3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:03.349276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ec4e6-fb1a-45ce-a6eb-c6c63e61f3d1 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:03.349552 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ec4e6-fb1a-45ce-a6eb-c6c63e61f3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:03.349823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ec4e6-fb1a-45ce-a6eb-c6c63e61f3d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:03.350583 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ec4e6-fb1a-45ce-a6eb-c6c63e61f3d1 None admin] RBAC: Adding query filter params (group.id=01f0327c73994f0ba1adf7e907e46571, role.id=0560a82175224c8e86d1b430212748d4, scope.project.id=d2ad57e577854d67ae2401564821ce05) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:03.350878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ec4e6-fb1a-45ce-a6eb-c6c63e61f3d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:03.352396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ec4e6-fb1a-45ce-a6eb-c6c63e61f3d1 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:03.359372 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 217/437] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Sep 7 12:54:03 2022] GET /identity/v3/role_assignments?group.id=01f0327c73994f0ba1adf7e907e46571&scope.project.id=d2ad57e577854d67ae2401564821ce05&role.id=0560a82175224c8e86d1b430212748d4 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:03.360229 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ec4e6-fb1a-45ce-a6eb-c6c63e61f3d1 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:03.361866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 221/438] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:03.368346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f8f78-2290-4483-89fd-cbcdf5d53f9d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:03.481230 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:03.512583 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f8f78-2290-4483-89fd-cbcdf5d53f9d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:03.526187 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ec4e6-fb1a-45ce-a6eb-c6c63e61f3d1 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:03.561685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053b4d4-c11e-408e-a4ae-cb1575c234b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:03.562217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053b4d4-c11e-408e-a4ae-cb1575c234b5 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:03.562494 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053b4d4-c11e-408e-a4ae-cb1575c234b5 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:03.562761 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053b4d4-c11e-408e-a4ae-cb1575c234b5 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:03.564092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053b4d4-c11e-408e-a4ae-cb1575c234b5 None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:03.565648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053b4d4-c11e-408e-a4ae-cb1575c234b5 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:03.572674 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 222/439] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:03 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:03.573736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053b4d4-c11e-408e-a4ae-cb1575c234b5 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:03.575713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9ea1-cb13-4d8b-83e0-69e73836fbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:03.576653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9ea1-cb13-4d8b-83e0-69e73836fbb2 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:03.577299 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9ea1-cb13-4d8b-83e0-69e73836fbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:03.577770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9ea1-cb13-4d8b-83e0-69e73836fbb2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:03.601153 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed9ea1-cb13-4d8b-83e0-69e73836fbb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-46ed9ea1-cb13-4d8b-83e0-69e73836fbb2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:03.605550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:03.606522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:03.607409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:03.607409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:03.607409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:03.607409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:03.607409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:03.607409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:03.607409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:03.607409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:03.607409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:03.607409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:03.607409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:54:03.607409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:03.608028 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 218/440] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:54:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:03.617484 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9ea1-cb13-4d8b-83e0-69e73836fbb2 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:03.658904 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:03.750940 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053b4d4-c11e-408e-a4ae-cb1575c234b5 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:03.805378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9ea1-cb13-4d8b-83e0-69e73836fbb2 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:03.814177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a67ca-6195-406b-87c2-efb8d974aa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:03.819367 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a67ca-6195-406b-87c2-efb8d974aa98 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:03.819367 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a67ca-6195-406b-87c2-efb8d974aa98 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:03.819367 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a67ca-6195-406b-87c2-efb8d974aa98 None admin] PATH_INFO: `/v3/groups/01f0327c73994f0ba1adf7e907e46571` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:03.820112 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a67ca-6195-406b-87c2-efb8d974aa98 None admin] RBAC: Authorizing `identity:get_group(group_id=01f0327c73994f0ba1adf7e907e46571)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:03.821724 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a67ca-6195-406b-87c2-efb8d974aa98 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:03.825051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 223/441] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Sep 7 12:54:03 2022] GET /identity/v3/groups/01f0327c73994f0ba1adf7e907e46571 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:03.831708 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a67ca-6195-406b-87c2-efb8d974aa98 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:03.855311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:03.880984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdce791-88b5-4c6f-8da4-18ad690e05c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:03.881626 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdce791-88b5-4c6f-8da4-18ad690e05c3 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:03.881929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdce791-88b5-4c6f-8da4-18ad690e05c3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:03.882172 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdce791-88b5-4c6f-8da4-18ad690e05c3 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:03.883539 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdce791-88b5-4c6f-8da4-18ad690e05c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:03.883841 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdce791-88b5-4c6f-8da4-18ad690e05c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:03.885620 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdce791-88b5-4c6f-8da4-18ad690e05c3 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:03.896841 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 219/442] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:03.902692 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdce791-88b5-4c6f-8da4-18ad690e05c3 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:03.998356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a67ca-6195-406b-87c2-efb8d974aa98 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:04.037985 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:04.042637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23a183-1116-4342-a87c-6e45faa3e5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:04.043692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23a183-1116-4342-a87c-6e45faa3e5af None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:04.044133 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23a183-1116-4342-a87c-6e45faa3e5af None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:04.044635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23a183-1116-4342-a87c-6e45faa3e5af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:04.045937 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23a183-1116-4342-a87c-6e45faa3e5af None admin] RBAC: Adding query filter params (group.id=01f0327c73994f0ba1adf7e907e46571, role.id=30891346cde644e7bd9ae90a3876efc8, scope.project.id=f2c27767fad842abb753f50c28758062) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:04.046650 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23a183-1116-4342-a87c-6e45faa3e5af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:04.048277 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23a183-1116-4342-a87c-6e45faa3e5af None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:04.060621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdce791-88b5-4c6f-8da4-18ad690e05c3 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:04.060831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 224/443] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Sep 7 12:54:03 2022] GET /identity/v3/role_assignments?group.id=01f0327c73994f0ba1adf7e907e46571&scope.project.id=f2c27767fad842abb753f50c28758062&role.id=30891346cde644e7bd9ae90a3876efc8 => generated 611 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:04.100964 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaf93f-fd34-45a8-b497-44f2e9dccee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:04.101603 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaf93f-fd34-45a8-b497-44f2e9dccee5 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:04.101883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaf93f-fd34-45a8-b497-44f2e9dccee5 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:04.102154 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaf93f-fd34-45a8-b497-44f2e9dccee5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:04.200000 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdaf93f-fd34-45a8-b497-44f2e9dccee5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:04.201614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdaf93f-fd34-45a8-b497-44f2e9dccee5 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:04.316950 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:04.324477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dd80f-6133-4797-83e7-0a5ff8029457 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:04.324820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dd80f-6133-4797-83e7-0a5ff8029457 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:04.325068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dd80f-6133-4797-83e7-0a5ff8029457 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:04.326948 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 225/444] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:54:04.332852 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987733bc-8617-4562-bdc4-ae08f5ade15d None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:04.333193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987733bc-8617-4562-bdc4-ae08f5ade15d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:04.333536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987733bc-8617-4562-bdc4-ae08f5ade15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:04.346013 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 220/445] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:04.351760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaf93f-fd34-45a8-b497-44f2e9dccee5 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:04.358871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-987733bc-8617-4562-bdc4-ae08f5ade15d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:04.361022 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-987733bc-8617-4562-bdc4-ae08f5ade15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:04.466257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 226/446] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:54:04.506587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaf93f-fd34-45a8-b497-44f2e9dccee5 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:04.548496 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b00e6-30a0-479e-9545-1276563db302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:04.548496 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b00e6-30a0-479e-9545-1276563db302 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:04.550061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b00e6-30a0-479e-9545-1276563db302 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:04.550061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b00e6-30a0-479e-9545-1276563db302 None admin] PATH_INFO: `/v3/projects/f2c27767fad842abb753f50c28758062` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:04.551022 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b00e6-30a0-479e-9545-1276563db302 None admin] RBAC: Authorizing `identity:get_project(project_id=f2c27767fad842abb753f50c28758062)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:04.552532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b00e6-30a0-479e-9545-1276563db302 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:04.554202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 221/447] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:04 2022] GET /identity/v3/projects/f2c27767fad842abb753f50c28758062 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:04.560072 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987733bc-8617-4562-bdc4-ae08f5ade15d None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:04.569572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:04.688989 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987733bc-8617-4562-bdc4-ae08f5ade15d None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:04.728192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b2af2-7221-4fdb-866f-25746b9f5abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:04.728862 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b2af2-7221-4fdb-866f-25746b9f5abb None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:04.729141 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b2af2-7221-4fdb-866f-25746b9f5abb None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:04.729411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b2af2-7221-4fdb-866f-25746b9f5abb None admin] PATH_INFO: `/v3/groups/01f0327c73994f0ba1adf7e907e46571` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:04.730590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b2af2-7221-4fdb-866f-25746b9f5abb None admin] RBAC: Authorizing `identity:get_group(group_id=01f0327c73994f0ba1adf7e907e46571)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:04.732056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b2af2-7221-4fdb-866f-25746b9f5abb None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:04.733897 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 227/448] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Sep 7 12:54:04 2022] GET /identity/v3/groups/01f0327c73994f0ba1adf7e907e46571 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:04.739982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b00e6-30a0-479e-9545-1276563db302 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:04.743643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b2af2-7221-4fdb-866f-25746b9f5abb None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:04.796116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:04.829031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:04.855900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b2af2-7221-4fdb-866f-25746b9f5abb None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:04.856107 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b00e6-30a0-479e-9545-1276563db302 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:04.895290 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cf93a-dffd-45b1-8024-8ce84722080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:04.896276 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cf93a-dffd-45b1-8024-8ce84722080b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:04.896704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa247f-438d-414f-9086-a940956a8f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:04.896842 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cf93a-dffd-45b1-8024-8ce84722080b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:04.897151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cf93a-dffd-45b1-8024-8ce84722080b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:04.897647 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa247f-438d-414f-9086-a940956a8f45 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:04.898114 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa247f-438d-414f-9086-a940956a8f45 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:04.899614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa247f-438d-414f-9086-a940956a8f45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:04.899787 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa247f-438d-414f-9086-a940956a8f45 None admin] RBAC: Adding query filter params (group.id=01f0327c73994f0ba1adf7e907e46571, role.id=0560a82175224c8e86d1b430212748d4, scope.project.id=f2c27767fad842abb753f50c28758062) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:04.900540 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa247f-438d-414f-9086-a940956a8f45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:04.902899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa247f-438d-414f-9086-a940956a8f45 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:04.920237 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 222/449] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Sep 7 12:54:04 2022] GET /identity/v3/role_assignments?group.id=01f0327c73994f0ba1adf7e907e46571&scope.project.id=f2c27767fad842abb753f50c28758062&role.id=0560a82175224c8e86d1b430212748d4 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:04.920498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cf93a-dffd-45b1-8024-8ce84722080b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:04.920498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-5b5cf93a-dffd-45b1-8024-8ce84722080b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:04.920498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:04.920498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:04.920498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:04.920498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:04.920498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:04.920498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:04.920498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:04.920498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:04.920498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:04.920498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:04.920498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:04.920498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:04.921340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:04.922199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:04.922199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:04.922199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:04.922199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:04.922199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:04.922199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:04.922199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:04.922199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:04.922199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:04.922199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:04.922199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:04.922199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:04.922199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:04.922199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:04.922199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 228/450] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:54:04.928755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa247f-438d-414f-9086-a940956a8f45 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:05.066055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa247f-438d-414f-9086-a940956a8f45 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:05.083432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:05.107124 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc06704-1336-476d-ad81-a33853168478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:05.107729 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc06704-1336-476d-ad81-a33853168478 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:05.108003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc06704-1336-476d-ad81-a33853168478 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:05.108283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc06704-1336-476d-ad81-a33853168478 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:05.108981 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc06704-1336-476d-ad81-a33853168478 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:05.109276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc06704-1336-476d-ad81-a33853168478 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:05.110691 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc06704-1336-476d-ad81-a33853168478 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:05.120346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 223/451] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:05.129201 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cf93a-dffd-45b1-8024-8ce84722080b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:05.254048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cf93a-dffd-45b1-8024-8ce84722080b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:05.296650 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06005700-6561-4990-9bca-f35bb4d8ea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:05.297277 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06005700-6561-4990-9bca-f35bb4d8ea5d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:05.297557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06005700-6561-4990-9bca-f35bb4d8ea5d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:05.297827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06005700-6561-4990-9bca-f35bb4d8ea5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:05.301230 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:05.385124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06005700-6561-4990-9bca-f35bb4d8ea5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:05.386617 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06005700-6561-4990-9bca-f35bb4d8ea5d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:05.493117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 229/452] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:05.499479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc06704-1336-476d-ad81-a33853168478 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:05.616048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc06704-1336-476d-ad81-a33853168478 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:05.652677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fbd43-97a4-477d-af16-2231883f6a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:05.653225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fbd43-97a4-477d-af16-2231883f6a99 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:05.653502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fbd43-97a4-477d-af16-2231883f6a99 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:05.653772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fbd43-97a4-477d-af16-2231883f6a99 None admin] PATH_INFO: `/v3/projects/e3af01406fe7484583db161921c3b6ee` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:05.654933 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fbd43-97a4-477d-af16-2231883f6a99 None admin] RBAC: Authorizing `identity:get_project(project_id=e3af01406fe7484583db161921c3b6ee)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:05.656604 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fbd43-97a4-477d-af16-2231883f6a99 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:05.658241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 224/453] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:05 2022] GET /identity/v3/projects/e3af01406fe7484583db161921c3b6ee => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:05.666900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06005700-6561-4990-9bca-f35bb4d8ea5d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:05.705474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:05.780080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06005700-6561-4990-9bca-f35bb4d8ea5d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:05.817543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f7bad-bced-4912-8a2e-c1e7f61b7679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:05.818202 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f7bad-bced-4912-8a2e-c1e7f61b7679 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:05.818486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f7bad-bced-4912-8a2e-c1e7f61b7679 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:05.818759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f7bad-bced-4912-8a2e-c1e7f61b7679 None admin] PATH_INFO: `/v3/groups/96d61c67c4f9408e82c30f3c285c5074` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:05.820070 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f7bad-bced-4912-8a2e-c1e7f61b7679 None admin] RBAC: Authorizing `identity:get_group(group_id=96d61c67c4f9408e82c30f3c285c5074)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:05.821649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f7bad-bced-4912-8a2e-c1e7f61b7679 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:05.823376 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 230/454] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Sep 7 12:54:05 2022] GET /identity/v3/groups/96d61c67c4f9408e82c30f3c285c5074 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:05.830160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fbd43-97a4-477d-af16-2231883f6a99 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:05.883761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:05.952134 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fbd43-97a4-477d-af16-2231883f6a99 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:05.988864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ca0bd-bb7c-41bf-8ab1-e26d6c9b6e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:05.989477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ca0bd-bb7c-41bf-8ab1-e26d6c9b6e00 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:05.989755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ca0bd-bb7c-41bf-8ab1-e26d6c9b6e00 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:05.990020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ca0bd-bb7c-41bf-8ab1-e26d6c9b6e00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:05.990767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ca0bd-bb7c-41bf-8ab1-e26d6c9b6e00 None admin] RBAC: Adding query filter params (group.id=96d61c67c4f9408e82c30f3c285c5074, role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=e3af01406fe7484583db161921c3b6ee) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:05.991076 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ca0bd-bb7c-41bf-8ab1-e26d6c9b6e00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:05.992604 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ca0bd-bb7c-41bf-8ab1-e26d6c9b6e00 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:05.999918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 225/455] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Sep 7 12:54:05 2022] GET /identity/v3/role_assignments?group.id=96d61c67c4f9408e82c30f3c285c5074&scope.project.id=e3af01406fe7484583db161921c3b6ee&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:09.105002 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662ce16-9111-42b1-a8b4-48587a6b45e8 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:09.105990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662ce16-9111-42b1-a8b4-48587a6b45e8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:09.106471 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662ce16-9111-42b1-a8b4-48587a6b45e8 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:09.108298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 231/456] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:09.125831 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06f507-eed5-4429-9445-9b2f248d5ea3 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:09.126811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06f507-eed5-4429-9445-9b2f248d5ea3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:09.127426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06f507-eed5-4429-9445-9b2f248d5ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:09.142868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e1874-abac-4a13-8cc1-11e2a4ecef10 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:09.143483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e1874-abac-4a13-8cc1-11e2a4ecef10 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:09.143989 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e1874-abac-4a13-8cc1-11e2a4ecef10 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:09.145880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 232/457] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:09.151215 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb65e3-9cac-42cc-b486-578f3d4e380d None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:09.151515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb65e3-9cac-42cc-b486-578f3d4e380d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:09.151721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb65e3-9cac-42cc-b486-578f3d4e380d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:09.165186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-3a06f507-eed5-4429-9445-9b2f248d5ea3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:09.166782 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3a06f507-eed5-4429-9445-9b2f248d5ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:09.193447 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-3dfb65e3-9cac-42cc-b486-578f3d4e380d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:09.197061 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-3dfb65e3-9cac-42cc-b486-578f3d4e380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:09.314008 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 226/458] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:09.334561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7e53e-6479-4a7a-a0ae-6bdb86963f11 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:09.334892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7e53e-6479-4a7a-a0ae-6bdb86963f11 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:09.335111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7e53e-6479-4a7a-a0ae-6bdb86963f11 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:09.336836 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 227/459] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:54:09.342827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 233/460] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:54:09.343030 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac5e83-5ea6-49b9-94e4-92043bee5299 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:09.343423 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac5e83-5ea6-49b9-94e4-92043bee5299 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:09.343859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac5e83-5ea6-49b9-94e4-92043bee5299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:09.393834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-51ac5e83-5ea6-49b9-94e4-92043bee5299 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:09.394722 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-51ac5e83-5ea6-49b9-94e4-92043bee5299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:09.444809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:09.498995 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 228/461] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:54:09.632639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb65e3-9cac-42cc-b486-578f3d4e380d None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:09.681396 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:09.725757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc34b3c-8734-45b0-93e0-ff2a5918f29b None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:09.726077 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc34b3c-8734-45b0-93e0-ff2a5918f29b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:09.726300 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc34b3c-8734-45b0-93e0-ff2a5918f29b None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:09.728937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 229/462] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:09.737990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4429d51-e8e5-428c-a7ab-afc4d7b658c9 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:09.738375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4429d51-e8e5-428c-a7ab-afc4d7b658c9 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:09.738541 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4429d51-e8e5-428c-a7ab-afc4d7b658c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:09.771206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-f4429d51-e8e5-428c-a7ab-afc4d7b658c9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:09.772455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f4429d51-e8e5-428c-a7ab-afc4d7b658c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:09.785731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb65e3-9cac-42cc-b486-578f3d4e380d None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:09.858295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d4ced-3747-43a7-9019-eb1b32818a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:09.858948 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d4ced-3747-43a7-9019-eb1b32818a8f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:09.859423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d4ced-3747-43a7-9019-eb1b32818a8f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:09.859843 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d4ced-3747-43a7-9019-eb1b32818a8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:09.875494 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d4ced-3747-43a7-9019-eb1b32818a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:09.876825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 230/463] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:54:09.877377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d4ced-3747-43a7-9019-eb1b32818a8f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:09.878355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4429d51-e8e5-428c-a7ab-afc4d7b658c9 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-940d4ced-3747-43a7-9019-eb1b32818a8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:09.910421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:09.911431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:09.912352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:09.912352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:09.912352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:09.915293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 234/464] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:09.916785 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d4ced-3747-43a7-9019-eb1b32818a8f None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:10.021527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:10.026447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4429d51-e8e5-428c-a7ab-afc4d7b658c9 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:10.048435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:10.071700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d4ced-3747-43a7-9019-eb1b32818a8f None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:10.073950 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab14e00-f2e3-4af4-95af-0949ff60e1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:10.074959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab14e00-f2e3-4af4-95af-0949ff60e1f7 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:10.075234 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab14e00-f2e3-4af4-95af-0949ff60e1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:10.075505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab14e00-f2e3-4af4-95af-0949ff60e1f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:10.088779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab14e00-f2e3-4af4-95af-0949ff60e1f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:10.090258 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab14e00-f2e3-4af4-95af-0949ff60e1f7 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-bab14e00-f2e3-4af4-95af-0949ff60e1f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:10.107880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:10.109530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:10.110956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:10.110956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:10.110956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:10.110956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 231/465] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:10.110956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab14e00-f2e3-4af4-95af-0949ff60e1f7 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:10.129311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238b01f-f1b4-4a0f-b796-6218c7aa77f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:10.131165 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238b01f-f1b4-4a0f-b796-6218c7aa77f6 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:10.131890 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238b01f-f1b4-4a0f-b796-6218c7aa77f6 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:10.132435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238b01f-f1b4-4a0f-b796-6218c7aa77f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:10.148713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238b01f-f1b4-4a0f-b796-6218c7aa77f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:10.151396 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238b01f-f1b4-4a0f-b796-6218c7aa77f6 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-8238b01f-f1b4-4a0f-b796-6218c7aa77f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:10.172109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:10.173097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:10.174088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:10.174088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:10.174088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:10.182083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 235/466] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:10.182083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238b01f-f1b4-4a0f-b796-6218c7aa77f6 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:10.255181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab14e00-f2e3-4af4-95af-0949ff60e1f7 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:10.300831 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f65e7c-ae15-473a-a5de-4c2fa8f2f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:10.301427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f65e7c-ae15-473a-a5de-4c2fa8f2f5ed None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:10.301839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f65e7c-ae15-473a-a5de-4c2fa8f2f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:10.302253 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f65e7c-ae15-473a-a5de-4c2fa8f2f5ed None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:10.303331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f65e7c-ae15-473a-a5de-4c2fa8f2f5ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:10.303828 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f65e7c-ae15-473a-a5de-4c2fa8f2f5ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:10.309129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f65e7c-ae15-473a-a5de-4c2fa8f2f5ed None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:10.336492 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 232/467] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:10.336492 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f65e7c-ae15-473a-a5de-4c2fa8f2f5ed None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:10.350613 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238b01f-f1b4-4a0f-b796-6218c7aa77f6 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:10.352160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:10.408671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb494d-daef-4a38-bc34-40eb95ea2757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:10.409823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb494d-daef-4a38-bc34-40eb95ea2757 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:10.410044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb494d-daef-4a38-bc34-40eb95ea2757 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:10.410299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb494d-daef-4a38-bc34-40eb95ea2757 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:10.411311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb494d-daef-4a38-bc34-40eb95ea2757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:10.411624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb494d-daef-4a38-bc34-40eb95ea2757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:10.413109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb494d-daef-4a38-bc34-40eb95ea2757 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:10.417567 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:10.436602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 236/468] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:10.437857 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb494d-daef-4a38-bc34-40eb95ea2757 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:10.483814 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f65e7c-ae15-473a-a5de-4c2fa8f2f5ed None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:10.522281 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12f5c2-7b78-44d9-a167-78310c8c7767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:10.522911 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12f5c2-7b78-44d9-a167-78310c8c7767 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:10.523223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12f5c2-7b78-44d9-a167-78310c8c7767 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:10.523526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12f5c2-7b78-44d9-a167-78310c8c7767 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:10.524189 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12f5c2-7b78-44d9-a167-78310c8c7767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:10.524526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12f5c2-7b78-44d9-a167-78310c8c7767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:10.525922 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12f5c2-7b78-44d9-a167-78310c8c7767 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:10.544451 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 233/469] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:10.544451 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12f5c2-7b78-44d9-a167-78310c8c7767 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:10.570904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb494d-daef-4a38-bc34-40eb95ea2757 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:10.606920 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995715a-6371-4c5c-a53e-f75f498710a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:10.607581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995715a-6371-4c5c-a53e-f75f498710a2 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:10.607856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995715a-6371-4c5c-a53e-f75f498710a2 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:10.608155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995715a-6371-4c5c-a53e-f75f498710a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:10.619779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995715a-6371-4c5c-a53e-f75f498710a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:10.621297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995715a-6371-4c5c-a53e-f75f498710a2 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:10.624314 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-b995715a-6371-4c5c-a53e-f75f498710a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:10.638320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:10.639404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:10.640397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:10.640397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:10.640397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:10.641657 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 237/470] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:10.642472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995715a-6371-4c5c-a53e-f75f498710a2 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:10.658215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12f5c2-7b78-44d9-a167-78310c8c7767 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:10.695234 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5e74f-7e59-45be-95cc-f7030d9f91cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:10.697632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5e74f-7e59-45be-95cc-f7030d9f91cb None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:10.697632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5e74f-7e59-45be-95cc-f7030d9f91cb None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:10.697632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5e74f-7e59-45be-95cc-f7030d9f91cb None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:10.697632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5e74f-7e59-45be-95cc-f7030d9f91cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:10.698533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5e74f-7e59-45be-95cc-f7030d9f91cb None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:10.708810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:10.723282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 234/471] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:54:10 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:54:10.724410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5e74f-7e59-45be-95cc-f7030d9f91cb None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:10.782823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995715a-6371-4c5c-a53e-f75f498710a2 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:10.827611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd27887-144a-4775-aa95-5d562cbf41c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:10.828130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd27887-144a-4775-aa95-5d562cbf41c8 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:10.828436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd27887-144a-4775-aa95-5d562cbf41c8 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:10.828719 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd27887-144a-4775-aa95-5d562cbf41c8 None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:10.829418 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd27887-144a-4775-aa95-5d562cbf41c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:10.831026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd27887-144a-4775-aa95-5d562cbf41c8 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:10.865944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 238/472] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:54:10 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:54:10.867572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea683-1682-462d-a27c-27ddc83686b6 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:10.867843 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea683-1682-462d-a27c-27ddc83686b6 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:10.868117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea683-1682-462d-a27c-27ddc83686b6 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:10.872435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 239/473] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:10.872435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdea683-1682-462d-a27c-27ddc83686b6 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:10.898297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5e74f-7e59-45be-95cc-f7030d9f91cb None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:10.934089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:10.948162 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d51c7-066d-47e4-a363-c72dd8ed0c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:10.948928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d51c7-066d-47e4-a363-c72dd8ed0c58 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:10.949261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d51c7-066d-47e4-a363-c72dd8ed0c58 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:10.949577 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d51c7-066d-47e4-a363-c72dd8ed0c58 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:10.950376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d51c7-066d-47e4-a363-c72dd8ed0c58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:10.951990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d51c7-066d-47e4-a363-c72dd8ed0c58 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:10.988626 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 235/474] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:54:10 2022] POST /identity/v3/users => generated 248 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:54:10.996687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11cf49-eea8-435c-8e86-ed71172f3bf6 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:10.996687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11cf49-eea8-435c-8e86-ed71172f3bf6 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:10.996687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11cf49-eea8-435c-8e86-ed71172f3bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:11.022013 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ed11cf49-eea8-435c-8e86-ed71172f3bf6 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:11.023365 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ed11cf49-eea8-435c-8e86-ed71172f3bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:11.072499 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdea683-1682-462d-a27c-27ddc83686b6 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:11.077543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:11.135085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 236/475] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:11.156423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b26123-ee43-4976-b983-b6f4540465fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:11.157471 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b26123-ee43-4976-b983-b6f4540465fd None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:11.157907 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b26123-ee43-4976-b983-b6f4540465fd None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:11.158349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b26123-ee43-4976-b983-b6f4540465fd None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:11.159144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b26123-ee43-4976-b983-b6f4540465fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:11.159481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b26123-ee43-4976-b983-b6f4540465fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:11.161085 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b26123-ee43-4976-b983-b6f4540465fd None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:11.185597 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 240/476] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:11.193566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11cf49-eea8-435c-8e86-ed71172f3bf6 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:11.326681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11cf49-eea8-435c-8e86-ed71172f3bf6 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:11.344232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:11.379422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a946d5a-f39b-4c27-8208-832aeab056e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:11.380469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a946d5a-f39b-4c27-8208-832aeab056e3 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:11.380954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a946d5a-f39b-4c27-8208-832aeab056e3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:11.381416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a946d5a-f39b-4c27-8208-832aeab056e3 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:11.382380 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a946d5a-f39b-4c27-8208-832aeab056e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:11.383888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a946d5a-f39b-4c27-8208-832aeab056e3 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:11.415634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 237/477] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:54:11 2022] POST /identity/v3/users => generated 249 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:54:11.527497 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b26123-ee43-4976-b983-b6f4540465fd None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:11.753007 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b26123-ee43-4976-b983-b6f4540465fd None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:11.819922 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf73258-6108-40fb-bc87-0f065a3a34e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:11.821114 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf73258-6108-40fb-bc87-0f065a3a34e7 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:11.821606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf73258-6108-40fb-bc87-0f065a3a34e7 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:11.822146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf73258-6108-40fb-bc87-0f065a3a34e7 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:11.823366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf73258-6108-40fb-bc87-0f065a3a34e7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:11.826168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf73258-6108-40fb-bc87-0f065a3a34e7 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:11.842402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.sql.core [None req-eaf73258-6108-40fb-bc87-0f065a3a34e7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 12:54:11.842402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 07 12:54:11.842402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [parameters: {'id': '1142d0afac2849b8bff367a43699f987', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 07 12:54:11.842402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=104922) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 12:54:11.877148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-eaf73258-6108-40fb-bc87-0f065a3a34e7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 07 12:54:11.877148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:11.877148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:54:11.877148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 12:54:11.877148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:54:11.877148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 12:54:11.877148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:54:11.877148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 12:54:11.877148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:54:11.877148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application conn.query(q) Sep 07 12:54:11.877148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:54:11.877148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:54:11.877148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:54:11.877148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application result.read() Sep 07 12:54:11.877148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return ref.to_dict() Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 12:54:11.878347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application next(self.gen) Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application yield resource Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application next(self.gen) Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise self.value Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application session.commit() Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 12:54:11.879334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self.session.flush() Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application compat.raise_( Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 12:54:11.880628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:54:11.881730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application conn.query(q) Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application result.read() Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:54:11.882634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [parameters: {'id': '1142d0afac2849b8bff367a43699f987', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:11.883425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 07 12:54:11.884225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:11.886762 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 241/478] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Sep 7 12:54:11 2022] POST /identity/v3/roles => generated 144 bytes in 353 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:11.888608 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a946d5a-f39b-4c27-8208-832aeab056e3 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:12.053635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a946d5a-f39b-4c27-8208-832aeab056e3 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:12.118359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6408185-b5eb-4a0a-b88c-95644c5c30a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:12.119427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6408185-b5eb-4a0a-b88c-95644c5c30a3 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:12.119843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6408185-b5eb-4a0a-b88c-95644c5c30a3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:12.120268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6408185-b5eb-4a0a-b88c-95644c5c30a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:12.141893 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6408185-b5eb-4a0a-b88c-95644c5c30a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-d6408185-b5eb-4a0a-b88c-95644c5c30a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:12.155613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:12.157136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:12.158562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:12.158562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:12.158562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:12.158562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:12.158562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:12.158562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:12.158562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:12.158562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:12.158562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:12.158562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:12.158562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:54:12.158562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:12.163293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 238/479] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:54:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:12.170011 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf73258-6108-40fb-bc87-0f065a3a34e7 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:12.236263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:12.365156 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf73258-6108-40fb-bc87-0f065a3a34e7 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:12.422426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c74c5-65e6-49f8-8892-b62a6eeefbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:12.423089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c74c5-65e6-49f8-8892-b62a6eeefbaf None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:12.423371 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c74c5-65e6-49f8-8892-b62a6eeefbaf None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:12.423678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c74c5-65e6-49f8-8892-b62a6eeefbaf None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:12.424572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c74c5-65e6-49f8-8892-b62a6eeefbaf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:12.424919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c74c5-65e6-49f8-8892-b62a6eeefbaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:12.426458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c74c5-65e6-49f8-8892-b62a6eeefbaf None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:12.442079 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 242/480] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:13.772006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d134b-d637-4993-bbf0-f5b842430ba8 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:13.772006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d134b-d637-4993-bbf0-f5b842430ba8 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:13.772006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d134b-d637-4993-bbf0-f5b842430ba8 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:13.772006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 239/481] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:13.786648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b745fd-5fc8-4aaa-b888-8da44f5037cd None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:13.787178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b745fd-5fc8-4aaa-b888-8da44f5037cd None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:13.787287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b745fd-5fc8-4aaa-b888-8da44f5037cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:13.822845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-c7b745fd-5fc8-4aaa-b888-8da44f5037cd None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:13.824142 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c7b745fd-5fc8-4aaa-b888-8da44f5037cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:13.946671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 243/482] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:13.976096 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef9978-6dbc-49dc-8456-c7dffe8d0cbe None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:13.976564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef9978-6dbc-49dc-8456-c7dffe8d0cbe None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:13.976940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef9978-6dbc-49dc-8456-c7dffe8d0cbe None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:13.980105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 240/483] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:13.985612 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b432e-c0ad-48cd-b945-626076d1f1d8 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:13.986190 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b432e-c0ad-48cd-b945-626076d1f1d8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:13.986737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b432e-c0ad-48cd-b945-626076d1f1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:14.020956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-c44b432e-c0ad-48cd-b945-626076d1f1d8 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:14.022617 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c44b432e-c0ad-48cd-b945-626076d1f1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:14.055618 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:14.165649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 244/484] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:14.213320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006f428-4163-4f19-b558-2c6446237bbb None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:14.214209 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006f428-4163-4f19-b558-2c6446237bbb None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:14.214919 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006f428-4163-4f19-b558-2c6446237bbb None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:14.219887 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 241/485] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:14.225785 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c9044-5b58-4685-8c1e-9a47355a99b7 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:14.226101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c9044-5b58-4685-8c1e-9a47355a99b7 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:14.226331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c9044-5b58-4685-8c1e-9a47355a99b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:14.259328 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-196c9044-5b58-4685-8c1e-9a47355a99b7 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:14.260578 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-196c9044-5b58-4685-8c1e-9a47355a99b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:14.263152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006f428-4163-4f19-b558-2c6446237bbb None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:14.326712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:14.427424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 245/486] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:14.485257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006f428-4163-4f19-b558-2c6446237bbb None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:14.536547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c9044-5b58-4685-8c1e-9a47355a99b7 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:14.551465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f962e0c-758b-4e3d-baee-4632c5483c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:14.552127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f962e0c-758b-4e3d-baee-4632c5483c19 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:14.552421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f962e0c-758b-4e3d-baee-4632c5483c19 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:14.552698 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f962e0c-758b-4e3d-baee-4632c5483c19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:14.574851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f962e0c-758b-4e3d-baee-4632c5483c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-1f962e0c-758b-4e3d-baee-4632c5483c19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:14.580027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:14.581562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:14.583136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:14.583136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:14.583136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:14.583136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:14.583136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:14.583136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:14.583136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:14.583136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:14.583136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:14.583136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:14.583136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:14.583136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:14.583136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 242/487] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:14.593830 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f962e0c-758b-4e3d-baee-4632c5483c19 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:14.697305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:14.732656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c9044-5b58-4685-8c1e-9a47355a99b7 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:14.789180 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a241bc2-791d-495b-8392-1c1ed37ad381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:14.790187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a241bc2-791d-495b-8392-1c1ed37ad381 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:14.790321 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a241bc2-791d-495b-8392-1c1ed37ad381 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:14.790688 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a241bc2-791d-495b-8392-1c1ed37ad381 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:14.802613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:14.803981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a241bc2-791d-495b-8392-1c1ed37ad381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-0a241bc2-791d-495b-8392-1c1ed37ad381 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:14.809816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:14.811280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:14.813303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:14.813303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:14.813303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:14.813303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:14.813303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:14.813303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:14.813303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:14.813303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:14.813303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:14.813303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:14.813303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:14.813303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:14.813303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 246/488] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:14.825813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a241bc2-791d-495b-8392-1c1ed37ad381 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:14.837026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f962e0c-758b-4e3d-baee-4632c5483c19 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:14.894467 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc79c2-49e4-4009-9e09-fe73ba636fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:14.895200 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc79c2-49e4-4009-9e09-fe73ba636fcc None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:14.895540 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc79c2-49e4-4009-9e09-fe73ba636fcc None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:14.895874 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc79c2-49e4-4009-9e09-fe73ba636fcc None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:14.897112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc79c2-49e4-4009-9e09-fe73ba636fcc None admin] RBAC: Adding query filter params (name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:14.897112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc79c2-49e4-4009-9e09-fe73ba636fcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:14.898538 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc79c2-49e4-4009-9e09-fe73ba636fcc None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:14.908905 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 243/489] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:14.910041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc79c2-49e4-4009-9e09-fe73ba636fcc None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:14.958477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a241bc2-791d-495b-8392-1c1ed37ad381 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:15.003630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45473d-d156-4dba-8c80-3c2c971e6a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:15.004243 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45473d-d156-4dba-8c80-3c2c971e6a87 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:15.004575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45473d-d156-4dba-8c80-3c2c971e6a87 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:15.004915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45473d-d156-4dba-8c80-3c2c971e6a87 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:15.005587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45473d-d156-4dba-8c80-3c2c971e6a87 None admin] RBAC: Adding query filter params (name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:15.005883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45473d-d156-4dba-8c80-3c2c971e6a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:15.007295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45473d-d156-4dba-8c80-3c2c971e6a87 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:15.017416 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 247/490] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:15.022812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45473d-d156-4dba-8c80-3c2c971e6a87 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:15.022812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:15.052127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc79c2-49e4-4009-9e09-fe73ba636fcc None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:15.096551 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33639d5-8e8e-4f23-b4fa-141e1e8d5b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:15.097268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33639d5-8e8e-4f23-b4fa-141e1e8d5b03 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:15.097605 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33639d5-8e8e-4f23-b4fa-141e1e8d5b03 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:15.097984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33639d5-8e8e-4f23-b4fa-141e1e8d5b03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:15.115040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33639d5-8e8e-4f23-b4fa-141e1e8d5b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-c33639d5-8e8e-4f23-b4fa-141e1e8d5b03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:15.120992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:15.127503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:15.129448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:15.129448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:15.129448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:15.129448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:15.129448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:15.129448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:15.129448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:15.129448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:15.129448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:15.129448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:15.129448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:15.129448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:15.129448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 244/491] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:15.129448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ce4c0-2748-4774-99ed-6af1824e7dad None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:15.130539 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ce4c0-2748-4774-99ed-6af1824e7dad None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:15.130539 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ce4c0-2748-4774-99ed-6af1824e7dad None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:15.130539 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 245/492] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:15.130539 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ce4c0-2748-4774-99ed-6af1824e7dad None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:15.142427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:15.162777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45473d-d156-4dba-8c80-3c2c971e6a87 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:15.212506 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be4192-cf17-476c-9f10-7a7016c62583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:15.213154 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be4192-cf17-476c-9f10-7a7016c62583 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:15.213429 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be4192-cf17-476c-9f10-7a7016c62583 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:15.213699 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be4192-cf17-476c-9f10-7a7016c62583 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:15.226774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be4192-cf17-476c-9f10-7a7016c62583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:15.228305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be4192-cf17-476c-9f10-7a7016c62583 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-28be4192-cf17-476c-9f10-7a7016c62583 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:15.246753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:15.248068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:15.249581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:15.249581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:15.249581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:15.249581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 248/493] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:15.254201 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be4192-cf17-476c-9f10-7a7016c62583 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:15.295102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ce4c0-2748-4774-99ed-6af1824e7dad None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:15.321479 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:15.349366 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c486d-77cf-418d-b883-4b09009da175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:15.350255 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c486d-77cf-418d-b883-4b09009da175 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:15.350913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c486d-77cf-418d-b883-4b09009da175 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:15.350913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c486d-77cf-418d-b883-4b09009da175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:15.369741 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c486d-77cf-418d-b883-4b09009da175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:15.372288 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c486d-77cf-418d-b883-4b09009da175 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:15.394635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be4192-cf17-476c-9f10-7a7016c62583 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-4a6c486d-77cf-418d-b883-4b09009da175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:15.398428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:15.399377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:15.400236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:15.400236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:15.400236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:15.400236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 246/494] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:15.402005 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1bde8-5e51-435d-9ff0-e7ed6a161f9e None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:15.402496 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1bde8-5e51-435d-9ff0-e7ed6a161f9e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:15.402966 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1bde8-5e51-435d-9ff0-e7ed6a161f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:15.426543 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-d7b1bde8-5e51-435d-9ff0-e7ed6a161f9e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:15.427765 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d7b1bde8-5e51-435d-9ff0-e7ed6a161f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:15.450894 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad68358-3143-40b3-9df5-fb9692041131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:15.451524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad68358-3143-40b3-9df5-fb9692041131 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:15.451856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad68358-3143-40b3-9df5-fb9692041131 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:15.452131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad68358-3143-40b3-9df5-fb9692041131 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:15.452873 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad68358-3143-40b3-9df5-fb9692041131 None admin] RBAC: Adding query filter params (name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:15.453175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad68358-3143-40b3-9df5-fb9692041131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:15.454609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad68358-3143-40b3-9df5-fb9692041131 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:15.469328 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 249/495] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:15.469328 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad68358-3143-40b3-9df5-fb9692041131 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:15.516051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:15.538950 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 247/496] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:15.544670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1bde8-5e51-435d-9ff0-e7ed6a161f9e None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:15.631957 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad68358-3143-40b3-9df5-fb9692041131 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:15.654668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:15.688721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a2156-0ba2-46f8-9092-7f37872b9c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:15.690024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a2156-0ba2-46f8-9092-7f37872b9c1e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:15.690381 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a2156-0ba2-46f8-9092-7f37872b9c1e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:15.690701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a2156-0ba2-46f8-9092-7f37872b9c1e None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:15.692043 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a2156-0ba2-46f8-9092-7f37872b9c1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:15.692691 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a2156-0ba2-46f8-9092-7f37872b9c1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:15.694519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a2156-0ba2-46f8-9092-7f37872b9c1e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:15.715501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 250/497] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:15.715501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a2156-0ba2-46f8-9092-7f37872b9c1e None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:15.717920 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1bde8-5e51-435d-9ff0-e7ed6a161f9e None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:15.774677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbde4e-015e-4b24-8b9d-a30e5ff639ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:15.775314 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbde4e-015e-4b24-8b9d-a30e5ff639ba None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:15.775587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbde4e-015e-4b24-8b9d-a30e5ff639ba None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:15.775858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbde4e-015e-4b24-8b9d-a30e5ff639ba None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:15.776557 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbde4e-015e-4b24-8b9d-a30e5ff639ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:15.776955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbde4e-015e-4b24-8b9d-a30e5ff639ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:15.778822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbde4e-015e-4b24-8b9d-a30e5ff639ba None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:15.796853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 248/498] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:15.796853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c60d18-af04-4daa-a81f-8715353eee25 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:15.796853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c60d18-af04-4daa-a81f-8715353eee25 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:15.796853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c60d18-af04-4daa-a81f-8715353eee25 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:15.796853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 249/499] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:15.797989 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c60d18-af04-4daa-a81f-8715353eee25 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:15.860605 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a2156-0ba2-46f8-9092-7f37872b9c1e None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:15.880602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:15.909708 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2556-b31f-40e4-a754-cc5e28354cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:15.910734 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2556-b31f-40e4-a754-cc5e28354cf6 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:15.911220 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2556-b31f-40e4-a754-cc5e28354cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:15.911712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2556-b31f-40e4-a754-cc5e28354cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:15.929305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d2556-b31f-40e4-a754-cc5e28354cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:15.930809 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d2556-b31f-40e4-a754-cc5e28354cf6 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:15.943147 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c60d18-af04-4daa-a81f-8715353eee25 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-b90d2556-b31f-40e4-a754-cc5e28354cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:15.952944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:15.953946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:15.954829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:15.954829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:15.954829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:15.954829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 251/500] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:15.955050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2556-b31f-40e4-a754-cc5e28354cf6 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:15.986414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4dd4a4-cfba-4473-bfc9-6316fca1695d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:15.988056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dd4a4-cfba-4473-bfc9-6316fca1695d None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:15.988503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dd4a4-cfba-4473-bfc9-6316fca1695d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:15.988783 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dd4a4-cfba-4473-bfc9-6316fca1695d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:15.991198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:15.997219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4dd4a4-cfba-4473-bfc9-6316fca1695d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:15.998997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4dd4a4-cfba-4473-bfc9-6316fca1695d None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-bc4dd4a4-cfba-4473-bfc9-6316fca1695d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:16.015215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:16.016242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:16.017185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:16.017185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:16.017185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:16.017185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:16.017185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:16.017185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:16.017185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:16.017185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:16.017185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:54:16.017185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:16.017185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 250/501] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:16.017876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d412f-a3aa-4d78-9f36-4f5420483260 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:16.017876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d412f-a3aa-4d78-9f36-4f5420483260 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:16.018797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d412f-a3aa-4d78-9f36-4f5420483260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:16.038308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-dd5d412f-a3aa-4d78-9f36-4f5420483260 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:16.039514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-dd5d412f-a3aa-4d78-9f36-4f5420483260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:16.089826 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2556-b31f-40e4-a754-cc5e28354cf6 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:16.136323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d0839-89bc-4626-b079-dd6f6ac51367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:16.136986 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d0839-89bc-4626-b079-dd6f6ac51367 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:16.137263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d0839-89bc-4626-b079-dd6f6ac51367 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:16.137534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d0839-89bc-4626-b079-dd6f6ac51367 None admin] PATH_INFO: `/v3/users/nova` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:16.138429 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 251/502] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:16.140698 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d412f-a3aa-4d78-9f36-4f5420483260 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:16.157683 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d0839-89bc-4626-b079-dd6f6ac51367 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:16.159429 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d0839-89bc-4626-b079-dd6f6ac51367 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-ee2d0839-89bc-4626-b079-dd6f6ac51367 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:16.175786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:16.176855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:16.177860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:16.177860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:16.177860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:16.177860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:16.177860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:16.177860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:16.177860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:16.177860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:16.177860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:54:16.177860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:16.177860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 252/503] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Sep 7 12:54:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:16.177860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d0839-89bc-4626-b079-dd6f6ac51367 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:16.210021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:16.292717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d412f-a3aa-4d78-9f36-4f5420483260 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:16.309086 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:16.331061 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d0839-89bc-4626-b079-dd6f6ac51367 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:16.338650 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e2060-6cb8-4637-83a2-574e33d883de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:16.339302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e2060-6cb8-4637-83a2-574e33d883de None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:16.339580 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e2060-6cb8-4637-83a2-574e33d883de None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:16.339832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e2060-6cb8-4637-83a2-574e33d883de None admin] PATH_INFO: `/v3/roles/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:16.352870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e2060-6cb8-4637-83a2-574e33d883de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-579e2060-6cb8-4637-83a2-574e33d883de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:16.358246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:16.359160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:16.361020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:16.361020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:16.361020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:16.361020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:16.361020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:16.361020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:16.361020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:16.361020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:16.361020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:16.361020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:16.361020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:16.361020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:16.361020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 252/504] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:16.362025 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e2060-6cb8-4637-83a2-574e33d883de None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:16.392312 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382c903-26f9-4b93-865a-3bc747b657d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:16.393160 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382c903-26f9-4b93-865a-3bc747b657d6 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:16.393527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382c903-26f9-4b93-865a-3bc747b657d6 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:16.394045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382c903-26f9-4b93-865a-3bc747b657d6 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:16.394435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382c903-26f9-4b93-865a-3bc747b657d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:16.394744 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382c903-26f9-4b93-865a-3bc747b657d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:16.396203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382c903-26f9-4b93-865a-3bc747b657d6 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:16.416046 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 253/505] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:16.417071 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382c903-26f9-4b93-865a-3bc747b657d6 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:16.505923 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e2060-6cb8-4637-83a2-574e33d883de None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:16.507895 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:16.555021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b842c2c-75fa-4b26-a4dc-b0a17fc13d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:16.555474 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b842c2c-75fa-4b26-a4dc-b0a17fc13d3f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:16.555759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b842c2c-75fa-4b26-a4dc-b0a17fc13d3f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:16.556049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b842c2c-75fa-4b26-a4dc-b0a17fc13d3f None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:16.557216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b842c2c-75fa-4b26-a4dc-b0a17fc13d3f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:16.557216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b842c2c-75fa-4b26-a4dc-b0a17fc13d3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:16.558753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b842c2c-75fa-4b26-a4dc-b0a17fc13d3f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:16.559799 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382c903-26f9-4b93-865a-3bc747b657d6 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:16.601619 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 253/506] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Sep 7 12:54:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:16.602523 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b842c2c-75fa-4b26-a4dc-b0a17fc13d3f None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:16.604881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddb608-d2ac-4243-a401-74f8d99b323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:16.605516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb608-d2ac-4243-a401-74f8d99b323d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:16.605793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb608-d2ac-4243-a401-74f8d99b323d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:16.606087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb608-d2ac-4243-a401-74f8d99b323d None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:16.606852 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddb608-d2ac-4243-a401-74f8d99b323d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:16.607149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddb608-d2ac-4243-a401-74f8d99b323d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:16.608727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddb608-d2ac-4243-a401-74f8d99b323d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:16.655503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 254/507] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Sep 7 12:54:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:16.656408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddb608-d2ac-4243-a401-74f8d99b323d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:16.673171 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:16.746896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b842c2c-75fa-4b26-a4dc-b0a17fc13d3f None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:16.791249 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914ecdb-b111-4909-9aed-f9e3dfa14efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:16.791792 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914ecdb-b111-4909-9aed-f9e3dfa14efe None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:16.792069 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914ecdb-b111-4909-9aed-f9e3dfa14efe None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:16.792340 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914ecdb-b111-4909-9aed-f9e3dfa14efe None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:16.793066 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914ecdb-b111-4909-9aed-f9e3dfa14efe None admin] RBAC: Adding query filter params (name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:16.793396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914ecdb-b111-4909-9aed-f9e3dfa14efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:16.794961 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914ecdb-b111-4909-9aed-f9e3dfa14efe None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:16.796029 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddb608-d2ac-4243-a401-74f8d99b323d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:16.805291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 254/508] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:16.806161 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914ecdb-b111-4909-9aed-f9e3dfa14efe None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:16.834837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:16.845151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb020b4-a0e0-43d4-9614-b4e82de1878b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:16.845966 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb020b4-a0e0-43d4-9614-b4e82de1878b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:16.846357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb020b4-a0e0-43d4-9614-b4e82de1878b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:16.846812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb020b4-a0e0-43d4-9614-b4e82de1878b None admin] PATH_INFO: `/v3/users/glance` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:16.857759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb020b4-a0e0-43d4-9614-b4e82de1878b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:16.859277 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb020b4-a0e0-43d4-9614-b4e82de1878b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-9cb020b4-a0e0-43d4-9614-b4e82de1878b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:16.875742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:16.877572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:16.879181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:16.879181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:16.879181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:16.879181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:16.879181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:16.879181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:16.879181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:16.879181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:16.879181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:54:16.879181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:16.879181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 255/509] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:16.879181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb020b4-a0e0-43d4-9614-b4e82de1878b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:16.940860 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914ecdb-b111-4909-9aed-f9e3dfa14efe None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:16.955899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:16.981588 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bafb9-10d6-4f15-a3b7-0a50a4067dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:16.982240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bafb9-10d6-4f15-a3b7-0a50a4067dff None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:16.982519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bafb9-10d6-4f15-a3b7-0a50a4067dff None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:16.982791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bafb9-10d6-4f15-a3b7-0a50a4067dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:16.999634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bafb9-10d6-4f15-a3b7-0a50a4067dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:17.001804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bafb9-10d6-4f15-a3b7-0a50a4067dff None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:17.002575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb020b4-a0e0-43d4-9614-b4e82de1878b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-639bafb9-10d6-4f15-a3b7-0a50a4067dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:17.016566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:17.017573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:17.018462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:17.018462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:17.018462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:17.018462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 255/510] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:17.018689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bafb9-10d6-4f15-a3b7-0a50a4067dff None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:17.047595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b564b5-0bf1-4580-9941-cdc02be748f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:17.048590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b564b5-0bf1-4580-9941-cdc02be748f8 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:17.049148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b564b5-0bf1-4580-9941-cdc02be748f8 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:17.049638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b564b5-0bf1-4580-9941-cdc02be748f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:17.116897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:17.132006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b564b5-0bf1-4580-9941-cdc02be748f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:17.133535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b564b5-0bf1-4580-9941-cdc02be748f8 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:17.151705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bafb9-10d6-4f15-a3b7-0a50a4067dff None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:17.190640 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b043a8a-59f7-4003-8d7f-799309670ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:17.191267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b043a8a-59f7-4003-8d7f-799309670ed6 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:17.191542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b043a8a-59f7-4003-8d7f-799309670ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:17.191807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b043a8a-59f7-4003-8d7f-799309670ed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:17.216010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:17.265155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 256/511] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:17.266021 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b564b5-0bf1-4580-9941-cdc02be748f8 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:17.277162 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b043a8a-59f7-4003-8d7f-799309670ed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:17.279014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b043a8a-59f7-4003-8d7f-799309670ed6 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:17.366047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:17.393910 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b564b5-0bf1-4580-9941-cdc02be748f8 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:17.409227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 256/512] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:17.409227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b043a8a-59f7-4003-8d7f-799309670ed6 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:17.444569 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7403e2-c012-4117-882c-6743b300a87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:17.445227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7403e2-c012-4117-882c-6743b300a87d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:17.445507 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7403e2-c012-4117-882c-6743b300a87d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:17.445778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7403e2-c012-4117-882c-6743b300a87d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:17.456886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7403e2-c012-4117-882c-6743b300a87d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:17.458427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7403e2-c012-4117-882c-6743b300a87d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-ef7403e2-c012-4117-882c-6743b300a87d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:17.475759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:17.476810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:17.477668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:17.477668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:17.477668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:17.477668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 257/513] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:17.477892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7403e2-c012-4117-882c-6743b300a87d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:17.503588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:17.538312 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b043a8a-59f7-4003-8d7f-799309670ed6 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:17.577909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761c361-b904-4e02-9dc6-a321bf77d53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:17.578443 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761c361-b904-4e02-9dc6-a321bf77d53b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:17.578696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761c361-b904-4e02-9dc6-a321bf77d53b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:17.578968 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761c361-b904-4e02-9dc6-a321bf77d53b None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:17.580113 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761c361-b904-4e02-9dc6-a321bf77d53b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:17.580656 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761c361-b904-4e02-9dc6-a321bf77d53b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:17.583177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761c361-b904-4e02-9dc6-a321bf77d53b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:17.594589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7403e2-c012-4117-882c-6743b300a87d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:17.610756 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 257/514] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Sep 7 12:54:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:17.611727 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761c361-b904-4e02-9dc6-a321bf77d53b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:17.638801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0aa49-0f5e-4a2f-bfa0-cff3e85e308c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:17.639307 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0aa49-0f5e-4a2f-bfa0-cff3e85e308c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:17.639586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0aa49-0f5e-4a2f-bfa0-cff3e85e308c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:17.639856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0aa49-0f5e-4a2f-bfa0-cff3e85e308c None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:17.640544 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0aa49-0f5e-4a2f-bfa0-cff3e85e308c None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:17.640846 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0aa49-0f5e-4a2f-bfa0-cff3e85e308c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:17.642243 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0aa49-0f5e-4a2f-bfa0-cff3e85e308c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:17.648531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:17.657209 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 258/515] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:17.658423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0aa49-0f5e-4a2f-bfa0-cff3e85e308c None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:17.728156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761c361-b904-4e02-9dc6-a321bf77d53b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:17.755424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:17.774614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63db371-1994-4465-bd62-3182f94b56d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:17.775725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63db371-1994-4465-bd62-3182f94b56d8 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:17.776280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63db371-1994-4465-bd62-3182f94b56d8 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:17.776735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63db371-1994-4465-bd62-3182f94b56d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:17.781899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0aa49-0f5e-4a2f-bfa0-cff3e85e308c None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:17.789959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63db371-1994-4465-bd62-3182f94b56d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:17.793872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63db371-1994-4465-bd62-3182f94b56d8 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-e63db371-1994-4465-bd62-3182f94b56d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:17.807377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:17.808475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:17.810454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:17.810454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:17.810454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:17.810454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 258/516] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:17.810454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63db371-1994-4465-bd62-3182f94b56d8 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:17.827655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe0bc5-b11a-416d-a8d3-8f1fbd9480da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:17.828305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe0bc5-b11a-416d-a8d3-8f1fbd9480da None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:17.828613 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe0bc5-b11a-416d-a8d3-8f1fbd9480da None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:17.828879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe0bc5-b11a-416d-a8d3-8f1fbd9480da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:17.842450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe0bc5-b11a-416d-a8d3-8f1fbd9480da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:17.843958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe0bc5-b11a-416d-a8d3-8f1fbd9480da None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-9dbe0bc5-b11a-416d-a8d3-8f1fbd9480da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:17.864462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:17.865616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:17.866477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:17.866477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:17.866477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:17.866477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 259/517] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:17.867866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe0bc5-b11a-416d-a8d3-8f1fbd9480da None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:17.916548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:17.940269 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63db371-1994-4465-bd62-3182f94b56d8 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:17.982195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dc38d-8d23-4684-aba2-ce68544fd050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:17.983818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dc38d-8d23-4684-aba2-ce68544fd050 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:17.983818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dc38d-8d23-4684-aba2-ce68544fd050 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:17.983818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dc38d-8d23-4684-aba2-ce68544fd050 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:17.984213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe0bc5-b11a-416d-a8d3-8f1fbd9480da None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:17.984766 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dc38d-8d23-4684-aba2-ce68544fd050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:17.984766 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dc38d-8d23-4684-aba2-ce68544fd050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:17.985483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dc38d-8d23-4684-aba2-ce68544fd050 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:17.997944 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 259/518] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:17.998809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dc38d-8d23-4684-aba2-ce68544fd050 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:18.017162 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:18.030621 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c52c7-370d-4e96-941c-6a274726b85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:18.031239 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c52c7-370d-4e96-941c-6a274726b85d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:18.031516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c52c7-370d-4e96-941c-6a274726b85d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:18.031782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c52c7-370d-4e96-941c-6a274726b85d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:18.113231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c52c7-370d-4e96-941c-6a274726b85d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:18.114879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c52c7-370d-4e96-941c-6a274726b85d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:18.119281 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dc38d-8d23-4684-aba2-ce68544fd050 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:18.159924 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf368d-97a7-4e5b-83df-8ee8e3bf1119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:18.160579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf368d-97a7-4e5b-83df-8ee8e3bf1119 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:18.160858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf368d-97a7-4e5b-83df-8ee8e3bf1119 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:18.161118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf368d-97a7-4e5b-83df-8ee8e3bf1119 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:18.161775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf368d-97a7-4e5b-83df-8ee8e3bf1119 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:18.163247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf368d-97a7-4e5b-83df-8ee8e3bf1119 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:18.181134 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:18.186399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 260/519] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:54:17 2022] POST /identity/v3/users => generated 247 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:54:18.187115 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf368d-97a7-4e5b-83df-8ee8e3bf1119 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:18.259898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 260/520] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:18.259898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c52c7-370d-4e96-941c-6a274726b85d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:18.306940 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:18.385723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf368d-97a7-4e5b-83df-8ee8e3bf1119 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:18.420608 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c52c7-370d-4e96-941c-6a274726b85d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:18.453998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502475a9-5bc0-4f85-a0c1-c1d1fa7f07ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:18.454916 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502475a9-5bc0-4f85-a0c1-c1d1fa7f07ca None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:18.455423 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502475a9-5bc0-4f85-a0c1-c1d1fa7f07ca None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:18.455886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502475a9-5bc0-4f85-a0c1-c1d1fa7f07ca None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:18.457112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502475a9-5bc0-4f85-a0c1-c1d1fa7f07ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:18.457603 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502475a9-5bc0-4f85-a0c1-c1d1fa7f07ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:18.459728 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502475a9-5bc0-4f85-a0c1-c1d1fa7f07ca None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:18.476763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 261/521] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:18.477628 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502475a9-5bc0-4f85-a0c1-c1d1fa7f07ca None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:18.483193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37553d-5cc8-48cc-8d40-c4bf441b90e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:18.483829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37553d-5cc8-48cc-8d40-c4bf441b90e8 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:18.484106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37553d-5cc8-48cc-8d40-c4bf441b90e8 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:18.484405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37553d-5cc8-48cc-8d40-c4bf441b90e8 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:18.485057 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37553d-5cc8-48cc-8d40-c4bf441b90e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:18.485359 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37553d-5cc8-48cc-8d40-c4bf441b90e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:18.486847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37553d-5cc8-48cc-8d40-c4bf441b90e8 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:18.507418 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 261/522] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:18.509473 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37553d-5cc8-48cc-8d40-c4bf441b90e8 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:18.572549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:18.641975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:18.652268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502475a9-5bc0-4f85-a0c1-c1d1fa7f07ca None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:18.656191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37553d-5cc8-48cc-8d40-c4bf441b90e8 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:18.698237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bde9e-6b23-48c1-a329-9a9b036fb0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:18.699269 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bde9e-6b23-48c1-a329-9a9b036fb0d9 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:18.700047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bde9e-6b23-48c1-a329-9a9b036fb0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:18.700047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bde9e-6b23-48c1-a329-9a9b036fb0d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:18.715772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bde9e-6b23-48c1-a329-9a9b036fb0d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:18.717223 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bde9e-6b23-48c1-a329-9a9b036fb0d9 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:18.721363 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbf611-0c96-48f1-8be9-f8fbddbcce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:18.722458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbf611-0c96-48f1-8be9-f8fbddbcce1f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:18.722948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbf611-0c96-48f1-8be9-f8fbddbcce1f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:18.723415 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbf611-0c96-48f1-8be9-f8fbddbcce1f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-fd9bde9e-6b23-48c1-a329-9a9b036fb0d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:18.733262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:18.734286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:18.735210 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:18.735210 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:18.735210 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:18.736878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 262/523] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:18.737789 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbf611-0c96-48f1-8be9-f8fbddbcce1f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:18.739615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bde9e-6b23-48c1-a329-9a9b036fb0d9 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:18.740629 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbf611-0c96-48f1-8be9-f8fbddbcce1f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-3dbbf611-0c96-48f1-8be9-f8fbddbcce1f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:18.763971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:18.765026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:18.765958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:18.765958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:18.765958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:18.765958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:18.765958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:18.765958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:18.765958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:18.765958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:18.765958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:54:18.765958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:18.765958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 262/524] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:18.767897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbf611-0c96-48f1-8be9-f8fbddbcce1f None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:18.893789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bde9e-6b23-48c1-a329-9a9b036fb0d9 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:18.937582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e045f-35e3-4363-bb04-4ebb68d2203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:18.938239 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e045f-35e3-4363-bb04-4ebb68d2203a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:18.938519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e045f-35e3-4363-bb04-4ebb68d2203a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:18.938794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e045f-35e3-4363-bb04-4ebb68d2203a None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:18.939875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbf611-0c96-48f1-8be9-f8fbddbcce1f None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:18.949251 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e045f-35e3-4363-bb04-4ebb68d2203a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:18.950793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e045f-35e3-4363-bb04-4ebb68d2203a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:18.967727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-0c0e045f-35e3-4363-bb04-4ebb68d2203a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:18.967727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:18.967727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:18.967727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:18.967727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:18.967727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:18.967727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:18.967727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:18.967727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:18.967727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:18.967727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:18.967727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:18.967727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:18.967727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:18.967727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:18.968892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:18.975564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:18.975564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:18.975564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:18.975564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:18.975564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:18.975564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:18.975564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:18.975564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:18.975564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 263/525] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:18.975564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e045f-35e3-4363-bb04-4ebb68d2203a None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:18.977160 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:18.977382 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:19.001677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff283f4-bc1a-4577-867f-09385d6dc8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:19.003172 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff283f4-bc1a-4577-867f-09385d6dc8bf None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:19.003448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff283f4-bc1a-4577-867f-09385d6dc8bf None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:19.003721 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff283f4-bc1a-4577-867f-09385d6dc8bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:19.013164 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff283f4-bc1a-4577-867f-09385d6dc8bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:19.015376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff283f4-bc1a-4577-867f-09385d6dc8bf None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:19.035047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-cff283f4-bc1a-4577-867f-09385d6dc8bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:19.035047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:19.035047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:19.035047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:19.035047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:19.035047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:19.035047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:19.035047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:19.035047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:19.035047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:19.035047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:19.035047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:19.035047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:19.035047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:19.035047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:19.036747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:19.038434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:19.038434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:19.038434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:19.038434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:19.038434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:19.038434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:19.038434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:19.038434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:19.039407 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 263/526] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:19.040329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff283f4-bc1a-4577-867f-09385d6dc8bf None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:19.105364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e045f-35e3-4363-bb04-4ebb68d2203a None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:19.155859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e61cf-3cb8-46dc-b9ba-f84e5374052d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:19.156863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e61cf-3cb8-46dc-b9ba-f84e5374052d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:19.157312 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e61cf-3cb8-46dc-b9ba-f84e5374052d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:19.157770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e61cf-3cb8-46dc-b9ba-f84e5374052d None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:19.159962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e61cf-3cb8-46dc-b9ba-f84e5374052d None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:19.160492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e61cf-3cb8-46dc-b9ba-f84e5374052d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:19.162892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e61cf-3cb8-46dc-b9ba-f84e5374052d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:19.186281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 264/527] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:19.187823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e61cf-3cb8-46dc-b9ba-f84e5374052d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:19.203637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff283f4-bc1a-4577-867f-09385d6dc8bf None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:19.258615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef21182-5b9d-474e-be54-26d0e781f477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:19.259615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef21182-5b9d-474e-be54-26d0e781f477 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:19.260059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef21182-5b9d-474e-be54-26d0e781f477 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:19.260526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef21182-5b9d-474e-be54-26d0e781f477 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:19.261874 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef21182-5b9d-474e-be54-26d0e781f477 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:19.264896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef21182-5b9d-474e-be54-26d0e781f477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:19.264896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef21182-5b9d-474e-be54-26d0e781f477 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:19.281590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:19.289513 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 264/528] 10.222.0.30 () {56 vars in 1139 bytes} [Wed Sep 7 12:54:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:19.290981 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef21182-5b9d-474e-be54-26d0e781f477 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:19.344518 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:19.349202 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e61cf-3cb8-46dc-b9ba-f84e5374052d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:19.397214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fec6d-0f97-496d-8483-adab07f3eb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:19.397845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fec6d-0f97-496d-8483-adab07f3eb93 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:19.398120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fec6d-0f97-496d-8483-adab07f3eb93 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:19.398385 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fec6d-0f97-496d-8483-adab07f3eb93 None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:19.399090 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459fec6d-0f97-496d-8483-adab07f3eb93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:19.399516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459fec6d-0f97-496d-8483-adab07f3eb93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:19.401064 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459fec6d-0f97-496d-8483-adab07f3eb93 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:19.422738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 265/529] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:19.423615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fec6d-0f97-496d-8483-adab07f3eb93 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:19.442736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef21182-5b9d-474e-be54-26d0e781f477 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:19.498062 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c040522-2ac5-4dbb-916c-8508a96f8664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:19.498533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c040522-2ac5-4dbb-916c-8508a96f8664 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:19.498801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c040522-2ac5-4dbb-916c-8508a96f8664 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:19.499069 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c040522-2ac5-4dbb-916c-8508a96f8664 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:19.499984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c040522-2ac5-4dbb-916c-8508a96f8664 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:19.500519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c040522-2ac5-4dbb-916c-8508a96f8664 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:19.503015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c040522-2ac5-4dbb-916c-8508a96f8664 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:19.536347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 265/530] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:19.536347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c040522-2ac5-4dbb-916c-8508a96f8664 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:19.603494 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fec6d-0f97-496d-8483-adab07f3eb93 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:19.631100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:19.656092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713df6a5-1762-4f8f-af98-68fb0adac47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:19.657004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713df6a5-1762-4f8f-af98-68fb0adac47a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:19.657512 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713df6a5-1762-4f8f-af98-68fb0adac47a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:19.658054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713df6a5-1762-4f8f-af98-68fb0adac47a None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:19.670889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713df6a5-1762-4f8f-af98-68fb0adac47a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:19.673482 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713df6a5-1762-4f8f-af98-68fb0adac47a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:19.688570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-713df6a5-1762-4f8f-af98-68fb0adac47a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:19.688570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:19.688570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:19.688570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:19.688570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:19.688570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:19.688570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:19.688570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:19.688570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:19.688570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:19.688570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:19.688570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:19.688570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:19.688570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:19.688570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:19.689825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:19.696523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:19.696523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:19.696523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:19.696523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:19.696523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:19.696523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:19.696523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:19.696523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:19.696523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 266/531] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:19.696523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713df6a5-1762-4f8f-af98-68fb0adac47a None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:19.701194 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:19.708139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c040522-2ac5-4dbb-916c-8508a96f8664 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:19.761878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1701e49-71db-4ffa-b4b5-a002a52a1224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:19.762725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1701e49-71db-4ffa-b4b5-a002a52a1224 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:19.764401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1701e49-71db-4ffa-b4b5-a002a52a1224 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:19.764761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1701e49-71db-4ffa-b4b5-a002a52a1224 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:19.837628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713df6a5-1762-4f8f-af98-68fb0adac47a None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:19.859879 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1701e49-71db-4ffa-b4b5-a002a52a1224 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:19.861454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1701e49-71db-4ffa-b4b5-a002a52a1224 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:19.888520 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d5b5f-eb65-4d44-b600-1aba43156795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:19.889311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d5b5f-eb65-4d44-b600-1aba43156795 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:19.889596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d5b5f-eb65-4d44-b600-1aba43156795 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:19.889941 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d5b5f-eb65-4d44-b600-1aba43156795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:19.890809 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d5b5f-eb65-4d44-b600-1aba43156795 None admin] RBAC: Adding query filter params (role.id=6c9336a73ed74d66a83c59fb3269efd5, scope.project.id=3381c0688581489b903e641f91914839, user.id=4089419bb88e4aeda23bf141370cb6e7) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:19.891123 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d5b5f-eb65-4d44-b600-1aba43156795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:19.892963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d5b5f-eb65-4d44-b600-1aba43156795 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:19.904695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 267/532] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:19 2022] GET /identity/v3/role_assignments?user.id=4089419bb88e4aeda23bf141370cb6e7&scope.project.id=3381c0688581489b903e641f91914839&role.id=6c9336a73ed74d66a83c59fb3269efd5 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:19.906655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d5b5f-eb65-4d44-b600-1aba43156795 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:20.000917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:20.034906 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:20.042694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 266/533] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:20.044176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1701e49-71db-4ffa-b4b5-a002a52a1224 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:20.096615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d5b5f-eb65-4d44-b600-1aba43156795 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:20.150448 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c5410-9509-48b2-9e9b-104af845958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:20.151096 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c5410-9509-48b2-9e9b-104af845958b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:20.151338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c5410-9509-48b2-9e9b-104af845958b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:20.151618 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c5410-9509-48b2-9e9b-104af845958b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:20.152505 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c5410-9509-48b2-9e9b-104af845958b None admin] RBAC: Adding query filter params (role.id=6c9336a73ed74d66a83c59fb3269efd5, scope.project.id=3381c0688581489b903e641f91914839, user.id=fbe8fa8ab8094aa69933398280810692) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:20.152790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c5410-9509-48b2-9e9b-104af845958b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:20.154335 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c5410-9509-48b2-9e9b-104af845958b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:20.169241 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 268/534] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:19 2022] GET /identity/v3/role_assignments?user.id=fbe8fa8ab8094aa69933398280810692&scope.project.id=3381c0688581489b903e641f91914839&role.id=6c9336a73ed74d66a83c59fb3269efd5 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:20.169241 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c5410-9509-48b2-9e9b-104af845958b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:20.286384 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1701e49-71db-4ffa-b4b5-a002a52a1224 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:20.383142 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274a80a-d786-4d84-ad7a-3020c48becba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:20.383685 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274a80a-d786-4d84-ad7a-3020c48becba None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:20.383970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274a80a-d786-4d84-ad7a-3020c48becba None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:20.384303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274a80a-d786-4d84-ad7a-3020c48becba None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:20.385055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274a80a-d786-4d84-ad7a-3020c48becba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:20.388345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274a80a-d786-4d84-ad7a-3020c48becba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:20.391100 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274a80a-d786-4d84-ad7a-3020c48becba None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:20.416923 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 267/535] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:20.418506 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274a80a-d786-4d84-ad7a-3020c48becba None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:20.421871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c5410-9509-48b2-9e9b-104af845958b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:20.443412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:20.493892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:20.504055 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd5c73-895a-49da-86d1-1d73b7777acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:20.505121 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd5c73-895a-49da-86d1-1d73b7777acb None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:20.505602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd5c73-895a-49da-86d1-1d73b7777acb None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:20.506073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd5c73-895a-49da-86d1-1d73b7777acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:20.542373 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274a80a-d786-4d84-ad7a-3020c48becba None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:20.543141 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd5c73-895a-49da-86d1-1d73b7777acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:20.545735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd5c73-895a-49da-86d1-1d73b7777acb None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-b1bd5c73-895a-49da-86d1-1d73b7777acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:20.574174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:20.575137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:20.575966 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:20.575966 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:20.575966 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:20.577972 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 269/536] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:20.590279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd5c73-895a-49da-86d1-1d73b7777acb None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:20.619995 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede1b55-62bb-4a3a-9b80-f23b9c08cddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:20.622423 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede1b55-62bb-4a3a-9b80-f23b9c08cddc None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:20.623215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede1b55-62bb-4a3a-9b80-f23b9c08cddc None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:20.623809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede1b55-62bb-4a3a-9b80-f23b9c08cddc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:20.626174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede1b55-62bb-4a3a-9b80-f23b9c08cddc None admin] RBAC: Adding query filter params (role.id=6c9336a73ed74d66a83c59fb3269efd5, scope.project.id=3381c0688581489b903e641f91914839, user.id=f332ac2346f0444a8d336ed2b3121be2) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:20.627439 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede1b55-62bb-4a3a-9b80-f23b9c08cddc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:20.631652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede1b55-62bb-4a3a-9b80-f23b9c08cddc None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:20.647862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 268/537] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:20 2022] GET /identity/v3/role_assignments?user.id=f332ac2346f0444a8d336ed2b3121be2&scope.project.id=3381c0688581489b903e641f91914839&role.id=6c9336a73ed74d66a83c59fb3269efd5 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:20.779104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd5c73-895a-49da-86d1-1d73b7777acb None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:20.848239 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c3757-82f7-4d4b-8170-31395ff7f8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:20.849134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c3757-82f7-4d4b-8170-31395ff7f8c2 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:20.849559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c3757-82f7-4d4b-8170-31395ff7f8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:20.849968 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c3757-82f7-4d4b-8170-31395ff7f8c2 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:20.852002 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c3757-82f7-4d4b-8170-31395ff7f8c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:20.852834 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c3757-82f7-4d4b-8170-31395ff7f8c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:20.855756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c3757-82f7-4d4b-8170-31395ff7f8c2 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:20.878866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 270/538] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:20.885359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede1b55-62bb-4a3a-9b80-f23b9c08cddc None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:20.949786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de6185-ebe8-49a7-8a5b-05cc9030f6f8 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:20.950436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de6185-ebe8-49a7-8a5b-05cc9030f6f8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:20.950915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de6185-ebe8-49a7-8a5b-05cc9030f6f8 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:20.952802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 271/539] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:20.959155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a519645-6636-4865-8e4f-3bdc69fd345e None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:20.959786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a519645-6636-4865-8e4f-3bdc69fd345e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:20.960253 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a519645-6636-4865-8e4f-3bdc69fd345e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:21.001496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-8a519645-6636-4865-8e4f-3bdc69fd345e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:21.003246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8a519645-6636-4865-8e4f-3bdc69fd345e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:21.025105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede1b55-62bb-4a3a-9b80-f23b9c08cddc None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:21.047678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:21.056186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:21.075670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fb413-2b2d-4675-bf77-e13e852b2089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:21.076338 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fb413-2b2d-4675-bf77-e13e852b2089 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:21.076705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fb413-2b2d-4675-bf77-e13e852b2089 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:21.076987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fb413-2b2d-4675-bf77-e13e852b2089 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:21.097657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fb413-2b2d-4675-bf77-e13e852b2089 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:21.099726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fb413-2b2d-4675-bf77-e13e852b2089 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:21.133878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-3a6fb413-2b2d-4675-bf77-e13e852b2089 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:21.133878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:21.133878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:21.133878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:21.133878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:21.133878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:21.133878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:21.133878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:21.133878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:21.133878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:21.133878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:21.133878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:21.133878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:21.133878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:21.133878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:21.134838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:21.135666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:21.135666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:21.135666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:21.135666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:21.135666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:21.135666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:21.135666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:21.135666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:21.135666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 269/540] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:21.142064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fb413-2b2d-4675-bf77-e13e852b2089 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:21.189872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 272/541] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:21.320969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fb413-2b2d-4675-bf77-e13e852b2089 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:21.370534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeaf33-1c88-452e-8b37-6843d93aaa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:21.371221 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeaf33-1c88-452e-8b37-6843d93aaa07 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:21.371500 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeaf33-1c88-452e-8b37-6843d93aaa07 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:21.371808 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeaf33-1c88-452e-8b37-6843d93aaa07 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:21.372595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aeaf33-1c88-452e-8b37-6843d93aaa07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:21.373196 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aeaf33-1c88-452e-8b37-6843d93aaa07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:21.374715 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aeaf33-1c88-452e-8b37-6843d93aaa07 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:21.394940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 270/542] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:21.401393 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a519645-6636-4865-8e4f-3bdc69fd345e None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:21.558276 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a519645-6636-4865-8e4f-3bdc69fd345e None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:21.611466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aaab8-5b65-4f8d-b6fd-6cc1b991dd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:21.612537 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aaab8-5b65-4f8d-b6fd-6cc1b991dd7e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:21.613138 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aaab8-5b65-4f8d-b6fd-6cc1b991dd7e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:21.613993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aaab8-5b65-4f8d-b6fd-6cc1b991dd7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:21.615615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeaf33-1c88-452e-8b37-6843d93aaa07 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:21.615984 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5aaab8-5b65-4f8d-b6fd-6cc1b991dd7e None admin] RBAC: Adding query filter params (role.id=6c9336a73ed74d66a83c59fb3269efd5, scope.project.id=3381c0688581489b903e641f91914839, user.id=eefd1293a22848e3b595e54be0455d10) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:21.616740 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5aaab8-5b65-4f8d-b6fd-6cc1b991dd7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:21.619445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5aaab8-5b65-4f8d-b6fd-6cc1b991dd7e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:21.634811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 273/543] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:21 2022] GET /identity/v3/role_assignments?user.id=eefd1293a22848e3b595e54be0455d10&scope.project.id=3381c0688581489b903e641f91914839&role.id=6c9336a73ed74d66a83c59fb3269efd5 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:21.678936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:21.778804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeaf33-1c88-452e-8b37-6843d93aaa07 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:21.839332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdee63-883b-4819-8ade-600f2bad0095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:21.839997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdee63-883b-4819-8ade-600f2bad0095 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:21.840275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdee63-883b-4819-8ade-600f2bad0095 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:21.840588 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdee63-883b-4819-8ade-600f2bad0095 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:21.855574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdee63-883b-4819-8ade-600f2bad0095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-61fdee63-883b-4819-8ade-600f2bad0095 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:21.863261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:21.864402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:21.865744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:21.865744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:21.865744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:21.865744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:21.865744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:21.865744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:21.865744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:21.865744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:21.865744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:21.865744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:21.865744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:21.865744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:21.865744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 271/544] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:21.872643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aaab8-5b65-4f8d-b6fd-6cc1b991dd7e None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:21.899518 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:22.016110 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aaab8-5b65-4f8d-b6fd-6cc1b991dd7e None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:22.069953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d36f7-86fc-4865-be71-71375b79c5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:22.070907 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d36f7-86fc-4865-be71-71375b79c5f4 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:22.071355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d36f7-86fc-4865-be71-71375b79c5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:22.071810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d36f7-86fc-4865-be71-71375b79c5f4 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:22.072906 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d36f7-86fc-4865-be71-71375b79c5f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:22.073299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d36f7-86fc-4865-be71-71375b79c5f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:22.075102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d36f7-86fc-4865-be71-71375b79c5f4 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:22.089271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 274/545] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:22.095536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdee63-883b-4819-8ade-600f2bad0095 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:22.244591 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdee63-883b-4819-8ade-600f2bad0095 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:22.246423 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:22.293510 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd53ab1-9df1-46ed-859e-62b85c219a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:22.294335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53ab1-9df1-46ed-859e-62b85c219a26 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:22.294637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53ab1-9df1-46ed-859e-62b85c219a26 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:22.294869 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53ab1-9df1-46ed-859e-62b85c219a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:22.306797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd53ab1-9df1-46ed-859e-62b85c219a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:22.308291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd53ab1-9df1-46ed-859e-62b85c219a26 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-2fd53ab1-9df1-46ed-859e-62b85c219a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:22.340977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:22.342027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:22.344225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:22.344225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:22.344225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:22.344225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 272/546] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:22.353585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d36f7-86fc-4865-be71-71375b79c5f4 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:22.480812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:22.527482 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d36f7-86fc-4865-be71-71375b79c5f4 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:22.591627 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b21384-3c41-491c-baee-5b6a6b97b576 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:22.591999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b21384-3c41-491c-baee-5b6a6b97b576 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:22.592289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b21384-3c41-491c-baee-5b6a6b97b576 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:22.593898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 273/547] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:22.594042 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25e533-020f-4197-b0b5-eb5e1b8100d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:22.594658 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25e533-020f-4197-b0b5-eb5e1b8100d6 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:22.595050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25e533-020f-4197-b0b5-eb5e1b8100d6 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:22.595331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25e533-020f-4197-b0b5-eb5e1b8100d6 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:22.596207 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25e533-020f-4197-b0b5-eb5e1b8100d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:22.596626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25e533-020f-4197-b0b5-eb5e1b8100d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:22.598359 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25e533-020f-4197-b0b5-eb5e1b8100d6 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:22.599419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c84d2-b1fc-44d4-9f73-a98b3194a5c9 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:22.599706 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c84d2-b1fc-44d4-9f73-a98b3194a5c9 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:22.599983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c84d2-b1fc-44d4-9f73-a98b3194a5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:22.625435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 275/548] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:22.633512 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25e533-020f-4197-b0b5-eb5e1b8100d6 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:22.640569 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-754c84d2-b1fc-44d4-9f73-a98b3194a5c9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:22.641782 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-754c84d2-b1fc-44d4-9f73-a98b3194a5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:22.786054 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 274/549] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:54:22.852316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25e533-020f-4197-b0b5-eb5e1b8100d6 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:22.918102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa85213-f276-4f0a-a69c-8fe02e3ceb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:22.918754 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa85213-f276-4f0a-a69c-8fe02e3ceb44 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:22.919032 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa85213-f276-4f0a-a69c-8fe02e3ceb44 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:22.919301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa85213-f276-4f0a-a69c-8fe02e3ceb44 None admin] PATH_INFO: `/v3/users/swift` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:22.928134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa85213-f276-4f0a-a69c-8fe02e3ceb44 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:22.929667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa85213-f276-4f0a-a69c-8fe02e3ceb44 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:22.936398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-caa85213-f276-4f0a-a69c-8fe02e3ceb44 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:22.948800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:22.949869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:22.950876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:22.950876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:22.950876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:22.950876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:22.950876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:22.950876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:22.950876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:22.950876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:22.950876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:54:22.950876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:22.953202 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 276/550] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:22.958283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c84d2-b1fc-44d4-9f73-a98b3194a5c9 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:23.106019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:23.147006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c84d2-b1fc-44d4-9f73-a98b3194a5c9 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:23.182570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa85213-f276-4f0a-a69c-8fe02e3ceb44 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:23.200943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeccff6-89d4-4d82-ab8b-82d25ee5496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:23.201850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeccff6-89d4-4d82-ab8b-82d25ee5496f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:23.202308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeccff6-89d4-4d82-ab8b-82d25ee5496f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:23.202706 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeccff6-89d4-4d82-ab8b-82d25ee5496f None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:23.203469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeccff6-89d4-4d82-ab8b-82d25ee5496f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:23.203772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeccff6-89d4-4d82-ab8b-82d25ee5496f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:23.206840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeccff6-89d4-4d82-ab8b-82d25ee5496f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:23.232397 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 275/551] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Sep 7 12:54:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:23.241371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeccff6-89d4-4d82-ab8b-82d25ee5496f None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:23.390911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa85213-f276-4f0a-a69c-8fe02e3ceb44 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:23.402181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeccff6-89d4-4d82-ab8b-82d25ee5496f None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:23.455992 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d423f81-9312-4384-a92f-5b266c579be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:23.456780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d423f81-9312-4384-a92f-5b266c579be9 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:23.457070 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d423f81-9312-4384-a92f-5b266c579be9 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:23.457500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d423f81-9312-4384-a92f-5b266c579be9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:23.459755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947718ac-9add-4f16-8bfe-b101f2103d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:23.460681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947718ac-9add-4f16-8bfe-b101f2103d61 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:23.461087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947718ac-9add-4f16-8bfe-b101f2103d61 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:23.461478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947718ac-9add-4f16-8bfe-b101f2103d61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:23.472909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d423f81-9312-4384-a92f-5b266c579be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-3d423f81-9312-4384-a92f-5b266c579be9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:23.479999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:23.481100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:23.481991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:23.481991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:23.481991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:23.481991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:23.481991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:23.481991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:23.481991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:23.481991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:23.481991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:23.481991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:23.481991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:23.481991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:23.482860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 277/552] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:23.484739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5173c-8101-4f10-8525-7b736680dc60 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:23.489018 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5173c-8101-4f10-8525-7b736680dc60 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:23.489018 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5173c-8101-4f10-8525-7b736680dc60 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:23.489281 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:23.489373 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 278/553] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:23.491608 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5173c-8101-4f10-8525-7b736680dc60 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:23.584200 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947718ac-9add-4f16-8bfe-b101f2103d61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:23.586002 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947718ac-9add-4f16-8bfe-b101f2103d61 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:23.590948 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:23.649232 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5173c-8101-4f10-8525-7b736680dc60 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:23.692152 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc6872-c8e9-426a-b5f7-863f0f52bc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:23.693188 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc6872-c8e9-426a-b5f7-863f0f52bc62 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:23.693636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc6872-c8e9-426a-b5f7-863f0f52bc62 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:23.694111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc6872-c8e9-426a-b5f7-863f0f52bc62 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:23.695310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc6872-c8e9-426a-b5f7-863f0f52bc62 None admin] RBAC: Adding query filter params (name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:23.695772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc6872-c8e9-426a-b5f7-863f0f52bc62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:23.697521 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc6872-c8e9-426a-b5f7-863f0f52bc62 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:23.708134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 279/554] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:23.710150 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84739921-6ad6-4de2-a9a9-06e627721c5b None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:23.710697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84739921-6ad6-4de2-a9a9-06e627721c5b None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:23.711173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84739921-6ad6-4de2-a9a9-06e627721c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:23.734398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-84739921-6ad6-4de2-a9a9-06e627721c5b None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:23.735645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-84739921-6ad6-4de2-a9a9-06e627721c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:23.737142 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 276/555] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:23.738055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947718ac-9add-4f16-8bfe-b101f2103d61 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:23.794300 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:23.836054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 280/556] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:23.837638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479dbeb-0ebc-4cde-ae1e-a4133f477c32 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:23.837927 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479dbeb-0ebc-4cde-ae1e-a4133f477c32 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:23.838208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479dbeb-0ebc-4cde-ae1e-a4133f477c32 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:23.843676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 281/557] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:23.843676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479dbeb-0ebc-4cde-ae1e-a4133f477c32 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:23.899475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947718ac-9add-4f16-8bfe-b101f2103d61 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:23.910920 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:23.950535 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebdb20-8cd5-4046-ab76-ccbd819fbd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:23.951650 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebdb20-8cd5-4046-ab76-ccbd819fbd24 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:23.952163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebdb20-8cd5-4046-ab76-ccbd819fbd24 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:23.952683 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebdb20-8cd5-4046-ab76-ccbd819fbd24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:23.971026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebdb20-8cd5-4046-ab76-ccbd819fbd24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:23.972760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebdb20-8cd5-4046-ab76-ccbd819fbd24 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:23.978899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479dbeb-0ebc-4cde-ae1e-a4133f477c32 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-92ebdb20-8cd5-4046-ab76-ccbd819fbd24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:23.990268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:23.991257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:23.992294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:23.992294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:23.992294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:23.992294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 277/558] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:23.993633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3f2e5-8e30-48c3-8563-b2ae6b0848cc None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:23.994996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3f2e5-8e30-48c3-8563-b2ae6b0848cc None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:23.994996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3f2e5-8e30-48c3-8563-b2ae6b0848cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:24.021935 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-b7f3f2e5-8e30-48c3-8563-b2ae6b0848cc None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:24.023595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b7f3f2e5-8e30-48c3-8563-b2ae6b0848cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:24.023820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c583a-a5fb-4b99-a685-a99900f9b8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:24.024533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c583a-a5fb-4b99-a685-a99900f9b8c4 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:24.025047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c583a-a5fb-4b99-a685-a99900f9b8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:24.025209 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c583a-a5fb-4b99-a685-a99900f9b8c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:24.037952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c583a-a5fb-4b99-a685-a99900f9b8c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:24.039595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c583a-a5fb-4b99-a685-a99900f9b8c4 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-0c8c583a-a5fb-4b99-a685-a99900f9b8c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:24.056293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:24.058517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:24.060680 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:24.060680 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:24.060680 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:24.068412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 282/559] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:24.068412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c583a-a5fb-4b99-a685-a99900f9b8c4 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:24.104050 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 278/560] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:24.105110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3f2e5-8e30-48c3-8563-b2ae6b0848cc None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:24.137470 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:24.179259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c583a-a5fb-4b99-a685-a99900f9b8c4 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:24.181100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:24.216870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5b334-a75a-46df-adf5-839b1cd8c3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:24.217497 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5b334-a75a-46df-adf5-839b1cd8c3be None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:24.217779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5b334-a75a-46df-adf5-839b1cd8c3be None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:24.218052 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5b334-a75a-46df-adf5-839b1cd8c3be None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:24.218829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5b334-a75a-46df-adf5-839b1cd8c3be None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:24.219137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5b334-a75a-46df-adf5-839b1cd8c3be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:24.220585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5b334-a75a-46df-adf5-839b1cd8c3be None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:24.234439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 283/561] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:24.236785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3f2e5-8e30-48c3-8563-b2ae6b0848cc None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:24.241110 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5b334-a75a-46df-adf5-839b1cd8c3be None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:24.286065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16860ff-d367-4ff1-9fc0-230425fdad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:24.286702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16860ff-d367-4ff1-9fc0-230425fdad42 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:24.286981 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16860ff-d367-4ff1-9fc0-230425fdad42 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:24.287252 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16860ff-d367-4ff1-9fc0-230425fdad42 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:24.287912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16860ff-d367-4ff1-9fc0-230425fdad42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:24.288208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16860ff-d367-4ff1-9fc0-230425fdad42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:24.289669 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16860ff-d367-4ff1-9fc0-230425fdad42 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:24.306551 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 279/562] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:24.309047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16860ff-d367-4ff1-9fc0-230425fdad42 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:24.389707 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5b334-a75a-46df-adf5-839b1cd8c3be None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:24.427620 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:24.440312 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba91733-f24c-4b90-a128-ec0a89a0b91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:24.441236 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba91733-f24c-4b90-a128-ec0a89a0b91b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:24.441699 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba91733-f24c-4b90-a128-ec0a89a0b91b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:24.442118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba91733-f24c-4b90-a128-ec0a89a0b91b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:24.452279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba91733-f24c-4b90-a128-ec0a89a0b91b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:24.453958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba91733-f24c-4b90-a128-ec0a89a0b91b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:24.454633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16860ff-d367-4ff1-9fc0-230425fdad42 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-eba91733-f24c-4b90-a128-ec0a89a0b91b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:24.470697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:24.471908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:24.478108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:24.478108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:24.478108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:24.478108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:24.478108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:24.478108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:24.478108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:24.478108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:24.478108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:54:24.478108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:24.478108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 284/563] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:24.478108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba91733-f24c-4b90-a128-ec0a89a0b91b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:24.509438 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:24.515010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47012e1e-f638-4bee-b55b-cfd4cb7cd3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:24.515673 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47012e1e-f638-4bee-b55b-cfd4cb7cd3b8 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:24.515958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47012e1e-f638-4bee-b55b-cfd4cb7cd3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:24.516225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47012e1e-f638-4bee-b55b-cfd4cb7cd3b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:24.528115 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47012e1e-f638-4bee-b55b-cfd4cb7cd3b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-47012e1e-f638-4bee-b55b-cfd4cb7cd3b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:24.535336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:24.537118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:24.538293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:24.538293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:24.538293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:24.538293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:24.538293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:24.538293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:24.538293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:24.538293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:24.538293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:24.538293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:24.538293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:24.538293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:24.538293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 280/564] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:24.538293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3c37b-07a3-4055-bd72-df1aa874cb49 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:24.539288 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3c37b-07a3-4055-bd72-df1aa874cb49 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:24.539288 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3c37b-07a3-4055-bd72-df1aa874cb49 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:24.540225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 281/565] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:24.541073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3c37b-07a3-4055-bd72-df1aa874cb49 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:24.606937 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba91733-f24c-4b90-a128-ec0a89a0b91b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:24.655786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36cbc5-6610-4a9a-b528-c328421a0d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:24.656465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36cbc5-6610-4a9a-b528-c328421a0d91 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:24.656747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36cbc5-6610-4a9a-b528-c328421a0d91 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:24.657018 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36cbc5-6610-4a9a-b528-c328421a0d91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:24.662068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3c37b-07a3-4055-bd72-df1aa874cb49 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:24.664849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36cbc5-6610-4a9a-b528-c328421a0d91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:24.666347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36cbc5-6610-4a9a-b528-c328421a0d91 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:24.681357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-cd36cbc5-6610-4a9a-b528-c328421a0d91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:24.681357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:24.681357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:24.681357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:24.681357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:24.681357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:24.681357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:24.681357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:24.681357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:24.681357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:24.681357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:24.681357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:24.681357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:24.681357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:24.681357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:24.683181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:24.684349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:24.684349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:24.684349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:24.684349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:24.684349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:24.684349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:24.684349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:24.684349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:24.684349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 285/566] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:24.685414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36cbc5-6610-4a9a-b528-c328421a0d91 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:24.706253 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa8b06-f4ce-4d4a-ab35-c3b6e7f19e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:24.706736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa8b06-f4ce-4d4a-ab35-c3b6e7f19e85 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:24.707009 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa8b06-f4ce-4d4a-ab35-c3b6e7f19e85 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:24.707269 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa8b06-f4ce-4d4a-ab35-c3b6e7f19e85 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:24.708008 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa8b06-f4ce-4d4a-ab35-c3b6e7f19e85 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:24.708307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa8b06-f4ce-4d4a-ab35-c3b6e7f19e85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:24.709799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa8b06-f4ce-4d4a-ab35-c3b6e7f19e85 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:24.728099 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 282/567] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Sep 7 12:54:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:24.729050 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa8b06-f4ce-4d4a-ab35-c3b6e7f19e85 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:24.731808 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:24.804474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:24.832740 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36cbc5-6610-4a9a-b528-c328421a0d91 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:24.889547 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa8b06-f4ce-4d4a-ab35-c3b6e7f19e85 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:24.891498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29f91c-35ac-437d-a3cd-ba320dd084e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:24.892144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29f91c-35ac-437d-a3cd-ba320dd084e2 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:24.892495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29f91c-35ac-437d-a3cd-ba320dd084e2 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:24.892976 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29f91c-35ac-437d-a3cd-ba320dd084e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:24.905896 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29f91c-35ac-437d-a3cd-ba320dd084e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-3b29f91c-35ac-437d-a3cd-ba320dd084e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:24.911628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:24.912693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:24.913563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:24.913563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:24.913563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:24.913563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:24.913563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:24.913563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:24.913563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:24.913563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:24.913563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:24.913563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:24.913563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:24.913563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:24.913563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 286/568] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:24.914268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac760c-b986-49eb-a27b-96fd0f7fd636 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:24.914268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac760c-b986-49eb-a27b-96fd0f7fd636 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:24.915094 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac760c-b986-49eb-a27b-96fd0f7fd636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:24.935378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-a9ac760c-b986-49eb-a27b-96fd0f7fd636 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:24.936645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a9ac760c-b986-49eb-a27b-96fd0f7fd636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:24.941375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a787b83-4556-4143-98da-e5328cf0fbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:24.941997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a787b83-4556-4143-98da-e5328cf0fbd2 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:24.942267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a787b83-4556-4143-98da-e5328cf0fbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:24.942528 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a787b83-4556-4143-98da-e5328cf0fbd2 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:24.943180 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a787b83-4556-4143-98da-e5328cf0fbd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:24.943476 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a787b83-4556-4143-98da-e5328cf0fbd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:24.944926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a787b83-4556-4143-98da-e5328cf0fbd2 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:24.954108 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 283/569] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:24.954948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a787b83-4556-4143-98da-e5328cf0fbd2 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:25.027155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 287/570] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:25.027853 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac760c-b986-49eb-a27b-96fd0f7fd636 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:25.037959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:25.093190 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a787b83-4556-4143-98da-e5328cf0fbd2 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:25.117367 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:25.139909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f1a4c-7f5a-4b4a-ba1a-15fe7ea92904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:25.140739 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f1a4c-7f5a-4b4a-ba1a-15fe7ea92904 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:25.140911 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f1a4c-7f5a-4b4a-ba1a-15fe7ea92904 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:25.141216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f1a4c-7f5a-4b4a-ba1a-15fe7ea92904 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:25.141792 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f1a4c-7f5a-4b4a-ba1a-15fe7ea92904 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:25.142093 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f1a4c-7f5a-4b4a-ba1a-15fe7ea92904 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:25.143696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f1a4c-7f5a-4b4a-ba1a-15fe7ea92904 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:25.155395 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac760c-b986-49eb-a27b-96fd0f7fd636 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:25.161823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 284/571] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:25.161823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f1a4c-7f5a-4b4a-ba1a-15fe7ea92904 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:25.200490 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6144258-9d87-47a9-bc39-b257563e72ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:25.201235 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6144258-9d87-47a9-bc39-b257563e72ca None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:25.201602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6144258-9d87-47a9-bc39-b257563e72ca None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:25.201956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6144258-9d87-47a9-bc39-b257563e72ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:25.213213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6144258-9d87-47a9-bc39-b257563e72ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:25.214815 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6144258-9d87-47a9-bc39-b257563e72ca None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-c6144258-9d87-47a9-bc39-b257563e72ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:25.231610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:25.233050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:25.234265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:25.234265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:25.234265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:25.234265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 288/572] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:25.234265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6144258-9d87-47a9-bc39-b257563e72ca None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:25.309410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f1a4c-7f5a-4b4a-ba1a-15fe7ea92904 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:25.354502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:25.366181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9418e3-d680-4351-93ee-01767c4146d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:25.366797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9418e3-d680-4351-93ee-01767c4146d6 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:25.367121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9418e3-d680-4351-93ee-01767c4146d6 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:25.367446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9418e3-d680-4351-93ee-01767c4146d6 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:25.368120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9418e3-d680-4351-93ee-01767c4146d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:25.368451 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9418e3-d680-4351-93ee-01767c4146d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:25.369861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9418e3-d680-4351-93ee-01767c4146d6 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:25.376990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6144258-9d87-47a9-bc39-b257563e72ca None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:25.380681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 285/573] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:25.381558 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9418e3-d680-4351-93ee-01767c4146d6 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:25.403786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:25.424317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014604a-d204-4392-9c0a-43dbefcf483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:25.425143 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014604a-d204-4392-9c0a-43dbefcf483d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:25.425432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014604a-d204-4392-9c0a-43dbefcf483d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:25.425706 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014604a-d204-4392-9c0a-43dbefcf483d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:25.438816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014604a-d204-4392-9c0a-43dbefcf483d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:25.440350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014604a-d204-4392-9c0a-43dbefcf483d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-b014604a-d204-4392-9c0a-43dbefcf483d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:25.456224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:25.457296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:25.458332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:25.458332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:25.458332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:25.458332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 289/574] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:25.458332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014604a-d204-4392-9c0a-43dbefcf483d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:25.514764 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9418e3-d680-4351-93ee-01767c4146d6 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:25.559930 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462183aa-651c-4e7f-a565-f787f1556e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:25.560851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462183aa-651c-4e7f-a565-f787f1556e86 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:25.561333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462183aa-651c-4e7f-a565-f787f1556e86 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:25.561763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462183aa-651c-4e7f-a565-f787f1556e86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:25.563037 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462183aa-651c-4e7f-a565-f787f1556e86 None admin] RBAC: Adding query filter params (role.id=6c9336a73ed74d66a83c59fb3269efd5, scope.project.id=3381c0688581489b903e641f91914839, user.id=f3796ca94b914fd18946551fa2bff331) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:25.563565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462183aa-651c-4e7f-a565-f787f1556e86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:25.566094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462183aa-651c-4e7f-a565-f787f1556e86 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:25.574594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 286/575] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:25 2022] GET /identity/v3/role_assignments?user.id=f3796ca94b914fd18946551fa2bff331&scope.project.id=3381c0688581489b903e641f91914839&role.id=6c9336a73ed74d66a83c59fb3269efd5 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:25.575907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462183aa-651c-4e7f-a565-f787f1556e86 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:25.584383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014604a-d204-4392-9c0a-43dbefcf483d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:25.637627 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab076c5-e199-4d11-8375-9a8341f95875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:25.638268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab076c5-e199-4d11-8375-9a8341f95875 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:25.638549 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab076c5-e199-4d11-8375-9a8341f95875 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:25.638824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab076c5-e199-4d11-8375-9a8341f95875 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:25.639500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab076c5-e199-4d11-8375-9a8341f95875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:25.639808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab076c5-e199-4d11-8375-9a8341f95875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:25.641352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab076c5-e199-4d11-8375-9a8341f95875 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:25.654290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:25.656604 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 290/576] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:25.657211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab076c5-e199-4d11-8375-9a8341f95875 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:25.717918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:25.750595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462183aa-651c-4e7f-a565-f787f1556e86 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:25.799507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690fd5a-be6d-4a74-8e9f-e48cc69a5069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:25.800451 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690fd5a-be6d-4a74-8e9f-e48cc69a5069 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:25.800703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690fd5a-be6d-4a74-8e9f-e48cc69a5069 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:25.800970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690fd5a-be6d-4a74-8e9f-e48cc69a5069 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:25.813484 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab076c5-e199-4d11-8375-9a8341f95875 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:25.814687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690fd5a-be6d-4a74-8e9f-e48cc69a5069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-3690fd5a-be6d-4a74-8e9f-e48cc69a5069 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:25.820909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:25.822011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:25.822851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:25.822851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:25.822851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:25.822851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:25.822851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:25.822851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:25.822851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:25.822851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:25.822851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:25.822851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:25.822851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:25.822851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:25.829342 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 287/577] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:25.829342 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690fd5a-be6d-4a74-8e9f-e48cc69a5069 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:25.866218 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5e9c4-c6ee-40a7-8187-7d8095e1c8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:25.866872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5e9c4-c6ee-40a7-8187-7d8095e1c8af None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:25.867158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5e9c4-c6ee-40a7-8187-7d8095e1c8af None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:25.867433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5e9c4-c6ee-40a7-8187-7d8095e1c8af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:25.881998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5e9c4-c6ee-40a7-8187-7d8095e1c8af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:25.883526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5e9c4-c6ee-40a7-8187-7d8095e1c8af None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-dda5e9c4-c6ee-40a7-8187-7d8095e1c8af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:25.901874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:25.902991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:25.904087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:25.904087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:25.904087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:25.905915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 291/578] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:25.907000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5e9c4-c6ee-40a7-8187-7d8095e1c8af None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:25.985943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690fd5a-be6d-4a74-8e9f-e48cc69a5069 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:26.001587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:26.035211 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175589f-e54c-43d6-94bb-a1516f629a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:26.035849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175589f-e54c-43d6-94bb-a1516f629a6a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:26.036130 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175589f-e54c-43d6-94bb-a1516f629a6a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:26.036593 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175589f-e54c-43d6-94bb-a1516f629a6a None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:26.037386 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175589f-e54c-43d6-94bb-a1516f629a6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:26.044041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175589f-e54c-43d6-94bb-a1516f629a6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:26.045602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175589f-e54c-43d6-94bb-a1516f629a6a None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:26.046500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:26.064915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 288/579] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:26.065830 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175589f-e54c-43d6-94bb-a1516f629a6a None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:26.071296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5e9c4-c6ee-40a7-8187-7d8095e1c8af None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:26.115990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677ce80-027f-482c-869d-fbfea7a0a707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:26.116931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677ce80-027f-482c-869d-fbfea7a0a707 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:26.117355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677ce80-027f-482c-869d-fbfea7a0a707 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:26.117790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677ce80-027f-482c-869d-fbfea7a0a707 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:26.126282 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677ce80-027f-482c-869d-fbfea7a0a707 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:26.128049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677ce80-027f-482c-869d-fbfea7a0a707 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:26.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-5677ce80-027f-482c-869d-fbfea7a0a707 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:26.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:26.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:26.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:26.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:26.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:26.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:26.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:26.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:26.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:26.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:26.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:26.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:26.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:26.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:26.141863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:26.143065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:26.143065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:26.143065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:26.143065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:26.143065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:26.143065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:26.143065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:26.143065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:26.150623 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 292/580] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:26.151871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677ce80-027f-482c-869d-fbfea7a0a707 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:26.199816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175589f-e54c-43d6-94bb-a1516f629a6a None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:26.247389 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8c9b1-6f9d-47ec-85b6-d87f4cb82bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:26.248748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8c9b1-6f9d-47ec-85b6-d87f4cb82bd6 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:26.249219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8c9b1-6f9d-47ec-85b6-d87f4cb82bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:26.249695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8c9b1-6f9d-47ec-85b6-d87f4cb82bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:26.251154 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8c9b1-6f9d-47ec-85b6-d87f4cb82bd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:26.251668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8c9b1-6f9d-47ec-85b6-d87f4cb82bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:26.254184 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8c9b1-6f9d-47ec-85b6-d87f4cb82bd6 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:26.269845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 289/581] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:26.269845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8c9b1-6f9d-47ec-85b6-d87f4cb82bd6 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:26.278380 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677ce80-027f-482c-869d-fbfea7a0a707 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:26.318024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:26.323710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12f401-1f71-44f1-a984-f40a47d126d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:26.324427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12f401-1f71-44f1-a984-f40a47d126d5 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:26.324804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12f401-1f71-44f1-a984-f40a47d126d5 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:26.325119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12f401-1f71-44f1-a984-f40a47d126d5 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:26.325863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12f401-1f71-44f1-a984-f40a47d126d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:26.326226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12f401-1f71-44f1-a984-f40a47d126d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:26.327725 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12f401-1f71-44f1-a984-f40a47d126d5 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:26.346440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 293/582] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:26.347992 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12f401-1f71-44f1-a984-f40a47d126d5 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:26.366219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:26.421028 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8c9b1-6f9d-47ec-85b6-d87f4cb82bd6 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:26.473316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e264441-7ba9-4b1e-b239-c6666c8db449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:26.474192 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e264441-7ba9-4b1e-b239-c6666c8db449 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:26.474395 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e264441-7ba9-4b1e-b239-c6666c8db449 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:26.474730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e264441-7ba9-4b1e-b239-c6666c8db449 None admin] PATH_INFO: `/v3/users/nova` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:26.483662 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e264441-7ba9-4b1e-b239-c6666c8db449 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:26.485310 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e264441-7ba9-4b1e-b239-c6666c8db449 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:26.492195 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12f401-1f71-44f1-a984-f40a47d126d5 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-8e264441-7ba9-4b1e-b239-c6666c8db449 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:26.499797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:26.501024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:26.502302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:26.502302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:26.502302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:26.502302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:26.502302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:26.502302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:26.502302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:26.502302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:26.502302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:54:26.502302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:26.502302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 290/583] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Sep 7 12:54:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:26.502302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e264441-7ba9-4b1e-b239-c6666c8db449 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:26.543848 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99567453-9664-46de-9c10-8cf0c331ed25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:26.544527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99567453-9664-46de-9c10-8cf0c331ed25 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:26.544812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99567453-9664-46de-9c10-8cf0c331ed25 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:26.545084 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99567453-9664-46de-9c10-8cf0c331ed25 None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:26.545795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99567453-9664-46de-9c10-8cf0c331ed25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:26.546109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99567453-9664-46de-9c10-8cf0c331ed25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:26.547720 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99567453-9664-46de-9c10-8cf0c331ed25 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:26.561582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 294/584] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:26.562436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99567453-9664-46de-9c10-8cf0c331ed25 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:26.647779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:26.652556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:26.664535 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e264441-7ba9-4b1e-b239-c6666c8db449 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:26.709109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99567453-9664-46de-9c10-8cf0c331ed25 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:26.710342 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034639b-3a13-449d-8f37-eeac07975d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:26.711006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034639b-3a13-449d-8f37-eeac07975d89 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:26.711284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034639b-3a13-449d-8f37-eeac07975d89 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:26.711609 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034639b-3a13-449d-8f37-eeac07975d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:26.730288 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034639b-3a13-449d-8f37-eeac07975d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:26.732769 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034639b-3a13-449d-8f37-eeac07975d89 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-e034639b-3a13-449d-8f37-eeac07975d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:26.751554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:26.753770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:26.756232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:26.756232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:26.756232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:26.760587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 291/585] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:26.761567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034639b-3a13-449d-8f37-eeac07975d89 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:26.775582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e055bf-070a-4d8e-8d2b-696540596954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:26.776354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e055bf-070a-4d8e-8d2b-696540596954 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:26.776740 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e055bf-070a-4d8e-8d2b-696540596954 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:26.776930 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e055bf-070a-4d8e-8d2b-696540596954 None admin] PATH_INFO: `/v3/users/glance` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:26.790947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e055bf-070a-4d8e-8d2b-696540596954 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:26.792482 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e055bf-070a-4d8e-8d2b-696540596954 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-19e055bf-070a-4d8e-8d2b-696540596954 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:26.807936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:26.809117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:26.810297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:26.810297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:26.810297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:26.810297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:26.810297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:26.810297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:26.810297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:26.810297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:26.810297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:54:26.810297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:26.813724 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 295/586] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:26.815826 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e055bf-070a-4d8e-8d2b-696540596954 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:26.906824 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034639b-3a13-449d-8f37-eeac07975d89 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:26.962524 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182c5df-89eb-4b65-9579-cd9ff9f5d66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:26.963160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182c5df-89eb-4b65-9579-cd9ff9f5d66c None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:26.963439 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182c5df-89eb-4b65-9579-cd9ff9f5d66c None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:26.963691 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182c5df-89eb-4b65-9579-cd9ff9f5d66c None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:26.964470 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182c5df-89eb-4b65-9579-cd9ff9f5d66c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:26.964773 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182c5df-89eb-4b65-9579-cd9ff9f5d66c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:26.966442 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182c5df-89eb-4b65-9579-cd9ff9f5d66c None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:26.970494 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e055bf-070a-4d8e-8d2b-696540596954 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:26.990320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 292/587] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Sep 7 12:54:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:26.991220 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182c5df-89eb-4b65-9579-cd9ff9f5d66c None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:26.994600 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:27.015232 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:27.028766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84419807-13c5-45ca-82a9-b22391fd5a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:27.029451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84419807-13c5-45ca-82a9-b22391fd5a7e None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:27.029938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84419807-13c5-45ca-82a9-b22391fd5a7e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:27.030125 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84419807-13c5-45ca-82a9-b22391fd5a7e None admin] PATH_INFO: `/v3/projects/3381c0688581489b903e641f91914839/users/4089419bb88e4aeda23bf141370cb6e7/roles/6c9336a73ed74d66a83c59fb3269efd5` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:27.047593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84419807-13c5-45ca-82a9-b22391fd5a7e None admin] RBAC: Authorizing `identity:create_grant(project_id=3381c0688581489b903e641f91914839, user_id=4089419bb88e4aeda23bf141370cb6e7, role_id=6c9336a73ed74d66a83c59fb3269efd5)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:27.049213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84419807-13c5-45ca-82a9-b22391fd5a7e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:27.067309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 296/588] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:54:26 2022] PUT /identity/v3/projects/3381c0688581489b903e641f91914839/users/4089419bb88e4aeda23bf141370cb6e7/roles/6c9336a73ed74d66a83c59fb3269efd5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:54:27.077483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84419807-13c5-45ca-82a9-b22391fd5a7e None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:27.157564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182c5df-89eb-4b65-9579-cd9ff9f5d66c None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:27.211684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf98b7c-b32e-47eb-a7f9-9ebaa6d7a2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:27.211684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf98b7c-b32e-47eb-a7f9-9ebaa6d7a2a4 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:27.212517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf98b7c-b32e-47eb-a7f9-9ebaa6d7a2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:27.212517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf98b7c-b32e-47eb-a7f9-9ebaa6d7a2a4 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:27.213203 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf98b7c-b32e-47eb-a7f9-9ebaa6d7a2a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:27.213520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf98b7c-b32e-47eb-a7f9-9ebaa6d7a2a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:27.214991 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf98b7c-b32e-47eb-a7f9-9ebaa6d7a2a4 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:27.234999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 293/589] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:27.234999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf98b7c-b32e-47eb-a7f9-9ebaa6d7a2a4 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:27.253967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84419807-13c5-45ca-82a9-b22391fd5a7e None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:27.308280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a81b5-8e46-42b0-87d8-f0d7a85dc7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:27.309010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a81b5-8e46-42b0-87d8-f0d7a85dc7e1 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:27.309294 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a81b5-8e46-42b0-87d8-f0d7a85dc7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:27.309571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a81b5-8e46-42b0-87d8-f0d7a85dc7e1 None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:27.310329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a81b5-8e46-42b0-87d8-f0d7a85dc7e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:27.310639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a81b5-8e46-42b0-87d8-f0d7a85dc7e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:27.312295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a81b5-8e46-42b0-87d8-f0d7a85dc7e1 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:27.317005 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:27.334736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 297/590] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Sep 7 12:54:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:27.335626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a81b5-8e46-42b0-87d8-f0d7a85dc7e1 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:27.380850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf98b7c-b32e-47eb-a7f9-9ebaa6d7a2a4 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:27.386933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:27.432499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7faa9-71b4-4c19-8394-f1911a9d7245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:27.433126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7faa9-71b4-4c19-8394-f1911a9d7245 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:27.433410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7faa9-71b4-4c19-8394-f1911a9d7245 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:27.433705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7faa9-71b4-4c19-8394-f1911a9d7245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:27.445941 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7faa9-71b4-4c19-8394-f1911a9d7245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:27.448252 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7faa9-71b4-4c19-8394-f1911a9d7245 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:27.469089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a81b5-8e46-42b0-87d8-f0d7a85dc7e1 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-c4f7faa9-71b4-4c19-8394-f1911a9d7245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:27.469568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:27.471445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:27.474086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:27.474086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:27.474086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:27.474086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 294/591] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:27.474086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7faa9-71b4-4c19-8394-f1911a9d7245 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:27.528733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2923bfd-a85f-4cb7-9bef-ffbb04a8a2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:27.529454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2923bfd-a85f-4cb7-9bef-ffbb04a8a2b1 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:27.529673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2923bfd-a85f-4cb7-9bef-ffbb04a8a2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:27.529933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2923bfd-a85f-4cb7-9bef-ffbb04a8a2b1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:27.540866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2923bfd-a85f-4cb7-9bef-ffbb04a8a2b1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:27.542063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2923bfd-a85f-4cb7-9bef-ffbb04a8a2b1 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-e2923bfd-a85f-4cb7-9bef-ffbb04a8a2b1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:27.556428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:27.557491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:27.559178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:27.559178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:27.559178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:27.559178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:27.559178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:27.559178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:27.559178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:27.559178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:27.559178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:54:27.559178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:27.559178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 298/592] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:27.559178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2923bfd-a85f-4cb7-9bef-ffbb04a8a2b1 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:27.610928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7faa9-71b4-4c19-8394-f1911a9d7245 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:27.629882 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:27.655890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab4cc9-fda6-46fd-827f-366789210cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:27.657071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab4cc9-fda6-46fd-827f-366789210cbc None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:27.657555 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab4cc9-fda6-46fd-827f-366789210cbc None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:27.658045 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab4cc9-fda6-46fd-827f-366789210cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:27.678743 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:27.684286 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab4cc9-fda6-46fd-827f-366789210cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:27.685976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab4cc9-fda6-46fd-827f-366789210cbc None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:27.692941 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2923bfd-a85f-4cb7-9bef-ffbb04a8a2b1 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-a5ab4cc9-fda6-46fd-827f-366789210cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:27.703479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:27.704700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:27.706081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:27.706081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:27.706081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:27.712714 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 295/593] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:27.712714 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab4cc9-fda6-46fd-827f-366789210cbc None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:27.738197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3223fc-6892-4be4-ab22-10448665cf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:27.738828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3223fc-6892-4be4-ab22-10448665cf65 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:27.739112 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3223fc-6892-4be4-ab22-10448665cf65 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:27.739393 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3223fc-6892-4be4-ab22-10448665cf65 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:27.740057 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3223fc-6892-4be4-ab22-10448665cf65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:27.740360 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3223fc-6892-4be4-ab22-10448665cf65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:27.741939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3223fc-6892-4be4-ab22-10448665cf65 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:27.764826 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 299/594] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:27.765856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3223fc-6892-4be4-ab22-10448665cf65 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:27.829376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab4cc9-fda6-46fd-827f-366789210cbc None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:27.871854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de676499-e393-4a43-aea3-4c0ad7263113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:27.872678 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de676499-e393-4a43-aea3-4c0ad7263113 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:27.873355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de676499-e393-4a43-aea3-4c0ad7263113 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:27.873717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de676499-e393-4a43-aea3-4c0ad7263113 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:27.874560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de676499-e393-4a43-aea3-4c0ad7263113 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:27.874963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de676499-e393-4a43-aea3-4c0ad7263113 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:27.876676 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de676499-e393-4a43-aea3-4c0ad7263113 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:27.905372 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 296/595] 10.222.0.30 () {56 vars in 1139 bytes} [Wed Sep 7 12:54:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:27.906819 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de676499-e393-4a43-aea3-4c0ad7263113 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:27.907489 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3223fc-6892-4be4-ab22-10448665cf65 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:27.944316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:27.956836 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e2ed0-299f-4484-b3e0-808d30a7c252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:27.957466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e2ed0-299f-4484-b3e0-808d30a7c252 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:27.957747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e2ed0-299f-4484-b3e0-808d30a7c252 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:27.958020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e2ed0-299f-4484-b3e0-808d30a7c252 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:27.958765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e2ed0-299f-4484-b3e0-808d30a7c252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:27.959073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e2ed0-299f-4484-b3e0-808d30a7c252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:27.960609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e2ed0-299f-4484-b3e0-808d30a7c252 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:27.973933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 300/596] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:27.974827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e2ed0-299f-4484-b3e0-808d30a7c252 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:27.998582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:28.042649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de676499-e393-4a43-aea3-4c0ad7263113 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:28.081017 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13af14-7a40-490c-bcf6-ed13446b55a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:28.081733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13af14-7a40-490c-bcf6-ed13446b55a4 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:28.082014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13af14-7a40-490c-bcf6-ed13446b55a4 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:28.082283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13af14-7a40-490c-bcf6-ed13446b55a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:28.093241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13af14-7a40-490c-bcf6-ed13446b55a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:28.094854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13af14-7a40-490c-bcf6-ed13446b55a4 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:28.107949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-8b13af14-7a40-490c-bcf6-ed13446b55a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:28.107949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:28.107949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:28.107949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:28.107949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:28.107949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:28.107949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:28.107949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:28.107949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:28.107949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:28.107949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:28.107949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:28.107949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:28.107949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:28.107949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:28.108974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:28.109859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:28.109859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:28.109859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:28.109859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:28.109859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:28.109859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:28.109859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:28.109859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:28.109859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 297/597] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:28.111396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca812e7-2c23-43f8-87c8-9d6f46c9b35c None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:28.111396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca812e7-2c23-43f8-87c8-9d6f46c9b35c None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:28.111396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca812e7-2c23-43f8-87c8-9d6f46c9b35c None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:28.117616 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 298/598] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:28.117616 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca812e7-2c23-43f8-87c8-9d6f46c9b35c None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:28.135673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e2ed0-299f-4484-b3e0-808d30a7c252 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:28.182144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1651566-9e21-4047-b1c4-2010fb744b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:28.183841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1651566-9e21-4047-b1c4-2010fb744b53 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:28.184668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1651566-9e21-4047-b1c4-2010fb744b53 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:28.185177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1651566-9e21-4047-b1c4-2010fb744b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:28.199848 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1651566-9e21-4047-b1c4-2010fb744b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:28.201275 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1651566-9e21-4047-b1c4-2010fb744b53 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-b1651566-9e21-4047-b1c4-2010fb744b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:28.218450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:28.220254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:28.222756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:28.222756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:28.222756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:28.222756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 301/599] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:28.222756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1651566-9e21-4047-b1c4-2010fb744b53 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:28.260681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:28.291301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca812e7-2c23-43f8-87c8-9d6f46c9b35c None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:28.304352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:28.338368 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7928125-eea9-4024-9546-1cd53692411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:28.339218 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7928125-eea9-4024-9546-1cd53692411e None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:28.339382 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7928125-eea9-4024-9546-1cd53692411e None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:28.339785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7928125-eea9-4024-9546-1cd53692411e None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:28.348596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7928125-eea9-4024-9546-1cd53692411e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:28.350151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7928125-eea9-4024-9546-1cd53692411e None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:28.351190 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1651566-9e21-4047-b1c4-2010fb744b53 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:28.366502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-c7928125-eea9-4024-9546-1cd53692411e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:28.366502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:28.366502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:28.366502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:28.366502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:28.366502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:28.366502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:28.366502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:28.366502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:28.366502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:28.366502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:28.366502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:28.366502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:28.366502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:28.366502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:28.367493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:28.369065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:28.369065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:28.369065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:28.369065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:28.369065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:28.369065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:28.369065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:28.369065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:28.369065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 299/600] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:28.369557 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbde93-dfaf-412e-b065-fae9a918c3f3 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:28.369557 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbde93-dfaf-412e-b065-fae9a918c3f3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:28.369973 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbde93-dfaf-412e-b065-fae9a918c3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:28.392205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-8dfbde93-dfaf-412e-b065-fae9a918c3f3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:28.393566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-8dfbde93-dfaf-412e-b065-fae9a918c3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:28.405686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da5cd7-b1ec-4b8d-962f-358833c7bb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:28.406431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5cd7-b1ec-4b8d-962f-358833c7bb6c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:28.406717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5cd7-b1ec-4b8d-962f-358833c7bb6c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:28.406996 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5cd7-b1ec-4b8d-962f-358833c7bb6c None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:28.407737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da5cd7-b1ec-4b8d-962f-358833c7bb6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:28.408495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da5cd7-b1ec-4b8d-962f-358833c7bb6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:28.409628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da5cd7-b1ec-4b8d-962f-358833c7bb6c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:28.425004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 302/601] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:28.430434 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da5cd7-b1ec-4b8d-962f-358833c7bb6c None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:28.481600 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 300/602] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:28.482717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbde93-dfaf-412e-b065-fae9a918c3f3 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:28.566301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da5cd7-b1ec-4b8d-962f-358833c7bb6c None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:28.608329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:28.623774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa1ceb-b73f-4fdd-965e-7b8a9ac4b7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:28.624751 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa1ceb-b73f-4fdd-965e-7b8a9ac4b7ce None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:28.625428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa1ceb-b73f-4fdd-965e-7b8a9ac4b7ce None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:28.625969 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa1ceb-b73f-4fdd-965e-7b8a9ac4b7ce None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:28.627268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa1ceb-b73f-4fdd-965e-7b8a9ac4b7ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:28.627812 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:28.627925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa1ceb-b73f-4fdd-965e-7b8a9ac4b7ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:28.630692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa1ceb-b73f-4fdd-965e-7b8a9ac4b7ce None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:28.645798 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbde93-dfaf-412e-b065-fae9a918c3f3 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:28.650601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 303/603] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:28.651617 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa1ceb-b73f-4fdd-965e-7b8a9ac4b7ce None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:28.684531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e271789-5f4f-4cfc-8b20-7e79e2f16049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:28.685166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e271789-5f4f-4cfc-8b20-7e79e2f16049 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:28.685447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e271789-5f4f-4cfc-8b20-7e79e2f16049 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:28.685720 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e271789-5f4f-4cfc-8b20-7e79e2f16049 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:28.686560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e271789-5f4f-4cfc-8b20-7e79e2f16049 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:28.686872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e271789-5f4f-4cfc-8b20-7e79e2f16049 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:28.688497 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e271789-5f4f-4cfc-8b20-7e79e2f16049 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:28.702277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 301/604] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:28.703170 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e271789-5f4f-4cfc-8b20-7e79e2f16049 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:28.769081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa1ceb-b73f-4fdd-965e-7b8a9ac4b7ce None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:28.808295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b570ba-3b64-462d-a7f1-c22696bb9971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:28.809178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b570ba-3b64-462d-a7f1-c22696bb9971 None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:28.809513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b570ba-3b64-462d-a7f1-c22696bb9971 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:28.809874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b570ba-3b64-462d-a7f1-c22696bb9971 None admin] PATH_INFO: `/v3/projects/3381c0688581489b903e641f91914839/users/fbe8fa8ab8094aa69933398280810692/roles/6c9336a73ed74d66a83c59fb3269efd5` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:28.817344 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e271789-5f4f-4cfc-8b20-7e79e2f16049 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:28.828127 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b570ba-3b64-462d-a7f1-c22696bb9971 None admin] RBAC: Authorizing `identity:create_grant(project_id=3381c0688581489b903e641f91914839, user_id=fbe8fa8ab8094aa69933398280810692, role_id=6c9336a73ed74d66a83c59fb3269efd5)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:28.829782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b570ba-3b64-462d-a7f1-c22696bb9971 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:28.849083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 304/605] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:54:28 2022] PUT /identity/v3/projects/3381c0688581489b903e641f91914839/users/fbe8fa8ab8094aa69933398280810692/roles/6c9336a73ed74d66a83c59fb3269efd5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:54:28.849928 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b570ba-3b64-462d-a7f1-c22696bb9971 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:28.867912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75aa38-b23c-45f9-9930-18f18e31810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:28.869363 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75aa38-b23c-45f9-9930-18f18e31810b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:28.869975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75aa38-b23c-45f9-9930-18f18e31810b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:28.870460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75aa38-b23c-45f9-9930-18f18e31810b None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:28.873849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:28.883972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75aa38-b23c-45f9-9930-18f18e31810b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:28.887389 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75aa38-b23c-45f9-9930-18f18e31810b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:28.905834 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:28.907572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-9a75aa38-b23c-45f9-9930-18f18e31810b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:28.907572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:28.907572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:28.907572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:28.907572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:28.907572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:28.907572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:28.907572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:28.907572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:28.907572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:28.907572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:28.907572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:28.907572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:28.907572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:28.907572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:28.908854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:28.910213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:28.910213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:28.910213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:28.910213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:28.910213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:28.910213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:28.910213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:28.910213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:28.915113 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 302/606] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:28.916958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75aa38-b23c-45f9-9930-18f18e31810b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:29.048297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b570ba-3b64-462d-a7f1-c22696bb9971 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:29.065016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75aa38-b23c-45f9-9930-18f18e31810b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:29.100973 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd14b4-9738-4799-a4e3-36fc056dabf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:29.102317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd14b4-9738-4799-a4e3-36fc056dabf6 None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:29.103082 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd14b4-9738-4799-a4e3-36fc056dabf6 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:29.103839 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd14b4-9738-4799-a4e3-36fc056dabf6 None admin] PATH_INFO: `/v3/projects/3381c0688581489b903e641f91914839/users/f332ac2346f0444a8d336ed2b3121be2/roles/6c9336a73ed74d66a83c59fb3269efd5` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:29.112015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc167b7-fb0a-4723-9ab3-a23691b76eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:29.112695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc167b7-fb0a-4723-9ab3-a23691b76eae None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:29.112976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc167b7-fb0a-4723-9ab3-a23691b76eae None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:29.113238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc167b7-fb0a-4723-9ab3-a23691b76eae None admin] PATH_INFO: `/v3/roles/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:29.126063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc167b7-fb0a-4723-9ab3-a23691b76eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:29.131548 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd14b4-9738-4799-a4e3-36fc056dabf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3381c0688581489b903e641f91914839, user_id=f332ac2346f0444a8d336ed2b3121be2, role_id=6c9336a73ed74d66a83c59fb3269efd5)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-9cc167b7-fb0a-4723-9ab3-a23691b76eae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:29.132763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:29.134268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:29.135718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:29.135718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:29.135718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:29.135718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:29.135718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:29.135718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:29.135718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:29.135718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:29.135718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:29.135718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:29.135718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:29.135718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:29.135718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 303/607] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:29.139703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc167b7-fb0a-4723-9ab3-a23691b76eae None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:29.140220 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd14b4-9738-4799-a4e3-36fc056dabf6 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:29.164766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 305/608] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:54:28 2022] PUT /identity/v3/projects/3381c0688581489b903e641f91914839/users/f332ac2346f0444a8d336ed2b3121be2/roles/6c9336a73ed74d66a83c59fb3269efd5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:54:29.166670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd14b4-9738-4799-a4e3-36fc056dabf6 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:29.288784 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:29.345004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:29.361459 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd14b4-9738-4799-a4e3-36fc056dabf6 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:29.430424 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc167b7-fb0a-4723-9ab3-a23691b76eae None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:29.448077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d6f17-d60f-4a5d-8429-dada5ae377b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:29.448771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d6f17-d60f-4a5d-8429-dada5ae377b9 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:29.449044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d6f17-d60f-4a5d-8429-dada5ae377b9 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:29.449319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d6f17-d60f-4a5d-8429-dada5ae377b9 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:29.450015 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d6f17-d60f-4a5d-8429-dada5ae377b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:29.450322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d6f17-d60f-4a5d-8429-dada5ae377b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:29.451859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d6f17-d60f-4a5d-8429-dada5ae377b9 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:29.463938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 306/609] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:29.470037 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d6f17-d60f-4a5d-8429-dada5ae377b9 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:29.480189 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f749335-0837-4f29-bf94-ce89620c2062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:29.481251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f749335-0837-4f29-bf94-ce89620c2062 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:29.481747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f749335-0837-4f29-bf94-ce89620c2062 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:29.482233 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f749335-0837-4f29-bf94-ce89620c2062 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:29.483243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f749335-0837-4f29-bf94-ce89620c2062 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:29.483747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f749335-0837-4f29-bf94-ce89620c2062 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:29.485627 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f749335-0837-4f29-bf94-ce89620c2062 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:29.501266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 304/610] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:29.507275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f749335-0837-4f29-bf94-ce89620c2062 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:29.595365 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d6f17-d60f-4a5d-8429-dada5ae377b9 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:29.656931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f749335-0837-4f29-bf94-ce89620c2062 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:29.662163 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ea115-fe4d-48be-879e-b63093da7b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:29.662825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ea115-fe4d-48be-879e-b63093da7b7a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:29.663103 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ea115-fe4d-48be-879e-b63093da7b7a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:29.663369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ea115-fe4d-48be-879e-b63093da7b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:29.675225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:29.682598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ea115-fe4d-48be-879e-b63093da7b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:29.684095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ea115-fe4d-48be-879e-b63093da7b7a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:29.703022 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa6c13-231b-46a8-bf01-63cc0f519ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:29.703703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa6c13-231b-46a8-bf01-63cc0f519ce3 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:29.703981 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa6c13-231b-46a8-bf01-63cc0f519ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:29.704252 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa6c13-231b-46a8-bf01-63cc0f519ce3 None admin] PATH_INFO: `/v3/projects/3381c0688581489b903e641f91914839/users/eefd1293a22848e3b595e54be0455d10/roles/6c9336a73ed74d66a83c59fb3269efd5` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-580ea115-fe4d-48be-879e-b63093da7b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:29.704600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:29.705752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:29.708783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:29.708783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:29.708783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:29.708783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 307/611] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:29.708783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784ddd6-7cb8-4ee6-9fc0-f6f5e8ea5742 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:29.708783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784ddd6-7cb8-4ee6-9fc0-f6f5e8ea5742 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:29.708783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784ddd6-7cb8-4ee6-9fc0-f6f5e8ea5742 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:29.714337 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 308/612] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:29.715756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7213869-bbb1-4c59-843d-3a602dc00fcf None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:29.716049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7213869-bbb1-4c59-843d-3a602dc00fcf None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:29.716328 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7213869-bbb1-4c59-843d-3a602dc00fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:29.723898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:29.732549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa6c13-231b-46a8-bf01-63cc0f519ce3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3381c0688581489b903e641f91914839, user_id=eefd1293a22848e3b595e54be0455d10, role_id=6c9336a73ed74d66a83c59fb3269efd5)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:29.734556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa6c13-231b-46a8-bf01-63cc0f519ce3 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:29.737951 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-d7213869-bbb1-4c59-843d-3a602dc00fcf None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:29.739341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d7213869-bbb1-4c59-843d-3a602dc00fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:29.757053 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 305/613] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:54:29 2022] PUT /identity/v3/projects/3381c0688581489b903e641f91914839/users/eefd1293a22848e3b595e54be0455d10/roles/6c9336a73ed74d66a83c59fb3269efd5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:54:29.758371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa6c13-231b-46a8-bf01-63cc0f519ce3 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:29.843238 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 309/614] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:29.941629 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa6c13-231b-46a8-bf01-63cc0f519ce3 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:30.020611 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68033f9e-6aed-4471-b019-8acf97fe0002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:30.021642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68033f9e-6aed-4471-b019-8acf97fe0002 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:30.022104 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68033f9e-6aed-4471-b019-8acf97fe0002 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:30.022540 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68033f9e-6aed-4471-b019-8acf97fe0002 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:30.023649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68033f9e-6aed-4471-b019-8acf97fe0002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:30.024124 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68033f9e-6aed-4471-b019-8acf97fe0002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:30.026549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68033f9e-6aed-4471-b019-8acf97fe0002 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:30.047518 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 306/615] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:30.053984 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7213869-bbb1-4c59-843d-3a602dc00fcf None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:30.165539 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68033f9e-6aed-4471-b019-8acf97fe0002 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:30.223336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:30.247087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7213869-bbb1-4c59-843d-3a602dc00fcf None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:30.288601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:30.295762 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30f548-9945-4c7f-9db5-77c9b8a566ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:30.296553 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30f548-9945-4c7f-9db5-77c9b8a566ef None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:30.296835 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30f548-9945-4c7f-9db5-77c9b8a566ef None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:30.302095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30f548-9945-4c7f-9db5-77c9b8a566ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:30.313887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30f548-9945-4c7f-9db5-77c9b8a566ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:30.315929 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30f548-9945-4c7f-9db5-77c9b8a566ef None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-7c30f548-9945-4c7f-9db5-77c9b8a566ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:30.335871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:30.337261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:30.338270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:30.338270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:30.338270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:30.338270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:30.338270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:30.338270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:30.338270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:30.338270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:30.338270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:54:30.338270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:30.338270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 310/616] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:30.344269 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30f548-9945-4c7f-9db5-77c9b8a566ef None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:30.388702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68033f9e-6aed-4471-b019-8acf97fe0002 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:30.453149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18210e-27f3-4bfe-916c-6e237d82aea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:30.454175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18210e-27f3-4bfe-916c-6e237d82aea8 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:30.454913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18210e-27f3-4bfe-916c-6e237d82aea8 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:30.456837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18210e-27f3-4bfe-916c-6e237d82aea8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:30.489480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18210e-27f3-4bfe-916c-6e237d82aea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-1c18210e-27f3-4bfe-916c-6e237d82aea8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:30.496888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:30.498375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:30.499208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:30.499208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:30.499208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:30.499208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:30.499208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:30.499208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:30.499208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:30.499208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:30.499208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:30.499208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:30.499208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:30.499208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:30.507877 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 307/617] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:30.513786 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18210e-27f3-4bfe-916c-6e237d82aea8 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:30.572595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30f548-9945-4c7f-9db5-77c9b8a566ef None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:30.672846 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a4c07-0a73-468f-83a6-44af3a9c1ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:30.673781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a4c07-0a73-468f-83a6-44af3a9c1ac0 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:30.674275 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a4c07-0a73-468f-83a6-44af3a9c1ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:30.675295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a4c07-0a73-468f-83a6-44af3a9c1ac0 None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:30.676226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a4c07-0a73-468f-83a6-44af3a9c1ac0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:30.676752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a4c07-0a73-468f-83a6-44af3a9c1ac0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:30.700797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a4c07-0a73-468f-83a6-44af3a9c1ac0 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:30.728492 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:30.740022 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 311/618] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Sep 7 12:54:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:30.745547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a4c07-0a73-468f-83a6-44af3a9c1ac0 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:30.751380 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18210e-27f3-4bfe-916c-6e237d82aea8 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:30.799954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baa115-13bd-4e7d-985c-b0ccb4691c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:30.800613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baa115-13bd-4e7d-985c-b0ccb4691c32 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:30.800896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baa115-13bd-4e7d-985c-b0ccb4691c32 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:30.801171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baa115-13bd-4e7d-985c-b0ccb4691c32 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:30.801877 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37baa115-13bd-4e7d-985c-b0ccb4691c32 None admin] RBAC: Adding query filter params (name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:30.802182 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37baa115-13bd-4e7d-985c-b0ccb4691c32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:30.803614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37baa115-13bd-4e7d-985c-b0ccb4691c32 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:30.816867 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 308/619] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:30.829520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baa115-13bd-4e7d-985c-b0ccb4691c32 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:30.852410 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:31.010464 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a4c07-0a73-468f-83a6-44af3a9c1ac0 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:31.015284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baa115-13bd-4e7d-985c-b0ccb4691c32 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:31.072284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf40b73-62f2-458d-8703-feafe90a6be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:31.073018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf40b73-62f2-458d-8703-feafe90a6be9 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:31.073298 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf40b73-62f2-458d-8703-feafe90a6be9 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:31.073570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf40b73-62f2-458d-8703-feafe90a6be9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:31.102913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf40b73-62f2-458d-8703-feafe90a6be9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:31.106827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf40b73-62f2-458d-8703-feafe90a6be9 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:31.108589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62439faf-0710-459d-88fb-2143b132f1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:31.109253 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62439faf-0710-459d-88fb-2143b132f1a0 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:31.109527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62439faf-0710-459d-88fb-2143b132f1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:31.109790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62439faf-0710-459d-88fb-2143b132f1a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:31.124821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-2bf40b73-62f2-458d-8703-feafe90a6be9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:31.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:31.140478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:31.143602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:31.143602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:31.143602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:31.143602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 309/620] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:31.143847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62439faf-0710-459d-88fb-2143b132f1a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:31.143847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62439faf-0710-459d-88fb-2143b132f1a0 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:31.152870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf40b73-62f2-458d-8703-feafe90a6be9 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-62439faf-0710-459d-88fb-2143b132f1a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:31.170611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:31.174080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:31.181492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:31.181492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:31.181492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:31.181492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 312/621] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:54:31.182032 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62439faf-0710-459d-88fb-2143b132f1a0 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:31.281057 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf40b73-62f2-458d-8703-feafe90a6be9 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:31.336185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52727702-d62d-486c-879f-24ec950629f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:31.336846 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52727702-d62d-486c-879f-24ec950629f2 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:31.337172 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52727702-d62d-486c-879f-24ec950629f2 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:31.337360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52727702-d62d-486c-879f-24ec950629f2 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:31.338026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52727702-d62d-486c-879f-24ec950629f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:31.338326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52727702-d62d-486c-879f-24ec950629f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:31.339707 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52727702-d62d-486c-879f-24ec950629f2 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:31.355332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 310/622] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:31.362433 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52727702-d62d-486c-879f-24ec950629f2 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:31.471347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62439faf-0710-459d-88fb-2143b132f1a0 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:31.474140 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:31.507284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:31.568229 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090eb7b-a1fd-483d-babd-955ebab6c561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:31.570370 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090eb7b-a1fd-483d-babd-955ebab6c561 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:31.573693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090eb7b-a1fd-483d-babd-955ebab6c561 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:31.575454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090eb7b-a1fd-483d-babd-955ebab6c561 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:31.576395 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090eb7b-a1fd-483d-babd-955ebab6c561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:31.577186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090eb7b-a1fd-483d-babd-955ebab6c561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:31.580302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090eb7b-a1fd-483d-babd-955ebab6c561 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:31.622712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 313/623] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:31.626041 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090eb7b-a1fd-483d-babd-955ebab6c561 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:31.627396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52727702-d62d-486c-879f-24ec950629f2 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:31.697053 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf6989-7344-43e6-adc1-0ba17025880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:31.698951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf6989-7344-43e6-adc1-0ba17025880a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:31.703172 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf6989-7344-43e6-adc1-0ba17025880a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:31.703172 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf6989-7344-43e6-adc1-0ba17025880a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:31.717703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf6989-7344-43e6-adc1-0ba17025880a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:31.720198 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf6989-7344-43e6-adc1-0ba17025880a None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-54bf6989-7344-43e6-adc1-0ba17025880a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:31.740849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:31.742526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:31.744240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:31.744240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:31.744240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:31.744240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:31.744240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:31.744240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:31.744240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:31.744240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:31.744240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:54:31.744240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:31.747342 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 311/624] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:31.751643 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7089a5-9ae4-4fcb-8bf6-b2c347cd9324 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:31.751643 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7089a5-9ae4-4fcb-8bf6-b2c347cd9324 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:31.751643 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7089a5-9ae4-4fcb-8bf6-b2c347cd9324 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:31.752087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 312/625] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:31.752935 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7089a5-9ae4-4fcb-8bf6-b2c347cd9324 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:31.810825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090eb7b-a1fd-483d-babd-955ebab6c561 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:31.866875 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b059748-3238-4a70-ab27-0a6a3c36f8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:31.867921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b059748-3238-4a70-ab27-0a6a3c36f8fd None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:31.868407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b059748-3238-4a70-ab27-0a6a3c36f8fd None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:31.869009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b059748-3238-4a70-ab27-0a6a3c36f8fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:31.879020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b059748-3238-4a70-ab27-0a6a3c36f8fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:31.882265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b059748-3238-4a70-ab27-0a6a3c36f8fd None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:31.897919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-9b059748-3238-4a70-ab27-0a6a3c36f8fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:31.897919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:31.897919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:31.897919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:31.897919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:31.897919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:31.897919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:31.897919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:31.897919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:31.897919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:31.897919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:31.897919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:31.897919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:31.897919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:31.897919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:31.898915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:31.899845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:31.899845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:31.899845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:31.899845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:31.899845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:31.899845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:31.899845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:31.899845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:31.903043 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 314/626] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:31.905524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d622b5-c7c9-43b3-af38-c132fbe37b6f None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:31.906330 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d622b5-c7c9-43b3-af38-c132fbe37b6f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:31.907032 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d622b5-c7c9-43b3-af38-c132fbe37b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:31.908928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7089a5-9ae4-4fcb-8bf6-b2c347cd9324 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:31.935638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-09d622b5-c7c9-43b3-af38-c132fbe37b6f None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:31.937333 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-09d622b5-c7c9-43b3-af38-c132fbe37b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:31.938533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:31.960227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:31.967235 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcce76-3388-4c32-ad6a-7ca394fff36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:31.967847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcce76-3388-4c32-ad6a-7ca394fff36c None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:31.968594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcce76-3388-4c32-ad6a-7ca394fff36c None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:31.968594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcce76-3388-4c32-ad6a-7ca394fff36c None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:31.969138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcce76-3388-4c32-ad6a-7ca394fff36c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:31.969443 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcce76-3388-4c32-ad6a-7ca394fff36c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:31.971029 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcce76-3388-4c32-ad6a-7ca394fff36c None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:31.996817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 313/627] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Sep 7 12:54:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:31.997840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcce76-3388-4c32-ad6a-7ca394fff36c None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:32.031044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 315/628] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:32.032526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d622b5-c7c9-43b3-af38-c132fbe37b6f None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:32.163137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d622b5-c7c9-43b3-af38-c132fbe37b6f None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:32.217941 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98d987-12f3-4efc-97f7-ca456c930632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:32.218959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98d987-12f3-4efc-97f7-ca456c930632 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:32.221991 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcce76-3388-4c32-ad6a-7ca394fff36c None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:32.222474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98d987-12f3-4efc-97f7-ca456c930632 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:32.222995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98d987-12f3-4efc-97f7-ca456c930632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:32.254288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:32.260415 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317b1c9-7c4b-4925-99e2-89fb108b5980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:32.261040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317b1c9-7c4b-4925-99e2-89fb108b5980 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:32.261317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317b1c9-7c4b-4925-99e2-89fb108b5980 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:32.261587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317b1c9-7c4b-4925-99e2-89fb108b5980 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:32.262312 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317b1c9-7c4b-4925-99e2-89fb108b5980 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:32.262863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317b1c9-7c4b-4925-99e2-89fb108b5980 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:32.264159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317b1c9-7c4b-4925-99e2-89fb108b5980 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:32.278054 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 314/629] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:32.279365 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bf59e-352a-428e-b379-14d056a64495 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:32.279647 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bf59e-352a-428e-b379-14d056a64495 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:32.279958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bf59e-352a-428e-b379-14d056a64495 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:32.286888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 315/630] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:32.287728 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bf59e-352a-428e-b379-14d056a64495 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:32.317947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98d987-12f3-4efc-97f7-ca456c930632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:32.319888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98d987-12f3-4efc-97f7-ca456c930632 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:32.339483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:32.440578 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bf59e-352a-428e-b379-14d056a64495 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:32.447851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 316/631] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:32.449486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d92507-3a60-4762-bca6-6cb616c6f9f8 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:32.450033 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d92507-3a60-4762-bca6-6cb616c6f9f8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:32.450520 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d92507-3a60-4762-bca6-6cb616c6f9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:32.471863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-d0d92507-3a60-4762-bca6-6cb616c6f9f8 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:32.473186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d0d92507-3a60-4762-bca6-6cb616c6f9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:32.491757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a74c1-37fc-4afc-9b87-14776584b187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:32.492817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a74c1-37fc-4afc-9b87-14776584b187 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:32.493381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a74c1-37fc-4afc-9b87-14776584b187 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:32.493775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a74c1-37fc-4afc-9b87-14776584b187 None admin] PATH_INFO: `/v3/projects/3381c0688581489b903e641f91914839/users/f3796ca94b914fd18946551fa2bff331/roles/6c9336a73ed74d66a83c59fb3269efd5` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:32.513680 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a74c1-37fc-4afc-9b87-14776584b187 None admin] RBAC: Authorizing `identity:create_grant(project_id=3381c0688581489b903e641f91914839, user_id=f3796ca94b914fd18946551fa2bff331, role_id=6c9336a73ed74d66a83c59fb3269efd5)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:32.515309 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a74c1-37fc-4afc-9b87-14776584b187 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:32.531331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:32.532367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 316/632] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:54:32 2022] PUT /identity/v3/projects/3381c0688581489b903e641f91914839/users/f3796ca94b914fd18946551fa2bff331/roles/6c9336a73ed74d66a83c59fb3269efd5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:54:32.533241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a74c1-37fc-4afc-9b87-14776584b187 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:32.578537 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 317/633] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:32.579615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d92507-3a60-4762-bca6-6cb616c6f9f8 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:32.708648 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:32.738092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a74c1-37fc-4afc-9b87-14776584b187 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:32.808648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d92507-3a60-4762-bca6-6cb616c6f9f8 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:32.814498 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ae042-d17c-4e07-962e-4afffb34a8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:32.815460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ae042-d17c-4e07-962e-4afffb34a8dc None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:32.815735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ae042-d17c-4e07-962e-4afffb34a8dc None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:32.816007 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ae042-d17c-4e07-962e-4afffb34a8dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:32.829326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ae042-d17c-4e07-962e-4afffb34a8dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:32.831268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ae042-d17c-4e07-962e-4afffb34a8dc None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-392ae042-d17c-4e07-962e-4afffb34a8dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:32.851596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:32.852777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:32.854055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:32.854055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:32.854055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:32.854055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 317/634] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:32.865927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ae042-d17c-4e07-962e-4afffb34a8dc None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:32.866547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3fbe8-3117-4b3a-9a18-a8ee05ed3d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:32.867810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3fbe8-3117-4b3a-9a18-a8ee05ed3d03 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:32.868347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3fbe8-3117-4b3a-9a18-a8ee05ed3d03 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:32.869008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3fbe8-3117-4b3a-9a18-a8ee05ed3d03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:32.887573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3fbe8-3117-4b3a-9a18-a8ee05ed3d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-41f3fbe8-3117-4b3a-9a18-a8ee05ed3d03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:32.893509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:32.894598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:32.895449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:32.895449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:32.895449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:32.895449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:32.895449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:32.895449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:32.895449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:32.895449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:32.895449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:32.895449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:32.895449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:32.895449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:32.898426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 318/635] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:32.906806 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3fbe8-3117-4b3a-9a18-a8ee05ed3d03 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:32.997743 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:33.019336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ae042-d17c-4e07-962e-4afffb34a8dc None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:33.062514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3fbe8-3117-4b3a-9a18-a8ee05ed3d03 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:33.073373 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f745e-d8e2-4bdf-96f7-a9c3386f133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:33.074306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f745e-d8e2-4bdf-96f7-a9c3386f133d None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:33.074731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f745e-d8e2-4bdf-96f7-a9c3386f133d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:33.075137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f745e-d8e2-4bdf-96f7-a9c3386f133d None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:33.076284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f745e-d8e2-4bdf-96f7-a9c3386f133d None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:33.076782 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f745e-d8e2-4bdf-96f7-a9c3386f133d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:33.079023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f745e-d8e2-4bdf-96f7-a9c3386f133d None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:33.088399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:33.099620 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 318/636] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:33.099620 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f745e-d8e2-4bdf-96f7-a9c3386f133d None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:33.110723 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c17e5c-5dbf-4cc1-9cf1-771c88ecabe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:33.112046 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c17e5c-5dbf-4cc1-9cf1-771c88ecabe3 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:33.112775 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c17e5c-5dbf-4cc1-9cf1-771c88ecabe3 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:33.113204 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c17e5c-5dbf-4cc1-9cf1-771c88ecabe3 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:33.114067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c17e5c-5dbf-4cc1-9cf1-771c88ecabe3 None admin] RBAC: Adding query filter params (name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:33.114591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c17e5c-5dbf-4cc1-9cf1-771c88ecabe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:33.116288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c17e5c-5dbf-4cc1-9cf1-771c88ecabe3 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:33.126885 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 319/637] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:33.128640 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ec327-636c-4fd7-b3f0-448db8261b69 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:33.129096 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ec327-636c-4fd7-b3f0-448db8261b69 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:33.129514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ec327-636c-4fd7-b3f0-448db8261b69 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:33.131331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 320/638] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:33.132292 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ec327-636c-4fd7-b3f0-448db8261b69 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:33.257568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f745e-d8e2-4bdf-96f7-a9c3386f133d None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:33.299312 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ec327-636c-4fd7-b3f0-448db8261b69 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:33.303470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:33.316190 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5aa8a-b6f3-4632-9c2d-2c4554c3f502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:33.316919 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5aa8a-b6f3-4632-9c2d-2c4554c3f502 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:33.317187 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5aa8a-b6f3-4632-9c2d-2c4554c3f502 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:33.317461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5aa8a-b6f3-4632-9c2d-2c4554c3f502 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:33.339269 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5aa8a-b6f3-4632-9c2d-2c4554c3f502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-c6a5aa8a-b6f3-4632-9c2d-2c4554c3f502 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:33.344779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:33.346700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:33.348425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:33.348425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:33.348425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:33.348425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:33.348425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:33.348425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:33.348425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:33.348425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:33.348425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:33.348425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:33.348425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:33.348425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:33.348425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 319/639] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:33.348425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5aa8a-b6f3-4632-9c2d-2c4554c3f502 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:33.374246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf43d7-bfbb-409d-ac6d-2f171b40c754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:33.375169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf43d7-bfbb-409d-ac6d-2f171b40c754 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:33.375444 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf43d7-bfbb-409d-ac6d-2f171b40c754 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:33.375711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf43d7-bfbb-409d-ac6d-2f171b40c754 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:33.384078 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf43d7-bfbb-409d-ac6d-2f171b40c754 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:33.385597 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf43d7-bfbb-409d-ac6d-2f171b40c754 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:33.398768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-16bf43d7-bfbb-409d-ac6d-2f171b40c754 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:33.398768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:33.398768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:33.398768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:33.398768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:33.398768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:33.398768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:33.398768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:33.398768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:33.398768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:33.398768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:33.398768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:33.398768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:33.398768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:33.398768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:33.400231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:33.401356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:33.401356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:33.401356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:33.401356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:33.401356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:33.401356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:33.401356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:33.401356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:33.404716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 321/640] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:33.406139 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f065a-5936-49e6-9573-b617a61ca7ec None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:33.406423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f065a-5936-49e6-9573-b617a61ca7ec None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:33.406739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f065a-5936-49e6-9573-b617a61ca7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:33.432272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:33.434155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-de4f065a-5936-49e6-9573-b617a61ca7ec None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:33.435443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-de4f065a-5936-49e6-9573-b617a61ca7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:33.494086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5aa8a-b6f3-4632-9c2d-2c4554c3f502 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:33.533028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 322/641] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:33.533028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f065a-5936-49e6-9573-b617a61ca7ec None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:33.563808 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1df6a5-f17f-419e-a1e3-c70b328c8afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:33.564778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1df6a5-f17f-419e-a1e3-c70b328c8afe None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:33.565915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1df6a5-f17f-419e-a1e3-c70b328c8afe None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:33.566432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1df6a5-f17f-419e-a1e3-c70b328c8afe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:33.587097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1df6a5-f17f-419e-a1e3-c70b328c8afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:33.588614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1df6a5-f17f-419e-a1e3-c70b328c8afe None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-3b1df6a5-f17f-419e-a1e3-c70b328c8afe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:33.612936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:33.619829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:33.620873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:33.620873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:33.620873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:33.620873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 320/642] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:33.620873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1df6a5-f17f-419e-a1e3-c70b328c8afe None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:33.677019 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:33.688924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f065a-5936-49e6-9573-b617a61ca7ec None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:33.736272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af0607-ad82-4ba7-9f8f-592051997edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:33.738001 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af0607-ad82-4ba7-9f8f-592051997edf None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:33.738759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af0607-ad82-4ba7-9f8f-592051997edf None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:33.739291 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af0607-ad82-4ba7-9f8f-592051997edf None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:33.740171 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af0607-ad82-4ba7-9f8f-592051997edf None admin] RBAC: Adding query filter params (name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:33.740663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af0607-ad82-4ba7-9f8f-592051997edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:33.742699 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af0607-ad82-4ba7-9f8f-592051997edf None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:33.756016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 323/643] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:33.757227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af0607-ad82-4ba7-9f8f-592051997edf None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:33.812422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1df6a5-f17f-419e-a1e3-c70b328c8afe None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:33.832489 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:33.872088 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2f1e0-b682-4a8e-ae5a-25b41091ed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:33.872760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2f1e0-b682-4a8e-ae5a-25b41091ed36 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:33.873344 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2f1e0-b682-4a8e-ae5a-25b41091ed36 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:33.873694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2f1e0-b682-4a8e-ae5a-25b41091ed36 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:33.874326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2f1e0-b682-4a8e-ae5a-25b41091ed36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:33.874633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2f1e0-b682-4a8e-ae5a-25b41091ed36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:33.876125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2f1e0-b682-4a8e-ae5a-25b41091ed36 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:33.892541 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 321/644] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:33.895003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2f1e0-b682-4a8e-ae5a-25b41091ed36 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:33.900243 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af0607-ad82-4ba7-9f8f-592051997edf None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:33.950534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28838ff2-a815-4984-bf4e-862c0b5f5046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:33.951263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28838ff2-a815-4984-bf4e-862c0b5f5046 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:33.951743 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28838ff2-a815-4984-bf4e-862c0b5f5046 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:33.951975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28838ff2-a815-4984-bf4e-862c0b5f5046 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:33.952669 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28838ff2-a815-4984-bf4e-862c0b5f5046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:33.953013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28838ff2-a815-4984-bf4e-862c0b5f5046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:33.954546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28838ff2-a815-4984-bf4e-862c0b5f5046 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:33.975490 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 324/645] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:33.975490 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28838ff2-a815-4984-bf4e-862c0b5f5046 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:34.001915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:34.037691 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2f1e0-b682-4a8e-ae5a-25b41091ed36 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:34.088866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717378-c1fd-46ef-b2b2-3e1e0ae3b134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:34.089594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717378-c1fd-46ef-b2b2-3e1e0ae3b134 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:34.089894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717378-c1fd-46ef-b2b2-3e1e0ae3b134 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:34.090131 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717378-c1fd-46ef-b2b2-3e1e0ae3b134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:34.102581 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b717378-c1fd-46ef-b2b2-3e1e0ae3b134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:34.104083 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b717378-c1fd-46ef-b2b2-3e1e0ae3b134 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:34.108129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28838ff2-a815-4984-bf4e-862c0b5f5046 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-2b717378-c1fd-46ef-b2b2-3e1e0ae3b134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:34.122475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:34.123871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:34.126080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:34.126080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:34.126080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:34.126080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 322/646] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:34.126080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717378-c1fd-46ef-b2b2-3e1e0ae3b134 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:34.162706 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3ffec-7560-431f-894f-392389ce7026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:34.163393 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:34.164262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3ffec-7560-431f-894f-392389ce7026 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:34.164794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3ffec-7560-431f-894f-392389ce7026 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:34.165287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3ffec-7560-431f-894f-392389ce7026 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:34.186648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3ffec-7560-431f-894f-392389ce7026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-12b3ffec-7560-431f-894f-392389ce7026 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:34.196534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:34.198113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:34.199584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:34.199584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:34.199584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:34.199584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:34.199584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:34.199584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:34.199584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:34.199584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:34.199584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:34.199584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:34.199584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:34.199584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:34.199584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 325/647] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:34.201557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3ffec-7560-431f-894f-392389ce7026 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:34.284398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717378-c1fd-46ef-b2b2-3e1e0ae3b134 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:34.319645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:34.341649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346e00b-869f-4797-8dd7-a5d7d8893822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:34.342155 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346e00b-869f-4797-8dd7-a5d7d8893822 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:34.342433 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346e00b-869f-4797-8dd7-a5d7d8893822 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:34.342703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346e00b-869f-4797-8dd7-a5d7d8893822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:34.343446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346e00b-869f-4797-8dd7-a5d7d8893822 None admin] RBAC: Adding query filter params (role.id=6c9336a73ed74d66a83c59fb3269efd5, scope.project.id=3381c0688581489b903e641f91914839, user.id=4089419bb88e4aeda23bf141370cb6e7) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:34.343750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346e00b-869f-4797-8dd7-a5d7d8893822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:34.345235 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346e00b-869f-4797-8dd7-a5d7d8893822 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:34.351924 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 323/648] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:34 2022] GET /identity/v3/role_assignments?user.id=4089419bb88e4aeda23bf141370cb6e7&scope.project.id=3381c0688581489b903e641f91914839&role.id=6c9336a73ed74d66a83c59fb3269efd5 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:34.352808 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346e00b-869f-4797-8dd7-a5d7d8893822 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:34.371372 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3ffec-7560-431f-894f-392389ce7026 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:34.432121 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b4b12-1db2-4b92-a79d-d1ab21d2594b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:34.432665 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b4b12-1db2-4b92-a79d-d1ab21d2594b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:34.432948 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b4b12-1db2-4b92-a79d-d1ab21d2594b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:34.433267 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b4b12-1db2-4b92-a79d-d1ab21d2594b None admin] PATH_INFO: `/v3/users/nova` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:34.444077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b4b12-1db2-4b92-a79d-d1ab21d2594b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:34.445645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b4b12-1db2-4b92-a79d-d1ab21d2594b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-724b4b12-1db2-4b92-a79d-d1ab21d2594b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:34.459958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:34.461104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:34.462559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:34.462559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:34.462559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:34.462559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:34.462559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:34.462559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:34.462559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:34.462559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:34.462559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:54:34.462559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:34.462559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 326/649] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Sep 7 12:54:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:34.463363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b4b12-1db2-4b92-a79d-d1ab21d2594b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:34.496391 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:34.523735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346e00b-869f-4797-8dd7-a5d7d8893822 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:34.571034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb89ad-fc0a-47d8-b1a5-f58511f39056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:34.571733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb89ad-fc0a-47d8-b1a5-f58511f39056 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:34.572035 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb89ad-fc0a-47d8-b1a5-f58511f39056 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:34.572284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb89ad-fc0a-47d8-b1a5-f58511f39056 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:34.572925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb89ad-fc0a-47d8-b1a5-f58511f39056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:34.573235 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb89ad-fc0a-47d8-b1a5-f58511f39056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:34.574679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb89ad-fc0a-47d8-b1a5-f58511f39056 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:34.589623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 324/650] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:34.590589 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb89ad-fc0a-47d8-b1a5-f58511f39056 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:34.626356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b4b12-1db2-4b92-a79d-d1ab21d2594b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:34.692956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7fc60-b1c8-4258-a1e0-4e08f513ee17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:34.693603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7fc60-b1c8-4258-a1e0-4e08f513ee17 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:34.693880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7fc60-b1c8-4258-a1e0-4e08f513ee17 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:34.694153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7fc60-b1c8-4258-a1e0-4e08f513ee17 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:34.694846 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7fc60-b1c8-4258-a1e0-4e08f513ee17 None admin] RBAC: Adding query filter params (name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:34.695145 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7fc60-b1c8-4258-a1e0-4e08f513ee17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:34.697579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7fc60-b1c8-4258-a1e0-4e08f513ee17 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:34.712278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:34.730304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 327/651] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:34.730304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7fc60-b1c8-4258-a1e0-4e08f513ee17 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:34.758073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb89ad-fc0a-47d8-b1a5-f58511f39056 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:34.820442 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadc6c2-276e-4af8-9060-9c859497d327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:34.821193 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadc6c2-276e-4af8-9060-9c859497d327 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:34.821543 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadc6c2-276e-4af8-9060-9c859497d327 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:34.822175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadc6c2-276e-4af8-9060-9c859497d327 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:34.822948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadc6c2-276e-4af8-9060-9c859497d327 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:34.823254 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadc6c2-276e-4af8-9060-9c859497d327 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:34.825227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadc6c2-276e-4af8-9060-9c859497d327 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:34.864538 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 325/652] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Sep 7 12:54:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:34.865696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadc6c2-276e-4af8-9060-9c859497d327 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:34.874397 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:34.900132 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7fc60-b1c8-4258-a1e0-4e08f513ee17 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:34.951584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029827c-7257-492f-bfd4-29f7dc7a0d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:34.953168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029827c-7257-492f-bfd4-29f7dc7a0d22 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:34.953446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029827c-7257-492f-bfd4-29f7dc7a0d22 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:34.953712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029827c-7257-492f-bfd4-29f7dc7a0d22 None admin] PATH_INFO: `/v3/users/glance` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:34.970939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029827c-7257-492f-bfd4-29f7dc7a0d22 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:34.974076 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029827c-7257-492f-bfd4-29f7dc7a0d22 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-9029827c-7257-492f-bfd4-29f7dc7a0d22 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:34.997228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:34.998692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:34.999730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:34.999730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:34.999730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:34.999730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:34.999730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:34.999730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:34.999730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:34.999730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:34.999730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:54:34.999730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:35.007421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 328/653] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:35.008053 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029827c-7257-492f-bfd4-29f7dc7a0d22 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:35.027114 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadc6c2-276e-4af8-9060-9c859497d327 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:35.077632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67560d15-7050-486a-b9c6-a045ffd64a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:35.078295 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67560d15-7050-486a-b9c6-a045ffd64a96 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:35.078577 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67560d15-7050-486a-b9c6-a045ffd64a96 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:35.078847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67560d15-7050-486a-b9c6-a045ffd64a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:35.082536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:35.091019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67560d15-7050-486a-b9c6-a045ffd64a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:35.092555 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67560d15-7050-486a-b9c6-a045ffd64a96 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-67560d15-7050-486a-b9c6-a045ffd64a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:35.109821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:35.110857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:35.117550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:35.117550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:35.117550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:35.117550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 326/654] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:35.117550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67560d15-7050-486a-b9c6-a045ffd64a96 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:35.141983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029827c-7257-492f-bfd4-29f7dc7a0d22 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:35.191782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c90c1-4707-4cd3-bc8a-ddca523ee38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:35.192314 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c90c1-4707-4cd3-bc8a-ddca523ee38b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:35.192676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c90c1-4707-4cd3-bc8a-ddca523ee38b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:35.192946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c90c1-4707-4cd3-bc8a-ddca523ee38b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:35.193376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:35.256562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67560d15-7050-486a-b9c6-a045ffd64a96 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:35.286092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c90c1-4707-4cd3-bc8a-ddca523ee38b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:35.288464 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c90c1-4707-4cd3-bc8a-ddca523ee38b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:35.296497 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c454fb-ecfc-4476-b965-b6c85f2371c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:35.297446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c454fb-ecfc-4476-b965-b6c85f2371c5 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:35.297744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c454fb-ecfc-4476-b965-b6c85f2371c5 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:35.298008 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c454fb-ecfc-4476-b965-b6c85f2371c5 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:35.299332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c454fb-ecfc-4476-b965-b6c85f2371c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:35.299332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c454fb-ecfc-4476-b965-b6c85f2371c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:35.301377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c454fb-ecfc-4476-b965-b6c85f2371c5 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:35.327136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 327/655] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Sep 7 12:54:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:35.328736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce9290-4e66-461f-8bdc-23f9dcb55e10 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:35.328964 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce9290-4e66-461f-8bdc-23f9dcb55e10 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:35.329242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce9290-4e66-461f-8bdc-23f9dcb55e10 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:35.332416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 328/656] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:35.332416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce9290-4e66-461f-8bdc-23f9dcb55e10 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:35.376767 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:35.443917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 329/657] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:35.443917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c90c1-4707-4cd3-bc8a-ddca523ee38b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:35.474289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce9290-4e66-461f-8bdc-23f9dcb55e10 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:35.498640 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:35.528499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d088d-fcc8-4d97-8eb4-2c7dba1d7e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:35.529127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d088d-fcc8-4d97-8eb4-2c7dba1d7e12 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:35.529405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d088d-fcc8-4d97-8eb4-2c7dba1d7e12 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:35.529752 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d088d-fcc8-4d97-8eb4-2c7dba1d7e12 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:35.530763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d088d-fcc8-4d97-8eb4-2c7dba1d7e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:35.531492 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d088d-fcc8-4d97-8eb4-2c7dba1d7e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:35.534563 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d088d-fcc8-4d97-8eb4-2c7dba1d7e12 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:35.549437 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 329/658] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:35.550574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d0c85-1088-47d5-98a1-61ae48838422 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:35.550853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d0c85-1088-47d5-98a1-61ae48838422 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:35.551121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d0c85-1088-47d5-98a1-61ae48838422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:35.571735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-203d0c85-1088-47d5-98a1-61ae48838422 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:35.573631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-203d0c85-1088-47d5-98a1-61ae48838422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:35.587549 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c90c1-4707-4cd3-bc8a-ddca523ee38b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:35.632330 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ded131-83e4-41cc-b304-e062c20db836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:35.633021 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ded131-83e4-41cc-b304-e062c20db836 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:35.633431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ded131-83e4-41cc-b304-e062c20db836 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:35.634014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ded131-83e4-41cc-b304-e062c20db836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:35.676407 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 330/659] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:35.676407 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d0c85-1088-47d5-98a1-61ae48838422 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:35.680012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:35.735226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ded131-83e4-41cc-b304-e062c20db836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:35.737495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ded131-83e4-41cc-b304-e062c20db836 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:35.797400 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d0c85-1088-47d5-98a1-61ae48838422 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:35.836479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e6f0e-3a18-4fe0-9603-ae82f038cde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:35.837140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e6f0e-3a18-4fe0-9603-ae82f038cde4 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:35.837425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e6f0e-3a18-4fe0-9603-ae82f038cde4 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:35.837701 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e6f0e-3a18-4fe0-9603-ae82f038cde4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:35.846132 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:35.855289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e6f0e-3a18-4fe0-9603-ae82f038cde4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:35.857046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e6f0e-3a18-4fe0-9603-ae82f038cde4 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:35.870869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 330/660] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:35.871899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ded131-83e4-41cc-b304-e062c20db836 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-925e6f0e-3a18-4fe0-9603-ae82f038cde4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:35.874954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:35.875951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:35.876886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:35.876886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:35.876886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:35.876886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 331/661] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:35.885588 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e6f0e-3a18-4fe0-9603-ae82f038cde4 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:35.958253 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:36.024988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e6f0e-3a18-4fe0-9603-ae82f038cde4 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:36.033474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ded131-83e4-41cc-b304-e062c20db836 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:36.077179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572f310-59bd-4af3-a017-8603831ae72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:36.077836 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572f310-59bd-4af3-a017-8603831ae72e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:36.078114 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572f310-59bd-4af3-a017-8603831ae72e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:36.078386 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572f310-59bd-4af3-a017-8603831ae72e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:36.082546 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d153a-d17d-4be6-a195-0a31844defce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:36.083542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d153a-d17d-4be6-a195-0a31844defce None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:36.084023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d153a-d17d-4be6-a195-0a31844defce None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:36.084536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d153a-d17d-4be6-a195-0a31844defce None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:36.085312 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d153a-d17d-4be6-a195-0a31844defce None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:36.085619 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d153a-d17d-4be6-a195-0a31844defce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:36.087018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d153a-d17d-4be6-a195-0a31844defce None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:36.087122 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572f310-59bd-4af3-a017-8603831ae72e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:36.088604 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572f310-59bd-4af3-a017-8603831ae72e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-e572f310-59bd-4af3-a017-8603831ae72e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:36.102205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:36.103255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:36.104203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:36.104203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:36.104203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:36.104203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:36.104203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:36.104203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:36.104203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:36.104203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:36.104203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:54:36.104203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:36.104203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 331/662] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:36.104203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572f310-59bd-4af3-a017-8603831ae72e None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:36.106349 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 332/663] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:36.107411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d153a-d17d-4be6-a195-0a31844defce None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:36.132776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:36.242804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d153a-d17d-4be6-a195-0a31844defce None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:36.256176 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572f310-59bd-4af3-a017-8603831ae72e None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:36.279788 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:36.284745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b2a21-8c78-40c5-a3f3-3257c04a8d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:36.285408 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b2a21-8c78-40c5-a3f3-3257c04a8d7a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:36.285736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b2a21-8c78-40c5-a3f3-3257c04a8d7a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:36.286058 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b2a21-8c78-40c5-a3f3-3257c04a8d7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:36.297237 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b2a21-8c78-40c5-a3f3-3257c04a8d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:36.298749 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf3c44-0a21-475a-97dc-2044ddfdd0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:36.299508 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf3c44-0a21-475a-97dc-2044ddfdd0f1 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:36.300001 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf3c44-0a21-475a-97dc-2044ddfdd0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:36.300136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf3c44-0a21-475a-97dc-2044ddfdd0f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-452b2a21-8c78-40c5-a3f3-3257c04a8d7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:36.302493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:36.303636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:36.304794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:36.304794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:36.304794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:36.304794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:36.304794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:36.304794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:36.304794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:36.304794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:36.304794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:36.304794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:36.304794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:36.304794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:36.304794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 333/664] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:36.304794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b2a21-8c78-40c5-a3f3-3257c04a8d7a None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:36.318107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf3c44-0a21-475a-97dc-2044ddfdd0f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:36.319336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf3c44-0a21-475a-97dc-2044ddfdd0f1 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-beaf3c44-0a21-475a-97dc-2044ddfdd0f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:36.339611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:36.340782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:36.341688 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:36.341688 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:36.341688 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:36.344576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 332/665] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:36.347677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf3c44-0a21-475a-97dc-2044ddfdd0f1 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:36.420915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:36.451849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b2a21-8c78-40c5-a3f3-3257c04a8d7a None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:36.482322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf3c44-0a21-475a-97dc-2044ddfdd0f1 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:36.497750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba3a02-24d4-4bc5-a988-3489465c9d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:36.499072 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba3a02-24d4-4bc5-a988-3489465c9d8a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:36.499405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba3a02-24d4-4bc5-a988-3489465c9d8a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:36.499622 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba3a02-24d4-4bc5-a988-3489465c9d8a None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:36.500408 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba3a02-24d4-4bc5-a988-3489465c9d8a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:36.500717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba3a02-24d4-4bc5-a988-3489465c9d8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:36.502798 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba3a02-24d4-4bc5-a988-3489465c9d8a None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:36.527320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab6314-a21d-420d-b892-fd07d27d48ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:36.528286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab6314-a21d-420d-b892-fd07d27d48ef None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:36.528738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab6314-a21d-420d-b892-fd07d27d48ef None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:36.528875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 334/666] 10.222.0.30 () {56 vars in 1139 bytes} [Wed Sep 7 12:54:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:36.529281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab6314-a21d-420d-b892-fd07d27d48ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:36.530225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba3a02-24d4-4bc5-a988-3489465c9d8a None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:36.544948 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab6314-a21d-420d-b892-fd07d27d48ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:36.546485 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab6314-a21d-420d-b892-fd07d27d48ef None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:36.559736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-7fab6314-a21d-420d-b892-fd07d27d48ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:36.559736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:36.559736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:36.559736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:36.559736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:36.559736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:36.559736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:36.559736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:36.559736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:36.559736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:36.559736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:36.559736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:36.559736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:36.559736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:36.559736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:36.561305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:36.562801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:36.562801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:36.562801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:36.562801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:36.562801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:36.562801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:36.562801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:36.562801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:36.566154 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 333/667] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:36.566937 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab6314-a21d-420d-b892-fd07d27d48ef None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:36.604622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:36.671554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba3a02-24d4-4bc5-a988-3489465c9d8a None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:36.693517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab6314-a21d-420d-b892-fd07d27d48ef None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:36.715152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07e916-08c0-438a-9ca4-ddd32aeef445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:36.716109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07e916-08c0-438a-9ca4-ddd32aeef445 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:36.716576 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07e916-08c0-438a-9ca4-ddd32aeef445 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:36.716944 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07e916-08c0-438a-9ca4-ddd32aeef445 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:36.717863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07e916-08c0-438a-9ca4-ddd32aeef445 None admin] RBAC: Adding query filter params (name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:36.718143 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07e916-08c0-438a-9ca4-ddd32aeef445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:36.719631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07e916-08c0-438a-9ca4-ddd32aeef445 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:36.721556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:36.742390 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 335/668] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:36.744152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07e916-08c0-438a-9ca4-ddd32aeef445 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:36.752366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21af47-cfde-4b56-ab70-618fd3ce0ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:36.753568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21af47-cfde-4b56-ab70-618fd3ce0ed4 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:36.753855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21af47-cfde-4b56-ab70-618fd3ce0ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:36.754129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21af47-cfde-4b56-ab70-618fd3ce0ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:36.755348 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21af47-cfde-4b56-ab70-618fd3ce0ed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:36.755677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21af47-cfde-4b56-ab70-618fd3ce0ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:36.757527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21af47-cfde-4b56-ab70-618fd3ce0ed4 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:36.772875 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 334/669] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:36.774128 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21af47-cfde-4b56-ab70-618fd3ce0ed4 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:36.874746 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07e916-08c0-438a-9ca4-ddd32aeef445 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:36.889004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:36.901040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21af47-cfde-4b56-ab70-618fd3ce0ed4 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:36.922745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92de8e-ed62-4cd0-8935-b6c0d5af8ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:36.923381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92de8e-ed62-4cd0-8935-b6c0d5af8ad0 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:36.923642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92de8e-ed62-4cd0-8935-b6c0d5af8ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:36.923985 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92de8e-ed62-4cd0-8935-b6c0d5af8ad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:36.944204 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e49332-3a1b-4c38-afaf-879b5978129e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:36.944856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e49332-3a1b-4c38-afaf-879b5978129e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:36.945131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e49332-3a1b-4c38-afaf-879b5978129e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:36.945400 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e49332-3a1b-4c38-afaf-879b5978129e None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:36.946099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e49332-3a1b-4c38-afaf-879b5978129e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:36.946397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e49332-3a1b-4c38-afaf-879b5978129e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:36.947887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e49332-3a1b-4c38-afaf-879b5978129e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:36.966717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 335/670] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:36.966717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e49332-3a1b-4c38-afaf-879b5978129e None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:37.000195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:37.016854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92de8e-ed62-4cd0-8935-b6c0d5af8ad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:37.018720 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92de8e-ed62-4cd0-8935-b6c0d5af8ad0 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:37.097789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e49332-3a1b-4c38-afaf-879b5978129e None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:37.137024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb7c6d-cded-4fe4-a3af-f5015d5c21a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:37.137659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb7c6d-cded-4fe4-a3af-f5015d5c21a3 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:37.137834 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb7c6d-cded-4fe4-a3af-f5015d5c21a3 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:37.138130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb7c6d-cded-4fe4-a3af-f5015d5c21a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:37.149859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb7c6d-cded-4fe4-a3af-f5015d5c21a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:37.150607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 336/671] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:37.151332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb7c6d-cded-4fe4-a3af-f5015d5c21a3 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:37.151480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92de8e-ed62-4cd0-8935-b6c0d5af8ad0 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-05cb7c6d-cded-4fe4-a3af-f5015d5c21a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:37.167556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:37.168735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:37.169732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:37.169732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:37.169732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:37.169732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 336/672] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:37.170309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50204fcf-e0bf-443c-8764-b5a4323a47bf None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:37.170309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50204fcf-e0bf-443c-8764-b5a4323a47bf None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:37.170470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50204fcf-e0bf-443c-8764-b5a4323a47bf None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:37.176496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 337/673] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:37.176496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50204fcf-e0bf-443c-8764-b5a4323a47bf None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:37.179131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:37.270850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:37.277981 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92de8e-ed62-4cd0-8935-b6c0d5af8ad0 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:37.300486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50204fcf-e0bf-443c-8764-b5a4323a47bf None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:37.325670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ddb1-673a-4ec0-8a17-ffbe67ee0a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:37.326318 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ddb1-673a-4ec0-8a17-ffbe67ee0a9b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:37.326596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ddb1-673a-4ec0-8a17-ffbe67ee0a9b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:37.326878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ddb1-673a-4ec0-8a17-ffbe67ee0a9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:37.334282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9ddb1-673a-4ec0-8a17-ffbe67ee0a9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:37.335788 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9ddb1-673a-4ec0-8a17-ffbe67ee0a9b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:37.338140 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567e190-7fe4-4a87-83ff-1cab999c42b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:37.338749 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567e190-7fe4-4a87-83ff-1cab999c42b2 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:37.339020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567e190-7fe4-4a87-83ff-1cab999c42b2 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:37.339294 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567e190-7fe4-4a87-83ff-1cab999c42b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:37.340050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567e190-7fe4-4a87-83ff-1cab999c42b2 None admin] RBAC: Adding query filter params (role.id=6c9336a73ed74d66a83c59fb3269efd5, scope.project.id=3381c0688581489b903e641f91914839, user.id=fbe8fa8ab8094aa69933398280810692) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:37.340352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567e190-7fe4-4a87-83ff-1cab999c42b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:37.341851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567e190-7fe4-4a87-83ff-1cab999c42b2 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:37.349211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 338/674] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:37 2022] GET /identity/v3/role_assignments?user.id=fbe8fa8ab8094aa69933398280810692&scope.project.id=3381c0688581489b903e641f91914839&role.id=6c9336a73ed74d66a83c59fb3269efd5 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:37.350055 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567e190-7fe4-4a87-83ff-1cab999c42b2 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:37.351071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-49e9ddb1-673a-4ec0-8a17-ffbe67ee0a9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:37.351071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:37.351071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:37.351071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:37.351071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:37.351071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:37.351071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:37.351071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:37.351071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:37.351071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:37.351071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:37.351071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:37.351071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:37.351071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:37.351071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:37.353026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:37.354940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:37.354940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:37.354940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:37.354940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:37.354940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:37.354940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:37.354940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:37.354940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:37.354940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 337/675] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:37.354940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ddb1-673a-4ec0-8a17-ffbe67ee0a9b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:37.459053 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:37.509095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ddb1-673a-4ec0-8a17-ffbe67ee0a9b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:37.513755 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567e190-7fe4-4a87-83ff-1cab999c42b2 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:37.556077 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d43b9-0ed5-4ab6-998f-143b297021bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:37.556300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197688fa-576e-4ea1-9f5e-e302e1d9e651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:37.556737 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d43b9-0ed5-4ab6-998f-143b297021bf None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:37.556828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197688fa-576e-4ea1-9f5e-e302e1d9e651 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:37.557010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d43b9-0ed5-4ab6-998f-143b297021bf None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:37.557096 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197688fa-576e-4ea1-9f5e-e302e1d9e651 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:37.557276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d43b9-0ed5-4ab6-998f-143b297021bf None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:37.557368 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197688fa-576e-4ea1-9f5e-e302e1d9e651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:37.558089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d43b9-0ed5-4ab6-998f-143b297021bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:37.558224 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d43b9-0ed5-4ab6-998f-143b297021bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:37.560479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d43b9-0ed5-4ab6-998f-143b297021bf None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:37.575656 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 338/676] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:37.575934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e06154-20e0-4869-a82c-987aa60473d5 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:37.576230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e06154-20e0-4869-a82c-987aa60473d5 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:37.576580 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e06154-20e0-4869-a82c-987aa60473d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:37.581491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197688fa-576e-4ea1-9f5e-e302e1d9e651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:37.583890 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197688fa-576e-4ea1-9f5e-e302e1d9e651 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:37.598329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-c2e06154-20e0-4869-a82c-987aa60473d5 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:37.599669 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c2e06154-20e0-4869-a82c-987aa60473d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-197688fa-576e-4ea1-9f5e-e302e1d9e651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:37.611919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:37.613099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:37.614149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:37.614149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:37.614149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:37.616605 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:37.621232 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 339/677] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:37.622402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197688fa-576e-4ea1-9f5e-e302e1d9e651 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:37.705546 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 339/678] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:37.706605 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e06154-20e0-4869-a82c-987aa60473d5 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:37.793147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197688fa-576e-4ea1-9f5e-e302e1d9e651 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:37.819857 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:37.865953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed67816-48f1-40b5-a178-f9631dcdd800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:37.866855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed67816-48f1-40b5-a178-f9631dcdd800 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:37.867322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed67816-48f1-40b5-a178-f9631dcdd800 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:37.867773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed67816-48f1-40b5-a178-f9631dcdd800 None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:37.868772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed67816-48f1-40b5-a178-f9631dcdd800 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:37.869314 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed67816-48f1-40b5-a178-f9631dcdd800 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:37.871028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed67816-48f1-40b5-a178-f9631dcdd800 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:37.888198 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e06154-20e0-4869-a82c-987aa60473d5 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:37.900003 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 340/679] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:37.901372 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed67816-48f1-40b5-a178-f9631dcdd800 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:37.945951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdf33d-06a1-4425-86ad-3578825722dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:37.946972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdf33d-06a1-4425-86ad-3578825722dc None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:37.947325 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdf33d-06a1-4425-86ad-3578825722dc None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:37.947664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdf33d-06a1-4425-86ad-3578825722dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:37.958476 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdf33d-06a1-4425-86ad-3578825722dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:37.960250 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdf33d-06a1-4425-86ad-3578825722dc None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-6cbdf33d-06a1-4425-86ad-3578825722dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:37.976635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:37.977942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:37.979139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:37.979139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:37.979139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:37.979139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:37.979139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:37.979139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:37.979139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:37.979139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:37.979139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:54:37.979139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:37.979698 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 340/680] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:37.980461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdf33d-06a1-4425-86ad-3578825722dc None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:37.993949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:38.041476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed67816-48f1-40b5-a178-f9631dcdd800 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:38.110211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaaa16-376e-4f96-8ee2-bc990130521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:38.110893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaaa16-376e-4f96-8ee2-bc990130521f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:38.111424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaaa16-376e-4f96-8ee2-bc990130521f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:38.111984 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaaa16-376e-4f96-8ee2-bc990130521f None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:38.113268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaaa16-376e-4f96-8ee2-bc990130521f None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:38.113874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaaa16-376e-4f96-8ee2-bc990130521f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:38.116272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaaa16-376e-4f96-8ee2-bc990130521f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:38.132111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 341/681] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:38.133601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaaa16-376e-4f96-8ee2-bc990130521f None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:38.145977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdf33d-06a1-4425-86ad-3578825722dc None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:38.188632 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:38.195600 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49efe5-e2f4-4930-9150-7d440a706e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:38.196599 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49efe5-e2f4-4930-9150-7d440a706e8d None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:38.196753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49efe5-e2f4-4930-9150-7d440a706e8d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:38.196994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49efe5-e2f4-4930-9150-7d440a706e8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:38.198394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49efe5-e2f4-4930-9150-7d440a706e8d None admin] RBAC: Adding query filter params (role.id=6c9336a73ed74d66a83c59fb3269efd5, scope.project.id=3381c0688581489b903e641f91914839, user.id=f332ac2346f0444a8d336ed2b3121be2) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:38.198948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49efe5-e2f4-4930-9150-7d440a706e8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:38.201714 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49efe5-e2f4-4930-9150-7d440a706e8d None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:38.214275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 341/682] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:37 2022] GET /identity/v3/role_assignments?user.id=f332ac2346f0444a8d336ed2b3121be2&scope.project.id=3381c0688581489b903e641f91914839&role.id=6c9336a73ed74d66a83c59fb3269efd5 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:38.215841 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49efe5-e2f4-4930-9150-7d440a706e8d None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:38.277365 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaaa16-376e-4f96-8ee2-bc990130521f None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:38.326331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afd826-d8a4-4bc6-8936-8cf395009bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:38.327327 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afd826-d8a4-4bc6-8936-8cf395009bcb None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:38.327327 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afd826-d8a4-4bc6-8936-8cf395009bcb None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:38.327590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afd826-d8a4-4bc6-8936-8cf395009bcb None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:38.328325 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afd826-d8a4-4bc6-8936-8cf395009bcb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:38.328693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afd826-d8a4-4bc6-8936-8cf395009bcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:38.330826 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afd826-d8a4-4bc6-8936-8cf395009bcb None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:38.350406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:38.364500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 342/683] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Sep 7 12:54:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:38.364500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afd826-d8a4-4bc6-8936-8cf395009bcb None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:38.414364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49efe5-e2f4-4930-9150-7d440a706e8d None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:38.472427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17528f75-1873-41e3-a8d7-eb2d2982c934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:38.474115 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17528f75-1873-41e3-a8d7-eb2d2982c934 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:38.474602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17528f75-1873-41e3-a8d7-eb2d2982c934 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:38.475069 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17528f75-1873-41e3-a8d7-eb2d2982c934 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:38.476015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17528f75-1873-41e3-a8d7-eb2d2982c934 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:38.478042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17528f75-1873-41e3-a8d7-eb2d2982c934 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-17528f75-1873-41e3-a8d7-eb2d2982c934 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:38.494056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:38.496127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:38.497934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:38.497934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:38.497934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:38.497934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:38.497934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:38.497934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:38.497934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:38.497934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:38.497934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:38.497934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:38.497934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:54:38.497934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:54:38.497934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:54:38.497934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:38.501216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 342/684] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Sep 7 12:54:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:38.503436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17528f75-1873-41e3-a8d7-eb2d2982c934 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:38.531118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:38.543548 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afd826-d8a4-4bc6-8936-8cf395009bcb None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:38.611170 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548ba4d-5a3a-46ef-a7ca-77d537720a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:38.612471 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548ba4d-5a3a-46ef-a7ca-77d537720a82 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:38.612908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548ba4d-5a3a-46ef-a7ca-77d537720a82 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:38.613273 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548ba4d-5a3a-46ef-a7ca-77d537720a82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:38.625208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548ba4d-5a3a-46ef-a7ca-77d537720a82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:38.626805 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548ba4d-5a3a-46ef-a7ca-77d537720a82 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:38.642326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-1548ba4d-5a3a-46ef-a7ca-77d537720a82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:38.642326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:38.642326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:38.642326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:38.642326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:38.642326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:38.642326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:38.642326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:38.642326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:38.642326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:38.642326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:38.642326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:38.642326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:38.642326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:38.642326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:38.644224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:38.645431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:38.645431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:38.645431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:38.645431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:38.645431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:38.645431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:38.645431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:38.645431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:38.648906 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 343/685] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:38.648906 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548ba4d-5a3a-46ef-a7ca-77d537720a82 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:38.695797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17528f75-1873-41e3-a8d7-eb2d2982c934 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:38.746217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef54d74-739a-4c7a-ba8a-2b39e8601ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:38.746965 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef54d74-739a-4c7a-ba8a-2b39e8601ac3 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:38.747272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef54d74-739a-4c7a-ba8a-2b39e8601ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:38.747547 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef54d74-739a-4c7a-ba8a-2b39e8601ac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:38.750970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:38.807469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548ba4d-5a3a-46ef-a7ca-77d537720a82 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:38.856403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bad62-159f-42bc-be38-cf42710b3c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:38.856403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bad62-159f-42bc-be38-cf42710b3c9b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:38.856403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bad62-159f-42bc-be38-cf42710b3c9b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:38.856403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bad62-159f-42bc-be38-cf42710b3c9b None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:38.856959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bad62-159f-42bc-be38-cf42710b3c9b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:38.856959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bad62-159f-42bc-be38-cf42710b3c9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:38.856959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bad62-159f-42bc-be38-cf42710b3c9b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:38.858471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef54d74-739a-4c7a-ba8a-2b39e8601ac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:38.859302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef54d74-739a-4c7a-ba8a-2b39e8601ac3 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:38.866900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 344/686] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Sep 7 12:54:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:38.868051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bad62-159f-42bc-be38-cf42710b3c9b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:38.893007 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:38.987379 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bad62-159f-42bc-be38-cf42710b3c9b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:38.988661 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 343/687] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:38.989737 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef54d74-739a-4c7a-ba8a-2b39e8601ac3 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:39.028850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:39.034695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45472b0-abaa-4960-adc2-4863ca615dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:39.035465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45472b0-abaa-4960-adc2-4863ca615dd0 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:39.035834 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45472b0-abaa-4960-adc2-4863ca615dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:39.036196 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45472b0-abaa-4960-adc2-4863ca615dd0 None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:39.037024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45472b0-abaa-4960-adc2-4863ca615dd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:39.037921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45472b0-abaa-4960-adc2-4863ca615dd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:39.039254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45472b0-abaa-4960-adc2-4863ca615dd0 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:39.053694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 345/688] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:39.054698 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45472b0-abaa-4960-adc2-4863ca615dd0 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:39.113713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef54d74-739a-4c7a-ba8a-2b39e8601ac3 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:39.148802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:39.163506 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64559b87-3761-4422-99a8-3ce9283f07fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:39.163767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64559b87-3761-4422-99a8-3ce9283f07fb None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:39.163900 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64559b87-3761-4422-99a8-3ce9283f07fb None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:39.164168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64559b87-3761-4422-99a8-3ce9283f07fb None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:39.165102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64559b87-3761-4422-99a8-3ce9283f07fb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:39.165448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64559b87-3761-4422-99a8-3ce9283f07fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:39.167907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64559b87-3761-4422-99a8-3ce9283f07fb None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:39.172953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45472b0-abaa-4960-adc2-4863ca615dd0 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:39.177993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 344/689] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Sep 7 12:54:38 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:39.181289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64559b87-3761-4422-99a8-3ce9283f07fb None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:39.264029 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31007826-0347-4c63-b7d2-d826f7d9e865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:39.264914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31007826-0347-4c63-b7d2-d826f7d9e865 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:39.265292 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31007826-0347-4c63-b7d2-d826f7d9e865 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:39.265653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31007826-0347-4c63-b7d2-d826f7d9e865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:39.295182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31007826-0347-4c63-b7d2-d826f7d9e865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:39.297770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31007826-0347-4c63-b7d2-d826f7d9e865 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-31007826-0347-4c63-b7d2-d826f7d9e865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:39.335601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:39.336882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:39.337998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:39.337998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:39.337998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:39.348698 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 346/690] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:39.356264 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:39.357501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31007826-0347-4c63-b7d2-d826f7d9e865 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:39.358744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64559b87-3761-4422-99a8-3ce9283f07fb None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:39.402836 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c11ec-37f1-482e-a111-865d2e1d3b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:39.403625 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c11ec-37f1-482e-a111-865d2e1d3b7c None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:39.404008 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c11ec-37f1-482e-a111-865d2e1d3b7c None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:39.404413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c11ec-37f1-482e-a111-865d2e1d3b7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:39.405237 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c11ec-37f1-482e-a111-865d2e1d3b7c None admin] RBAC: Adding query filter params (role.id=6c9336a73ed74d66a83c59fb3269efd5, scope.project.id=3381c0688581489b903e641f91914839, user.id=eefd1293a22848e3b595e54be0455d10) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:39.405616 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c11ec-37f1-482e-a111-865d2e1d3b7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:39.407076 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c11ec-37f1-482e-a111-865d2e1d3b7c None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:39.415250 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 345/691] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:39 2022] GET /identity/v3/role_assignments?user.id=eefd1293a22848e3b595e54be0455d10&scope.project.id=3381c0688581489b903e641f91914839&role.id=6c9336a73ed74d66a83c59fb3269efd5 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:39.547480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31007826-0347-4c63-b7d2-d826f7d9e865 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:39.586255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:39.598962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f8188-49c0-4cd7-a709-1230fcae835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:39.599601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f8188-49c0-4cd7-a709-1230fcae835c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:39.599939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f8188-49c0-4cd7-a709-1230fcae835c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:39.600210 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f8188-49c0-4cd7-a709-1230fcae835c None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:39.600949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f8188-49c0-4cd7-a709-1230fcae835c None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:39.601249 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f8188-49c0-4cd7-a709-1230fcae835c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:39.602681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f8188-49c0-4cd7-a709-1230fcae835c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:39.625089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 347/692] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:39.631431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c11ec-37f1-482e-a111-865d2e1d3b7c None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:39.758451 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c11ec-37f1-482e-a111-865d2e1d3b7c None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:39.801632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb016d5f-65ca-46f1-9fd8-7df010ef1f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:39.802296 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb016d5f-65ca-46f1-9fd8-7df010ef1f92 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:39.802574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb016d5f-65ca-46f1-9fd8-7df010ef1f92 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:39.802843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb016d5f-65ca-46f1-9fd8-7df010ef1f92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:39.812180 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb016d5f-65ca-46f1-9fd8-7df010ef1f92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:39.813742 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb016d5f-65ca-46f1-9fd8-7df010ef1f92 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:39.827150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-bb016d5f-65ca-46f1-9fd8-7df010ef1f92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:39.827150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:39.827150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:39.827150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:39.827150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:39.827150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:39.827150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:39.827150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:39.827150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:39.827150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:39.827150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:39.827150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:39.827150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:39.827150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:39.827150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:39.829327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:39.831649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:39.831649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:39.831649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:39.831649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:39.831649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:39.831649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:39.831649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:39.831649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:39.831649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 346/693] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:39.836390 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f8188-49c0-4cd7-a709-1230fcae835c None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:39.954596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54a079-feca-454b-ab3c-f5970d522aed None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:39.955075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54a079-feca-454b-ab3c-f5970d522aed None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:39.955572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54a079-feca-454b-ab3c-f5970d522aed None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:39.957977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 347/694] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:39.963833 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf7f55-43df-40e9-8e5a-cace7db18a13 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:39.964460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf7f55-43df-40e9-8e5a-cace7db18a13 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:39.964948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf7f55-43df-40e9-8e5a-cace7db18a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:39.987281 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-7fbf7f55-43df-40e9-8e5a-cace7db18a13 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:39.989033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7fbf7f55-43df-40e9-8e5a-cace7db18a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:40.015425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f8188-49c0-4cd7-a709-1230fcae835c None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:40.054307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:40.064838 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e9a1a-63e8-4e7c-8037-1cc657b9b6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:40.066311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e9a1a-63e8-4e7c-8037-1cc657b9b6da None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:40.066807 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e9a1a-63e8-4e7c-8037-1cc657b9b6da None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:40.067316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e9a1a-63e8-4e7c-8037-1cc657b9b6da None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:40.068231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e9a1a-63e8-4e7c-8037-1cc657b9b6da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:40.068991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e9a1a-63e8-4e7c-8037-1cc657b9b6da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:40.071459 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e9a1a-63e8-4e7c-8037-1cc657b9b6da None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:40.095515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 348/695] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:40.102382 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e9a1a-63e8-4e7c-8037-1cc657b9b6da None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:40.176679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 348/696] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:54:40.204790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:40.260621 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e9a1a-63e8-4e7c-8037-1cc657b9b6da None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:40.299482 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d2863-20bc-4004-a7af-b4455dfa80b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:40.300023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d2863-20bc-4004-a7af-b4455dfa80b2 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:40.300305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d2863-20bc-4004-a7af-b4455dfa80b2 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:40.300610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d2863-20bc-4004-a7af-b4455dfa80b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:40.301351 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d2863-20bc-4004-a7af-b4455dfa80b2 None admin] RBAC: Adding query filter params (role.id=6c9336a73ed74d66a83c59fb3269efd5, scope.project.id=3381c0688581489b903e641f91914839, user.id=f3796ca94b914fd18946551fa2bff331) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:40.301658 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d2863-20bc-4004-a7af-b4455dfa80b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:40.303207 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d2863-20bc-4004-a7af-b4455dfa80b2 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:40.310442 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 349/697] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:40 2022] GET /identity/v3/role_assignments?user.id=f3796ca94b914fd18946551fa2bff331&scope.project.id=3381c0688581489b903e641f91914839&role.id=6c9336a73ed74d66a83c59fb3269efd5 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:40.555688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf7f55-43df-40e9-8e5a-cace7db18a13 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:40.727072 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf7f55-43df-40e9-8e5a-cace7db18a13 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:40.781911 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0d383-cd90-459c-a6eb-54437482f8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:40.782578 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0d383-cd90-459c-a6eb-54437482f8b3 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:40.782859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0d383-cd90-459c-a6eb-54437482f8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:40.783098 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0d383-cd90-459c-a6eb-54437482f8b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:40.804366 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0d383-cd90-459c-a6eb-54437482f8b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-c6d0d383-cd90-459c-a6eb-54437482f8b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:40.809495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:40.810598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:40.812063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:40.812063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:40.812063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:40.812063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:40.812063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:40.812063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:40.812063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:40.812063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:40.812063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:40.812063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:40.812063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:40.812063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:40.812063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 349/698] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:40.821679 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d2863-20bc-4004-a7af-b4455dfa80b2 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:41.004262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d2863-20bc-4004-a7af-b4455dfa80b2 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:41.035329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:41.066632 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12ce48-9725-45b3-896d-c7a0d9940c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:41.068036 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12ce48-9725-45b3-896d-c7a0d9940c12 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:41.068567 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12ce48-9725-45b3-896d-c7a0d9940c12 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:41.069051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12ce48-9725-45b3-896d-c7a0d9940c12 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:41.069938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12ce48-9725-45b3-896d-c7a0d9940c12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:41.070464 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12ce48-9725-45b3-896d-c7a0d9940c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:41.072090 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12ce48-9725-45b3-896d-c7a0d9940c12 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:41.090022 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 350/699] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:41.097921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0d383-cd90-459c-a6eb-54437482f8b3 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:41.131249 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:41.178823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078499b-cb9c-46e0-a94e-918876113b26 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:41.179500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078499b-cb9c-46e0-a94e-918876113b26 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:41.179985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078499b-cb9c-46e0-a94e-918876113b26 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:41.181978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 351/700] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:54:41.187189 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea3d45-ccc0-42ca-abc5-5d2831363fe4 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:41.187768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea3d45-ccc0-42ca-abc5-5d2831363fe4 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:41.188264 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea3d45-ccc0-42ca-abc5-5d2831363fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:41.223795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-a6ea3d45-ccc0-42ca-abc5-5d2831363fe4 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:41.225035 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a6ea3d45-ccc0-42ca-abc5-5d2831363fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:41.291534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0d383-cd90-459c-a6eb-54437482f8b3 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:41.323717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 352/701] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:54:41.355232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8db70d-b2a6-4c7e-aba5-e3e40bbf91aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:41.355876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8db70d-b2a6-4c7e-aba5-e3e40bbf91aa None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:41.356152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8db70d-b2a6-4c7e-aba5-e3e40bbf91aa None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:41.356444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8db70d-b2a6-4c7e-aba5-e3e40bbf91aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:41.371004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8db70d-b2a6-4c7e-aba5-e3e40bbf91aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:41.372630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8db70d-b2a6-4c7e-aba5-e3e40bbf91aa None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-fc8db70d-b2a6-4c7e-aba5-e3e40bbf91aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:41.394553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:41.395579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:41.396514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:41.396514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:41.396514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:41.396778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 350/702] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:41.405580 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea3d45-ccc0-42ca-abc5-5d2831363fe4 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:41.546307 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea3d45-ccc0-42ca-abc5-5d2831363fe4 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:41.564614 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:41.598228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea393623-353d-4c75-83ab-ce46de0ac405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:41.598781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea393623-353d-4c75-83ab-ce46de0ac405 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:41.599069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea393623-353d-4c75-83ab-ce46de0ac405 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:41.599345 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea393623-353d-4c75-83ab-ce46de0ac405 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:41.600014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea393623-353d-4c75-83ab-ce46de0ac405 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:41.600317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea393623-353d-4c75-83ab-ce46de0ac405 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:41.601784 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea393623-353d-4c75-83ab-ce46de0ac405 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:41.619877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 353/703] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:41.627866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8db70d-b2a6-4c7e-aba5-e3e40bbf91aa None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:41.715160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:41.732178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea393623-353d-4c75-83ab-ce46de0ac405 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:41.792771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8db70d-b2a6-4c7e-aba5-e3e40bbf91aa None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:41.836106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d34390-ae6a-4e7b-87e5-03bd53550a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:41.836881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d34390-ae6a-4e7b-87e5-03bd53550a73 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:41.837206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d34390-ae6a-4e7b-87e5-03bd53550a73 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:41.837480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d34390-ae6a-4e7b-87e5-03bd53550a73 None admin] PATH_INFO: `/v3/users/nova` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:41.854590 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d34390-ae6a-4e7b-87e5-03bd53550a73 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:41.856579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d34390-ae6a-4e7b-87e5-03bd53550a73 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-a2d34390-ae6a-4e7b-87e5-03bd53550a73 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:41.869672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:41.870892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:41.871866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:41.871866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:41.871866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:41.871866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:41.871866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:41.871866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:41.871866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:41.871866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:41.871866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:54:41.871866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:41.874806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 351/704] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Sep 7 12:54:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:41.881189 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d34390-ae6a-4e7b-87e5-03bd53550a73 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:41.983778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea393623-353d-4c75-83ab-ce46de0ac405 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:42.022933 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d34390-ae6a-4e7b-87e5-03bd53550a73 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:42.054524 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:42.058167 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d972b-ae9a-4173-9203-b03c5c92a679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:42.059313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d972b-ae9a-4173-9203-b03c5c92a679 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:42.059599 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d972b-ae9a-4173-9203-b03c5c92a679 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:42.059929 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d972b-ae9a-4173-9203-b03c5c92a679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:42.068235 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f38a1-6f2e-4e3e-bc37-1dfc5ddbb93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:42.069271 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f38a1-6f2e-4e3e-bc37-1dfc5ddbb93c None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:42.069771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f38a1-6f2e-4e3e-bc37-1dfc5ddbb93c None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:42.070481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f38a1-6f2e-4e3e-bc37-1dfc5ddbb93c None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:42.071416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f38a1-6f2e-4e3e-bc37-1dfc5ddbb93c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:42.071872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f38a1-6f2e-4e3e-bc37-1dfc5ddbb93c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:42.073573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f38a1-6f2e-4e3e-bc37-1dfc5ddbb93c None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:42.076080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d972b-ae9a-4173-9203-b03c5c92a679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:42.079412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d972b-ae9a-4173-9203-b03c5c92a679 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:42.096426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 352/705] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Sep 7 12:54:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-787d972b-ae9a-4173-9203-b03c5c92a679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:42.104525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:42.105681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:42.106603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:42.106603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:42.106603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:42.106784 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f38a1-6f2e-4e3e-bc37-1dfc5ddbb93c None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:42.108418 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 354/706] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:54:42.114906 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d972b-ae9a-4173-9203-b03c5c92a679 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:42.167027 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:42.334829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f38a1-6f2e-4e3e-bc37-1dfc5ddbb93c None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:42.349195 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d972b-ae9a-4173-9203-b03c5c92a679 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:42.391891 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c944a1b-a889-4522-9090-0e6904929aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:42.393139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c944a1b-a889-4522-9090-0e6904929aeb None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:42.393677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c944a1b-a889-4522-9090-0e6904929aeb None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:42.394080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c944a1b-a889-4522-9090-0e6904929aeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:42.394187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3625f-64c0-48e4-b699-e900526755cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:42.394829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3625f-64c0-48e4-b699-e900526755cb None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:42.395106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3625f-64c0-48e4-b699-e900526755cb None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:42.395378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3625f-64c0-48e4-b699-e900526755cb None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:42.396044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3625f-64c0-48e4-b699-e900526755cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:42.396347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3625f-64c0-48e4-b699-e900526755cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:42.397817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3625f-64c0-48e4-b699-e900526755cb None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:42.420899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 355/707] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:42.422561 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82847b41-29f8-4081-8a73-123f06f7eeef None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:42.422842 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82847b41-29f8-4081-8a73-123f06f7eeef None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:42.423183 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82847b41-29f8-4081-8a73-123f06f7eeef None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:42.429188 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 356/708] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:42.432997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82847b41-29f8-4081-8a73-123f06f7eeef None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:42.481918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:42.517285 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c944a1b-a889-4522-9090-0e6904929aeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:42.519907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c944a1b-a889-4522-9090-0e6904929aeb None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:42.547182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:42.578611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82847b41-29f8-4081-8a73-123f06f7eeef None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:42.638979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ac82e-eec8-435f-b831-b0d8eb72c69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:42.641177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ac82e-eec8-435f-b831-b0d8eb72c69f None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:42.641804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ac82e-eec8-435f-b831-b0d8eb72c69f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:42.642474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ac82e-eec8-435f-b831-b0d8eb72c69f None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:42.644689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ac82e-eec8-435f-b831-b0d8eb72c69f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:42.646400 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ac82e-eec8-435f-b831-b0d8eb72c69f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:42.673663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 357/709] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:54:42 2022] POST /identity/v3/users => generated 254 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:54:42.675410 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839be64b-857b-461b-a1a2-b6875234d25d None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:42.675710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839be64b-857b-461b-a1a2-b6875234d25d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:42.675979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839be64b-857b-461b-a1a2-b6875234d25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:42.692689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 353/710] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:42.701598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c944a1b-a889-4522-9090-0e6904929aeb None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:42.722018 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-839be64b-857b-461b-a1a2-b6875234d25d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:42.723999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-839be64b-857b-461b-a1a2-b6875234d25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:42.844516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 358/711] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:42.879827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:42.904945 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c944a1b-a889-4522-9090-0e6904929aeb None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:42.949732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26115daf-1375-4719-9977-01fa367af3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:42.950465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26115daf-1375-4719-9977-01fa367af3e3 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:42.950748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26115daf-1375-4719-9977-01fa367af3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:42.951003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26115daf-1375-4719-9977-01fa367af3e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:42.967898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26115daf-1375-4719-9977-01fa367af3e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:42.970435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26115daf-1375-4719-9977-01fa367af3e3 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:42.972259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc934b9e-b3c3-4ce0-b442-4b061bff6724 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:42.972576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc934b9e-b3c3-4ce0-b442-4b061bff6724 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:42.972855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc934b9e-b3c3-4ce0-b442-4b061bff6724 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:42.974642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 359/712] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:54:42.980501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a5bea-f2d4-49ce-9826-0718e5ec7160 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:42.980791 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a5bea-f2d4-49ce-9826-0718e5ec7160 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:42.981051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a5bea-f2d4-49ce-9826-0718e5ec7160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-26115daf-1375-4719-9977-01fa367af3e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:42.998174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:42.999571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:43.000565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:43.000565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:43.000565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:43.004412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 354/713] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:43.009753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26115daf-1375-4719-9977-01fa367af3e3 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:43.014955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-174a5bea-f2d4-49ce-9826-0718e5ec7160 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:43.016563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-174a5bea-f2d4-49ce-9826-0718e5ec7160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:43.099258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:43.112822 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 360/714] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:43.137055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26115daf-1375-4719-9977-01fa367af3e3 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:43.182116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ad275-d5fa-4f48-923e-8faf25661edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:43.182665 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ad275-d5fa-4f48-923e-8faf25661edc None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:43.182944 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ad275-d5fa-4f48-923e-8faf25661edc None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:43.183212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ad275-d5fa-4f48-923e-8faf25661edc None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:43.183937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ad275-d5fa-4f48-923e-8faf25661edc None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:43.184240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ad275-d5fa-4f48-923e-8faf25661edc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:43.185676 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ad275-d5fa-4f48-923e-8faf25661edc None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:43.187394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:43.206740 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 355/715] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:43.208191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a5bea-f2d4-49ce-9826-0718e5ec7160 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:43.267587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ad275-d5fa-4f48-923e-8faf25661edc None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:43.371829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a5bea-f2d4-49ce-9826-0718e5ec7160 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:43.417432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa5c0f-ce33-4c58-aef1-63ccb3971eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:43.418851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa5c0f-ce33-4c58-aef1-63ccb3971eb6 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:43.419727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa5c0f-ce33-4c58-aef1-63ccb3971eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:43.420467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa5c0f-ce33-4c58-aef1-63ccb3971eb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:43.430591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa5c0f-ce33-4c58-aef1-63ccb3971eb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:43.432972 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa5c0f-ce33-4c58-aef1-63ccb3971eb6 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:43.434100 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ad275-d5fa-4f48-923e-8faf25661edc None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:43.448069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-7bfa5c0f-ce33-4c58-aef1-63ccb3971eb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:43.448069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:43.448069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:43.448069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:43.448069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:43.448069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:43.448069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:43.448069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:43.448069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:43.448069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:43.448069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:43.448069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:43.448069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:43.448069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:43.448069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:43.449547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:43.450909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:43.450909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:43.450909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:43.450909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:43.450909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:43.450909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:43.450909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:43.450909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:43.453979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 361/716] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:43.456042 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e684f-5f9a-44ec-89fd-71a2a1dd6ccd None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:43.456779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e684f-5f9a-44ec-89fd-71a2a1dd6ccd None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:43.457257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e684f-5f9a-44ec-89fd-71a2a1dd6ccd None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:43.459089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 362/717] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:43.460250 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e684f-5f9a-44ec-89fd-71a2a1dd6ccd None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:43.476122 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce30312-069c-404f-86b8-4e764025fabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:43.476765 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce30312-069c-404f-86b8-4e764025fabb None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:43.477047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce30312-069c-404f-86b8-4e764025fabb None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:43.477339 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce30312-069c-404f-86b8-4e764025fabb None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:43.478018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce30312-069c-404f-86b8-4e764025fabb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:43.479468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce30312-069c-404f-86b8-4e764025fabb None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:43.502884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 356/718] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Sep 7 12:54:43 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:54:43.504572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce30312-069c-404f-86b8-4e764025fabb None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:43.556900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:43.586757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:43.640225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e684f-5f9a-44ec-89fd-71a2a1dd6ccd None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:43.641684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce30312-069c-404f-86b8-4e764025fabb None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:43.684652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b654ce-94a0-482e-86ee-5b0642cc7202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:43.685239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b654ce-94a0-482e-86ee-5b0642cc7202 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:43.685519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b654ce-94a0-482e-86ee-5b0642cc7202 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:43.685790 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b654ce-94a0-482e-86ee-5b0642cc7202 None admin] PATH_INFO: `/v3/services/network` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:43.686617 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b654ce-94a0-482e-86ee-5b0642cc7202 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:43.687894 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475119e-04e7-4dd0-861f-3f1f6c501629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:43.688107 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b654ce-94a0-482e-86ee-5b0642cc7202 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:43.688958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475119e-04e7-4dd0-861f-3f1f6c501629 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:43.689458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475119e-04e7-4dd0-861f-3f1f6c501629 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:43.690028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475119e-04e7-4dd0-861f-3f1f6c501629 None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:43.691263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475119e-04e7-4dd0-861f-3f1f6c501629 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:43.692041 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475119e-04e7-4dd0-861f-3f1f6c501629 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:43.694007 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475119e-04e7-4dd0-861f-3f1f6c501629 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-40b654ce-94a0-482e-86ee-5b0642cc7202 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:43.698426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:43.699848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:43.700768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:43.700768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:43.700768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:43.700768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:43.700768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:43.700768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:43.700768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:43.700768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:43.700768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:43.700768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:43.700768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:54:43.700768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:54:43.700768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:54:43.700768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:43.700768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 357/719] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:43 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:43.702190 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b970-6bf6-4856-9358-44a243dd9e87 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:43.702301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b970-6bf6-4856-9358-44a243dd9e87 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:43.702567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b970-6bf6-4856-9358-44a243dd9e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:43.718566 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 363/720] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:43.718566 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475119e-04e7-4dd0-861f-3f1f6c501629 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:43.735377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-73f2b970-6bf6-4856-9358-44a243dd9e87 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:43.737431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-73f2b970-6bf6-4856-9358-44a243dd9e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:43.855414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 358/721] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:43.857077 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2b970-6bf6-4856-9358-44a243dd9e87 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:43.865458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475119e-04e7-4dd0-861f-3f1f6c501629 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:43.884794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:43.913986 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8587d1-9c09-440f-bca6-637a1018778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:43.914630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8587d1-9c09-440f-bca6-637a1018778b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:43.915158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8587d1-9c09-440f-bca6-637a1018778b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:43.915448 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8587d1-9c09-440f-bca6-637a1018778b None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:43.916113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8587d1-9c09-440f-bca6-637a1018778b None admin] RBAC: Adding query filter params (name=network) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:43.916442 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8587d1-9c09-440f-bca6-637a1018778b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:43.918003 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8587d1-9c09-440f-bca6-637a1018778b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:43.924496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 364/722] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Sep 7 12:54:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:43.931609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8587d1-9c09-440f-bca6-637a1018778b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:44.001543 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:44.076558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8587d1-9c09-440f-bca6-637a1018778b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:44.124317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4722016-ef3c-478b-a2ef-30d5ecd08741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:44.125311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4722016-ef3c-478b-a2ef-30d5ecd08741 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:44.125311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4722016-ef3c-478b-a2ef-30d5ecd08741 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:44.125660 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4722016-ef3c-478b-a2ef-30d5ecd08741 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:44.126275 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4722016-ef3c-478b-a2ef-30d5ecd08741 None admin] RBAC: Adding query filter params (type=network) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:44.126585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4722016-ef3c-478b-a2ef-30d5ecd08741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:44.128281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4722016-ef3c-478b-a2ef-30d5ecd08741 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:44.135975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 365/723] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Sep 7 12:54:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:44.161245 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2b970-6bf6-4856-9358-44a243dd9e87 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:44.203024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a3c2d-3e6c-4c4c-a959-f6df93e0b73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:44.203661 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a3c2d-3e6c-4c4c-a959-f6df93e0b73e None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:44.203988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a3c2d-3e6c-4c4c-a959-f6df93e0b73e None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:44.204260 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a3c2d-3e6c-4c4c-a959-f6df93e0b73e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:44.205044 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a3c2d-3e6c-4c4c-a959-f6df93e0b73e None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=3381c0688581489b903e641f91914839, user.id=fbe8fa8ab8094aa69933398280810692) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:44.205588 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a3c2d-3e6c-4c4c-a959-f6df93e0b73e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:44.206951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a3c2d-3e6c-4c4c-a959-f6df93e0b73e None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:44.215141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 359/724] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:43 2022] GET /identity/v3/role_assignments?user.id=fbe8fa8ab8094aa69933398280810692&scope.project.id=3381c0688581489b903e641f91914839&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 259 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:44.227206 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4722016-ef3c-478b-a2ef-30d5ecd08741 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:44.339869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:44.464639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4722016-ef3c-478b-a2ef-30d5ecd08741 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:44.520983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60336c8-57e1-4554-bbe9-bd5ab5a75a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:44.521657 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60336c8-57e1-4554-bbe9-bd5ab5a75a59 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:44.521911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60336c8-57e1-4554-bbe9-bd5ab5a75a59 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:44.522178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60336c8-57e1-4554-bbe9-bd5ab5a75a59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:44.536026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60336c8-57e1-4554-bbe9-bd5ab5a75a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-d60336c8-57e1-4554-bbe9-bd5ab5a75a59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:44.541452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:44.544904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:44.547738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:44.547738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:44.547738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:44.547738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:44.547738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:44.547738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:44.547738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:44.547738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:44.547738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:44.547738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:44.547738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:44.547738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:44.547738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 366/725] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:54:44.556632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a3c2d-3e6c-4c4c-a959-f6df93e0b73e None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:44.694984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a3c2d-3e6c-4c4c-a959-f6df93e0b73e None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:44.717657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:44.745394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdfda2-f0f8-44c9-9b45-d5bdf0515c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:44.746046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdfda2-f0f8-44c9-9b45-d5bdf0515c5a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:44.746315 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdfda2-f0f8-44c9-9b45-d5bdf0515c5a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:44.746585 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdfda2-f0f8-44c9-9b45-d5bdf0515c5a None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:44.747312 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdfda2-f0f8-44c9-9b45-d5bdf0515c5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:44.747620 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdfda2-f0f8-44c9-9b45-d5bdf0515c5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:44.749525 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdfda2-f0f8-44c9-9b45-d5bdf0515c5a None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:44.764639 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 360/726] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:44.770670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60336c8-57e1-4554-bbe9-bd5ab5a75a59 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:44.913614 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:44.917611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60336c8-57e1-4554-bbe9-bd5ab5a75a59 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:44.973211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b898e6-f503-462f-95e0-b06c936bd6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:44.973895 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b898e6-f503-462f-95e0-b06c936bd6bb None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:44.974179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b898e6-f503-462f-95e0-b06c936bd6bb None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:44.974457 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b898e6-f503-462f-95e0-b06c936bd6bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:44.991807 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b898e6-f503-462f-95e0-b06c936bd6bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:44.994462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b898e6-f503-462f-95e0-b06c936bd6bb None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-27b898e6-f503-462f-95e0-b06c936bd6bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:45.025880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:45.028331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:45.030424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:45.030424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:45.030424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:45.030424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 367/727] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:45.033522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdfda2-f0f8-44c9-9b45-d5bdf0515c5a None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:45.167903 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdfda2-f0f8-44c9-9b45-d5bdf0515c5a None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:45.206710 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b455c50-4d76-4a5d-bb8a-995f7671a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:45.207330 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b455c50-4d76-4a5d-bb8a-995f7671a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:45.207607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b455c50-4d76-4a5d-bb8a-995f7671a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:45.207879 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b455c50-4d76-4a5d-bb8a-995f7671a8d8 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:45.208567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b455c50-4d76-4a5d-bb8a-995f7671a8d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:45.208871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b455c50-4d76-4a5d-bb8a-995f7671a8d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:45.210265 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b455c50-4d76-4a5d-bb8a-995f7671a8d8 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:45.224359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 361/728] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:45.229774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b898e6-f503-462f-95e0-b06c936bd6bb None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:45.400786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b898e6-f503-462f-95e0-b06c936bd6bb None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:45.478067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328f696-b964-4d58-b2e6-bbeb0df6b29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:45.478648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328f696-b964-4d58-b2e6-bbeb0df6b29d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:45.478926 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328f696-b964-4d58-b2e6-bbeb0df6b29d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:45.479196 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328f696-b964-4d58-b2e6-bbeb0df6b29d None admin] PATH_INFO: `/v3/users/swift` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:45.494094 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328f696-b964-4d58-b2e6-bbeb0df6b29d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:45.496458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328f696-b964-4d58-b2e6-bbeb0df6b29d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-f328f696-b964-4d58-b2e6-bbeb0df6b29d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:45.512500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:45.514938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:45.517432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:45.517432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:45.517432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:45.517432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:45.517432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:45.517432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:45.517432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:45.517432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:45.517432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:54:45.517432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:45.517432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 368/729] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:45.524403 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b455c50-4d76-4a5d-bb8a-995f7671a8d8 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:45.579344 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:45.656798 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b455c50-4d76-4a5d-bb8a-995f7671a8d8 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:45.698130 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163719e-934a-4bf4-bf48-043e2f9c8f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:45.698756 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163719e-934a-4bf4-bf48-043e2f9c8f10 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:45.699032 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163719e-934a-4bf4-bf48-043e2f9c8f10 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:45.699363 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163719e-934a-4bf4-bf48-043e2f9c8f10 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:45.700115 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163719e-934a-4bf4-bf48-043e2f9c8f10 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:45.700441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163719e-934a-4bf4-bf48-043e2f9c8f10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:45.701888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163719e-934a-4bf4-bf48-043e2f9c8f10 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:45.723201 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 362/730] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Sep 7 12:54:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:45.729624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328f696-b964-4d58-b2e6-bbeb0df6b29d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:45.775653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:45.921341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328f696-b964-4d58-b2e6-bbeb0df6b29d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:45.990304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd390221-f5ce-4c95-9862-2bca590c5981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:45.990898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd390221-f5ce-4c95-9862-2bca590c5981 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:45.991178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd390221-f5ce-4c95-9862-2bca590c5981 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:45.991454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd390221-f5ce-4c95-9862-2bca590c5981 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:46.026306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e9b4f-4152-426f-8548-b009a45ad080 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:46.026661 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e9b4f-4152-426f-8548-b009a45ad080 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:46.026840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e9b4f-4152-426f-8548-b009a45ad080 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:46.028515 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 363/731] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:46.036244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33ac94-00a0-4eb2-9509-09ef041b1519 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:46.036925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33ac94-00a0-4eb2-9509-09ef041b1519 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:46.037288 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33ac94-00a0-4eb2-9509-09ef041b1519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:46.088393 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-0c33ac94-00a0-4eb2-9509-09ef041b1519 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:46.090447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0c33ac94-00a0-4eb2-9509-09ef041b1519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:46.103517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd390221-f5ce-4c95-9862-2bca590c5981 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:46.105343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd390221-f5ce-4c95-9862-2bca590c5981 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:46.124911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:46.249272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 364/732] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:46.293419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 369/733] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:45 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:46.301560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33ac94-00a0-4eb2-9509-09ef041b1519 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:46.340993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:46.474272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33ac94-00a0-4eb2-9509-09ef041b1519 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:46.475668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abb1f0-b2c1-43d7-a010-80cf22d5ffd8 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:46.476222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abb1f0-b2c1-43d7-a010-80cf22d5ffd8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:46.476753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abb1f0-b2c1-43d7-a010-80cf22d5ffd8 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:46.480527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 370/734] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:54:46.484427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09a1db-c1b5-4836-8026-4208a16d6188 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:46.485068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09a1db-c1b5-4836-8026-4208a16d6188 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:46.485555 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09a1db-c1b5-4836-8026-4208a16d6188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:46.525174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b71a2-e8be-4801-adb5-0e2fe583c037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:46.525823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b71a2-e8be-4801-adb5-0e2fe583c037 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:46.526100 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b71a2-e8be-4801-adb5-0e2fe583c037 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:46.526371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b71a2-e8be-4801-adb5-0e2fe583c037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:46.528009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-5b09a1db-c1b5-4836-8026-4208a16d6188 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:46.529264 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5b09a1db-c1b5-4836-8026-4208a16d6188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:46.552769 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b71a2-e8be-4801-adb5-0e2fe583c037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:46.554458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b71a2-e8be-4801-adb5-0e2fe583c037 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-7b9b71a2-e8be-4801-adb5-0e2fe583c037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:46.573827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:46.574849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:46.576181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:46.576181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:46.576181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:46.576181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 365/735] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:46.582334 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b71a2-e8be-4801-adb5-0e2fe583c037 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:46.685366 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:46.719677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b71a2-e8be-4801-adb5-0e2fe583c037 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:46.725319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 371/736] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:54:46.726316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09a1db-c1b5-4836-8026-4208a16d6188 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:46.771381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f593085-bf2f-490d-a2a0-6623c1e0f196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:46.772623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f593085-bf2f-490d-a2a0-6623c1e0f196 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:46.773789 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f593085-bf2f-490d-a2a0-6623c1e0f196 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:46.774392 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f593085-bf2f-490d-a2a0-6623c1e0f196 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:46.775489 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f593085-bf2f-490d-a2a0-6623c1e0f196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:46.775997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f593085-bf2f-490d-a2a0-6623c1e0f196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:46.778136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f593085-bf2f-490d-a2a0-6623c1e0f196 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:46.798655 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 366/737] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:46.807012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f593085-bf2f-490d-a2a0-6623c1e0f196 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:46.840961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:46.942347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f593085-bf2f-490d-a2a0-6623c1e0f196 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:46.986020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c05761-49f9-4b7d-b706-b2ad1fc868c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:46.988210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c05761-49f9-4b7d-b706-b2ad1fc868c7 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:46.988803 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c05761-49f9-4b7d-b706-b2ad1fc868c7 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:46.990012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c05761-49f9-4b7d-b706-b2ad1fc868c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:46.993526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:47.001649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c05761-49f9-4b7d-b706-b2ad1fc868c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:47.004868 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c05761-49f9-4b7d-b706-b2ad1fc868c7 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:47.021823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-38c05761-49f9-4b7d-b706-b2ad1fc868c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:47.021823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:47.021823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:47.021823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:47.021823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:47.021823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:47.021823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:47.021823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:47.021823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:47.021823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:47.021823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:47.021823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:47.021823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:47.021823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:47.021823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:47.022834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:47.023750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:47.023750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:47.023750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:47.023750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:47.023750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:47.023750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:47.023750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:47.023750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:47.026996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 367/738] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:47.033461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c05761-49f9-4b7d-b706-b2ad1fc868c7 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:47.039323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09a1db-c1b5-4836-8026-4208a16d6188 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:47.105381 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414a132-b44d-47d4-9e4c-85eee46ae6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:47.106040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414a132-b44d-47d4-9e4c-85eee46ae6a4 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:47.106313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414a132-b44d-47d4-9e4c-85eee46ae6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:47.106578 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414a132-b44d-47d4-9e4c-85eee46ae6a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:47.134181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414a132-b44d-47d4-9e4c-85eee46ae6a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-6414a132-b44d-47d4-9e4c-85eee46ae6a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:47.139398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:47.140411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:47.141266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:47.141266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:47.141266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:47.141266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:47.141266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:47.141266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:47.141266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:47.141266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:47.141266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:47.141266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:47.141266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:47.141266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:47.141266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 372/739] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:47.151462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414a132-b44d-47d4-9e4c-85eee46ae6a4 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:47.229035 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c05761-49f9-4b7d-b706-b2ad1fc868c7 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:47.286635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f4321-0116-45e0-954a-c67b231adcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:47.287420 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f4321-0116-45e0-954a-c67b231adcb0 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:47.287816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f4321-0116-45e0-954a-c67b231adcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:47.288280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f4321-0116-45e0-954a-c67b231adcb0 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:47.289565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f4321-0116-45e0-954a-c67b231adcb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:47.290105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f4321-0116-45e0-954a-c67b231adcb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:47.292714 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f4321-0116-45e0-954a-c67b231adcb0 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:47.300813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414a132-b44d-47d4-9e4c-85eee46ae6a4 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:47.302798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:47.309468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 368/740] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:47.316641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da7a04-ce5c-4361-b36e-4be34d8cdba7 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:47.316944 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da7a04-ce5c-4361-b36e-4be34d8cdba7 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:47.317292 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da7a04-ce5c-4361-b36e-4be34d8cdba7 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:47.318802 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 369/741] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:47.319399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da7a04-ce5c-4361-b36e-4be34d8cdba7 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:47.365695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f7a82-ce3b-4233-83f9-7b8edd2525c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:47.366469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f7a82-ce3b-4233-83f9-7b8edd2525c0 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:47.366822 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f7a82-ce3b-4233-83f9-7b8edd2525c0 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:47.367185 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f7a82-ce3b-4233-83f9-7b8edd2525c0 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:47.368087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f7a82-ce3b-4233-83f9-7b8edd2525c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:47.368546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f7a82-ce3b-4233-83f9-7b8edd2525c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:47.370304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f7a82-ce3b-4233-83f9-7b8edd2525c0 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:47.389339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 373/742] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:47.390444 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f7a82-ce3b-4233-83f9-7b8edd2525c0 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:47.404490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:47.480881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da7a04-ce5c-4361-b36e-4be34d8cdba7 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:47.540445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7159038-c3ee-4f4f-a436-2bda9d8746fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:47.541399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7159038-c3ee-4f4f-a436-2bda9d8746fc None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:47.541823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7159038-c3ee-4f4f-a436-2bda9d8746fc None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:47.542275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7159038-c3ee-4f4f-a436-2bda9d8746fc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:47.543260 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7159038-c3ee-4f4f-a436-2bda9d8746fc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:47.545345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7159038-c3ee-4f4f-a436-2bda9d8746fc None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-a7159038-c3ee-4f4f-a436-2bda9d8746fc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:47.564333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:47.565805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:47.566859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:47.566859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:47.566859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:47.566859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:47.566859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:47.566859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:47.566859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:47.566859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:47.566859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:47.566859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:47.566859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:54:47.566859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:54:47.566859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:54:47.566859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:47.567702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 370/743] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Sep 7 12:54:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:47.570104 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adc7c1-f121-4041-ab32-31dcb6b20b0b None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:47.570545 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adc7c1-f121-4041-ab32-31dcb6b20b0b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:47.570986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adc7c1-f121-4041-ab32-31dcb6b20b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:47.585907 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f7a82-ce3b-4233-83f9-7b8edd2525c0 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:47.594778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-f3adc7c1-f121-4041-ab32-31dcb6b20b0b None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:47.596575 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f3adc7c1-f121-4041-ab32-31dcb6b20b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:47.641111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14086587-f39f-4afc-a485-1d20a2731d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:47.642417 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14086587-f39f-4afc-a485-1d20a2731d5d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:47.643128 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14086587-f39f-4afc-a485-1d20a2731d5d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:47.643628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14086587-f39f-4afc-a485-1d20a2731d5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:47.645115 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14086587-f39f-4afc-a485-1d20a2731d5d None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=3381c0688581489b903e641f91914839, user.id=f3796ca94b914fd18946551fa2bff331) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:47.645677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14086587-f39f-4afc-a485-1d20a2731d5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:47.648844 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14086587-f39f-4afc-a485-1d20a2731d5d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:47.666756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 374/744] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:47 2022] GET /identity/v3/role_assignments?user.id=f3796ca94b914fd18946551fa2bff331&scope.project.id=3381c0688581489b903e641f91914839&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:47.666756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14086587-f39f-4afc-a485-1d20a2731d5d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:47.705043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 371/745] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:47.714154 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adc7c1-f121-4041-ab32-31dcb6b20b0b None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:47.756804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:47.870286 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:47.924286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14086587-f39f-4afc-a485-1d20a2731d5d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:47.954913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adc7c1-f121-4041-ab32-31dcb6b20b0b None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:47.980451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2f414-bb79-4fd2-bb68-01fda566a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:47.981293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2f414-bb79-4fd2-bb68-01fda566a427 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:47.981576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2f414-bb79-4fd2-bb68-01fda566a427 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:47.981960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2f414-bb79-4fd2-bb68-01fda566a427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:47.997013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2f414-bb79-4fd2-bb68-01fda566a427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:47.998994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2f414-bb79-4fd2-bb68-01fda566a427 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:48.002165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa3bb7-4424-4b37-8bb3-4bbaf72ddbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:48.002819 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa3bb7-4424-4b37-8bb3-4bbaf72ddbf6 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:48.003230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa3bb7-4424-4b37-8bb3-4bbaf72ddbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:48.008407 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa3bb7-4424-4b37-8bb3-4bbaf72ddbf6 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:48.008407 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa3bb7-4424-4b37-8bb3-4bbaf72ddbf6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:48.008407 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa3bb7-4424-4b37-8bb3-4bbaf72ddbf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:48.008407 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa3bb7-4424-4b37-8bb3-4bbaf72ddbf6 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:48.015785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 372/746] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Sep 7 12:54:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-4bf2f414-bb79-4fd2-bb68-01fda566a427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:48.016509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:48.019466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:48.026012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:48.026012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:48.026012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:48.026641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89073841-b42e-4134-82f4-6afe47ce2d9b None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:48.026641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89073841-b42e-4134-82f4-6afe47ce2d9b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:48.027085 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 375/747] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:48.027321 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89073841-b42e-4134-82f4-6afe47ce2d9b None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:48.027551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2f414-bb79-4fd2-bb68-01fda566a427 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:48.027783 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 373/748] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:48.027783 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89073841-b42e-4134-82f4-6afe47ce2d9b None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:48.123107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:48.145413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89073841-b42e-4134-82f4-6afe47ce2d9b None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:48.148962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2f414-bb79-4fd2-bb68-01fda566a427 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:48.163729 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:48.190705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf96d09-c195-43b5-bb99-226ba90ed6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:48.191212 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f5bde-af8d-4dd9-bd91-82db312e6f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:48.191383 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf96d09-c195-43b5-bb99-226ba90ed6eb None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:48.191638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf96d09-c195-43b5-bb99-226ba90ed6eb None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:48.191918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf96d09-c195-43b5-bb99-226ba90ed6eb None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:48.192633 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f5bde-af8d-4dd9-bd91-82db312e6f0e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:48.192759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf96d09-c195-43b5-bb99-226ba90ed6eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:48.193001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf96d09-c195-43b5-bb99-226ba90ed6eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:48.193448 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f5bde-af8d-4dd9-bd91-82db312e6f0e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:48.193885 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f5bde-af8d-4dd9-bd91-82db312e6f0e None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:48.194411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf96d09-c195-43b5-bb99-226ba90ed6eb None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:48.194884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f5bde-af8d-4dd9-bd91-82db312e6f0e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:48.195352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f5bde-af8d-4dd9-bd91-82db312e6f0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:48.197003 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f5bde-af8d-4dd9-bd91-82db312e6f0e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:48.203199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 376/749] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Sep 7 12:54:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:48.204865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7ada5-565d-43c0-9449-41855b7ec0ff None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:48.205415 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7ada5-565d-43c0-9449-41855b7ec0ff None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:48.205960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7ada5-565d-43c0-9449-41855b7ec0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:48.214056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 374/750] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:48.215820 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf96d09-c195-43b5-bb99-226ba90ed6eb None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:48.228542 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-bda7ada5-565d-43c0-9449-41855b7ec0ff None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:48.230225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-bda7ada5-565d-43c0-9449-41855b7ec0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:48.337671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 377/751] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:48.339949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7ada5-565d-43c0-9449-41855b7ec0ff None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:48.379858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf96d09-c195-43b5-bb99-226ba90ed6eb None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:48.436885 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f164093-398f-42a8-a745-533139a7a017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:48.438468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f164093-398f-42a8-a745-533139a7a017 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:48.439318 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f164093-398f-42a8-a745-533139a7a017 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:48.439935 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f164093-398f-42a8-a745-533139a7a017 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:48.441820 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f164093-398f-42a8-a745-533139a7a017 None admin] RBAC: Adding query filter params (interface=public, service_id=699a2a2a0c844003b6522ae9e109d71e, region_id=RegionOne) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:48.442637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f164093-398f-42a8-a745-533139a7a017 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:48.445597 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f164093-398f-42a8-a745-533139a7a017 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:48.462191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:48.464608 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 375/752] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Sep 7 12:54:48 2022] GET /identity/v3/endpoints?service_id=699a2a2a0c844003b6522ae9e109d71e&interface=public®ion_id=RegionOne => generated 194 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:48.467932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f164093-398f-42a8-a745-533139a7a017 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:48.507215 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7ada5-565d-43c0-9449-41855b7ec0ff None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:48.523522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:48.563031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287c4f1-f80a-4ea2-bd93-dfc82e15bf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:48.563853 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287c4f1-f80a-4ea2-bd93-dfc82e15bf04 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:48.564138 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287c4f1-f80a-4ea2-bd93-dfc82e15bf04 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:48.564424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287c4f1-f80a-4ea2-bd93-dfc82e15bf04 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:48.575899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287c4f1-f80a-4ea2-bd93-dfc82e15bf04 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:48.577793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287c4f1-f80a-4ea2-bd93-dfc82e15bf04 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-5287c4f1-f80a-4ea2-bd93-dfc82e15bf04 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:48.595557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:48.597987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:48.599326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:48.599326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:48.599326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:48.599326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:48.599326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:48.599326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:48.599326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:48.599326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:48.599326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:54:48.599326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:48.602540 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 378/753] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Sep 7 12:54:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:48.603551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287c4f1-f80a-4ea2-bd93-dfc82e15bf04 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:48.651986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f164093-398f-42a8-a745-533139a7a017 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:48.717515 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ea50c-1976-4d9c-aa37-8c714579b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:48.718761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ea50c-1976-4d9c-aa37-8c714579b3ff None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:48.719166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ea50c-1976-4d9c-aa37-8c714579b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:48.719648 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ea50c-1976-4d9c-aa37-8c714579b3ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:48.740160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ea50c-1976-4d9c-aa37-8c714579b3ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:48.749610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287c4f1-f80a-4ea2-bd93-dfc82e15bf04 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-d48ea50c-1976-4d9c-aa37-8c714579b3ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:48.749983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:48.750881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:48.751780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:48.751780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:48.751780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:48.751780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:48.751780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:48.751780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:48.751780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:48.751780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:48.751780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:48.751780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:48.751780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:48.751780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:48.753907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 376/754] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:48.753907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ea50c-1976-4d9c-aa37-8c714579b3ff None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:48.805549 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1e870-8f04-4772-a8e2-1a7ada879cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:48.806575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1e870-8f04-4772-a8e2-1a7ada879cee None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:48.807080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1e870-8f04-4772-a8e2-1a7ada879cee None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:48.807615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1e870-8f04-4772-a8e2-1a7ada879cee None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:48.808723 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1e870-8f04-4772-a8e2-1a7ada879cee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:48.811328 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1e870-8f04-4772-a8e2-1a7ada879cee None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:48.813506 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:48.832256 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 379/755] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Sep 7 12:54:48 2022] GET /identity/v3/services => generated 544 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:48.832256 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1e870-8f04-4772-a8e2-1a7ada879cee None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:48.939259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:48.953458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ea50c-1976-4d9c-aa37-8c714579b3ff None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:49.026452 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b14a1-13d0-408f-9b9b-2334badf6a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:49.027352 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b14a1-13d0-408f-9b9b-2334badf6a4f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:49.027800 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b14a1-13d0-408f-9b9b-2334badf6a4f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:49.028943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b14a1-13d0-408f-9b9b-2334badf6a4f None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:49.030944 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b14a1-13d0-408f-9b9b-2334badf6a4f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:49.031636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b14a1-13d0-408f-9b9b-2334badf6a4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:49.035084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b14a1-13d0-408f-9b9b-2334badf6a4f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:49.045426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1e870-8f04-4772-a8e2-1a7ada879cee None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:49.066106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 377/756] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Sep 7 12:54:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:49.067481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b14a1-13d0-408f-9b9b-2334badf6a4f None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:49.111108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf3de4-beb4-49fb-820b-08a104f9f59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:49.112362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf3de4-beb4-49fb-820b-08a104f9f59f None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:49.112822 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf3de4-beb4-49fb-820b-08a104f9f59f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:49.113166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf3de4-beb4-49fb-820b-08a104f9f59f None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:49.114461 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf3de4-beb4-49fb-820b-08a104f9f59f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:49.115790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf3de4-beb4-49fb-820b-08a104f9f59f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:49.144559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 380/757] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Sep 7 12:54:48 2022] POST /identity/v3/services => generated 240 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:54:49.145776 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf3de4-beb4-49fb-820b-08a104f9f59f None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:49.322186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:49.364856 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b14a1-13d0-408f-9b9b-2334badf6a4f None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:49.410040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf3de4-beb4-49fb-820b-08a104f9f59f None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:49.456818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c7484-c2cf-46b2-8fcb-1fde3a2fb381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:49.458067 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c7484-c2cf-46b2-8fcb-1fde3a2fb381 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:49.458561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c7484-c2cf-46b2-8fcb-1fde3a2fb381 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:49.459293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c7484-c2cf-46b2-8fcb-1fde3a2fb381 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:49.461157 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c7484-c2cf-46b2-8fcb-1fde3a2fb381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:49.461675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c7484-c2cf-46b2-8fcb-1fde3a2fb381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:49.464306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c7484-c2cf-46b2-8fcb-1fde3a2fb381 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:49.480412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450131fa-2aef-47a0-8415-a5c46d39b928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:49.481887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450131fa-2aef-47a0-8415-a5c46d39b928 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:49.482233 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 378/758] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:49.482952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450131fa-2aef-47a0-8415-a5c46d39b928 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:49.483472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450131fa-2aef-47a0-8415-a5c46d39b928 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:49.491661 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c7484-c2cf-46b2-8fcb-1fde3a2fb381 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:49.528594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:49.575860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450131fa-2aef-47a0-8415-a5c46d39b928 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:49.577354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450131fa-2aef-47a0-8415-a5c46d39b928 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:49.651694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:49.765463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 381/759] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:54:49.772357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450131fa-2aef-47a0-8415-a5c46d39b928 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:49.802291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c7484-c2cf-46b2-8fcb-1fde3a2fb381 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:49.847114 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeaf07-4570-4878-a9cb-cc8e0098ebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:49.852412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeaf07-4570-4878-a9cb-cc8e0098ebb0 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:49.852412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeaf07-4570-4878-a9cb-cc8e0098ebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:49.852412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeaf07-4570-4878-a9cb-cc8e0098ebb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:49.863799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeeaf07-4570-4878-a9cb-cc8e0098ebb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:49.865388 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeeaf07-4570-4878-a9cb-cc8e0098ebb0 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-afeeaf07-4570-4878-a9cb-cc8e0098ebb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:49.887559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:49.888862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:49.889749 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:49.889749 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:49.889749 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:49.889749 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 379/760] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:54:49.897040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeaf07-4570-4878-a9cb-cc8e0098ebb0 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:49.988408 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:50.018757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeaf07-4570-4878-a9cb-cc8e0098ebb0 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:50.055989 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450131fa-2aef-47a0-8415-a5c46d39b928 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:50.074363 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f340a7-fcb0-48c4-9fd1-695edf42fe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:50.075593 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f340a7-fcb0-48c4-9fd1-695edf42fe4f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:50.076025 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f340a7-fcb0-48c4-9fd1-695edf42fe4f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:50.076544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f340a7-fcb0-48c4-9fd1-695edf42fe4f None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:50.077987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f340a7-fcb0-48c4-9fd1-695edf42fe4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:50.078415 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f340a7-fcb0-48c4-9fd1-695edf42fe4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:50.080745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f340a7-fcb0-48c4-9fd1-695edf42fe4f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:50.097796 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 380/761] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:50.105174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f340a7-fcb0-48c4-9fd1-695edf42fe4f None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:50.173128 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df957d88-7bf9-48da-b23a-a89a20165bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:50.173797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df957d88-7bf9-48da-b23a-a89a20165bfe None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:50.174251 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df957d88-7bf9-48da-b23a-a89a20165bfe None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:50.174653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df957d88-7bf9-48da-b23a-a89a20165bfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:50.193561 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df957d88-7bf9-48da-b23a-a89a20165bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:50.195374 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df957d88-7bf9-48da-b23a-a89a20165bfe None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-df957d88-7bf9-48da-b23a-a89a20165bfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:50.239884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:50.240975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:50.241886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:50.241886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:50.241886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:50.241886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 382/762] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 470 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:50.250713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df957d88-7bf9-48da-b23a-a89a20165bfe None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:50.270139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f340a7-fcb0-48c4-9fd1-695edf42fe4f None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:50.276763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:50.309004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:50.327296 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640245e-5ad2-471a-86b5-49b09fe68347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:50.328202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640245e-5ad2-471a-86b5-49b09fe68347 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:50.328668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640245e-5ad2-471a-86b5-49b09fe68347 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:50.329159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640245e-5ad2-471a-86b5-49b09fe68347 None admin] PATH_INFO: `/v3/users/nova` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:50.355457 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640245e-5ad2-471a-86b5-49b09fe68347 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:50.357073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640245e-5ad2-471a-86b5-49b09fe68347 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-4640245e-5ad2-471a-86b5-49b09fe68347 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:50.392039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:50.394041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:50.395004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:50.395004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:50.395004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:50.395004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:50.395004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:50.395004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:50.395004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:50.395004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:50.395004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:54:50.395004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:50.396075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 381/763] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Sep 7 12:54:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:50.398271 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc38af-a5e9-4f12-af19-5516353a89a7 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:50.398763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc38af-a5e9-4f12-af19-5516353a89a7 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:50.399684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc38af-a5e9-4f12-af19-5516353a89a7 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:50.407861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 382/764] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:50.410151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc38af-a5e9-4f12-af19-5516353a89a7 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:50.487453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df957d88-7bf9-48da-b23a-a89a20165bfe None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:50.557839 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f005d0-aad9-4424-8a9f-5b8451ca25fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:50.558499 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f005d0-aad9-4424-8a9f-5b8451ca25fd None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:50.558785 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f005d0-aad9-4424-8a9f-5b8451ca25fd None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:50.564409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f005d0-aad9-4424-8a9f-5b8451ca25fd None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:50.564409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f005d0-aad9-4424-8a9f-5b8451ca25fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:50.564409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f005d0-aad9-4424-8a9f-5b8451ca25fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:50.564409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f005d0-aad9-4424-8a9f-5b8451ca25fd None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:50.581429 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 383/765] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:50.583193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848f0ff-a6ac-4d8d-b68b-4bdfa3c594f4 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:50.583503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848f0ff-a6ac-4d8d-b68b-4bdfa3c594f4 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:50.583737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848f0ff-a6ac-4d8d-b68b-4bdfa3c594f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:50.597742 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc38af-a5e9-4f12-af19-5516353a89a7 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:50.612935 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-6848f0ff-a6ac-4d8d-b68b-4bdfa3c594f4 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:50.615135 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6848f0ff-a6ac-4d8d-b68b-4bdfa3c594f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:50.682733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24d6fb-ecf1-4343-af17-167d6f924274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:50.685289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24d6fb-ecf1-4343-af17-167d6f924274 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:50.685777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24d6fb-ecf1-4343-af17-167d6f924274 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:50.686251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24d6fb-ecf1-4343-af17-167d6f924274 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:50.687584 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24d6fb-ecf1-4343-af17-167d6f924274 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:50.688128 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24d6fb-ecf1-4343-af17-167d6f924274 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:50.690984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24d6fb-ecf1-4343-af17-167d6f924274 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:50.719088 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 383/766] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Sep 7 12:54:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:50.719969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24d6fb-ecf1-4343-af17-167d6f924274 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:50.734561 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:50.752670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 384/767] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:50.754015 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848f0ff-a6ac-4d8d-b68b-4bdfa3c594f4 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:50.795022 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:50.874042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24d6fb-ecf1-4343-af17-167d6f924274 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:50.920142 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c579f-7d23-4d2f-b071-1ef935af90ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:50.921317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c579f-7d23-4d2f-b071-1ef935af90ac None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:50.921576 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c579f-7d23-4d2f-b071-1ef935af90ac None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:50.921853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c579f-7d23-4d2f-b071-1ef935af90ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:50.929986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c579f-7d23-4d2f-b071-1ef935af90ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:50.931471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c579f-7d23-4d2f-b071-1ef935af90ac None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:50.945817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-9e7c579f-7d23-4d2f-b071-1ef935af90ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:50.945817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:50.945817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:50.945817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:50.945817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:50.945817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:50.945817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:50.945817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:50.945817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:50.945817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:50.945817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:50.945817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:50.945817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:50.945817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:50.945817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:50.947579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:50.949475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:50.949475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:50.949475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:50.949475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:50.949475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:50.949475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:50.949475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:50.949475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:50.949475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 384/768] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:50.954733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c579f-7d23-4d2f-b071-1ef935af90ac None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:51.071451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848f0ff-a6ac-4d8d-b68b-4bdfa3c594f4 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:51.154036 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b3247-267d-4a01-9c8d-4667fb2d42ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:51.155426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b3247-267d-4a01-9c8d-4667fb2d42ed None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:51.156134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b3247-267d-4a01-9c8d-4667fb2d42ed None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:51.156854 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b3247-267d-4a01-9c8d-4667fb2d42ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:51.167332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c579f-7d23-4d2f-b071-1ef935af90ac None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:51.177375 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b3247-267d-4a01-9c8d-4667fb2d42ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:51.180323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b3247-267d-4a01-9c8d-4667fb2d42ed None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:51.181717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-7f5b3247-267d-4a01-9c8d-4667fb2d42ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:51.210259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:51.212319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:51.214329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:51.214329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:51.214329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:51.217326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 385/769] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 464 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:51.219142 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b3247-267d-4a01-9c8d-4667fb2d42ed None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:51.232446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee50cf6-224c-4f9c-b25e-ce31448a80c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:51.233138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee50cf6-224c-4f9c-b25e-ce31448a80c7 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:51.233413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee50cf6-224c-4f9c-b25e-ce31448a80c7 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:51.233683 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee50cf6-224c-4f9c-b25e-ce31448a80c7 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:51.234481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee50cf6-224c-4f9c-b25e-ce31448a80c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:51.234783 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee50cf6-224c-4f9c-b25e-ce31448a80c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:51.236350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee50cf6-224c-4f9c-b25e-ce31448a80c7 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:51.251252 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 385/770] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:51.252340 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee50cf6-224c-4f9c-b25e-ce31448a80c7 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:51.317954 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:51.381210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee50cf6-224c-4f9c-b25e-ce31448a80c7 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:51.408997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b3247-267d-4a01-9c8d-4667fb2d42ed None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:51.446890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296e59c-2dda-4688-bf0e-bd8f51dda382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:51.448010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296e59c-2dda-4688-bf0e-bd8f51dda382 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:51.448547 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296e59c-2dda-4688-bf0e-bd8f51dda382 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:51.449073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296e59c-2dda-4688-bf0e-bd8f51dda382 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:51.449916 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632e01-0dae-4e45-a8ee-3f8a7b8d1bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:51.450235 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296e59c-2dda-4688-bf0e-bd8f51dda382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:51.450772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296e59c-2dda-4688-bf0e-bd8f51dda382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:51.451223 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632e01-0dae-4e45-a8ee-3f8a7b8d1bb8 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:51.451762 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632e01-0dae-4e45-a8ee-3f8a7b8d1bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:51.452230 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632e01-0dae-4e45-a8ee-3f8a7b8d1bb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:51.453429 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296e59c-2dda-4688-bf0e-bd8f51dda382 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:51.464822 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd632e01-0dae-4e45-a8ee-3f8a7b8d1bb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-dd632e01-0dae-4e45-a8ee-3f8a7b8d1bb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:51.470888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:51.472257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:51.473159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:51.473159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:51.473159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:51.473159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:51.473159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:51.473159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:51.473159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:51.473159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:51.473159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:51.473159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:51.473159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:51.473159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:51.475980 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 386/771] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:51.477098 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632e01-0dae-4e45-a8ee-3f8a7b8d1bb8 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:51.477748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 386/772] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:51.484415 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296e59c-2dda-4688-bf0e-bd8f51dda382 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:51.526397 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:51.597753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632e01-0dae-4e45-a8ee-3f8a7b8d1bb8 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:51.608348 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:51.621176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296e59c-2dda-4688-bf0e-bd8f51dda382 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:51.637228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d798a7-3a83-4ad8-8299-720ae7992d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:51.637854 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d798a7-3a83-4ad8-8299-720ae7992d0c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:51.638137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d798a7-3a83-4ad8-8299-720ae7992d0c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:51.638410 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d798a7-3a83-4ad8-8299-720ae7992d0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:51.639152 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d798a7-3a83-4ad8-8299-720ae7992d0c None admin] RBAC: Adding query filter params (role.id=6c9336a73ed74d66a83c59fb3269efd5, scope.project.id=3381c0688581489b903e641f91914839, user.id=beb2724f88054621a78b2aaa502f6538) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:51.639460 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d798a7-3a83-4ad8-8299-720ae7992d0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:51.641212 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d798a7-3a83-4ad8-8299-720ae7992d0c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:51.647891 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 387/773] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:51 2022] GET /identity/v3/role_assignments?user.id=beb2724f88054621a78b2aaa502f6538&scope.project.id=3381c0688581489b903e641f91914839&role.id=6c9336a73ed74d66a83c59fb3269efd5 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:51.648981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d798a7-3a83-4ad8-8299-720ae7992d0c None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:51.666587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05c707-9755-484b-8e44-dda210537743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:51.668014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05c707-9755-484b-8e44-dda210537743 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:51.669051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05c707-9755-484b-8e44-dda210537743 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:51.669816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05c707-9755-484b-8e44-dda210537743 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:51.680568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05c707-9755-484b-8e44-dda210537743 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:51.682911 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05c707-9755-484b-8e44-dda210537743 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:51.698955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-6b05c707-9755-484b-8e44-dda210537743 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:51.698955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:51.698955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:51.698955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:51.698955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:51.698955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:51.698955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:51.698955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:51.698955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:51.698955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:51.698955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:51.698955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:51.698955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:51.698955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:51.698955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:51.699937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:51.700875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:51.700875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:51.700875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:51.700875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:51.700875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:51.700875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:51.700875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:51.700875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:51.702381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 387/774] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:54:51.708462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05c707-9755-484b-8e44-dda210537743 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:51.807059 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d798a7-3a83-4ad8-8299-720ae7992d0c None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:51.836806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:51.867384 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05c707-9755-484b-8e44-dda210537743 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:51.869760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3993f03-07f3-4d4d-aabb-ded836403f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:51.871962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993f03-07f3-4d4d-aabb-ded836403f9b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:51.872587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993f03-07f3-4d4d-aabb-ded836403f9b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:51.873162 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993f03-07f3-4d4d-aabb-ded836403f9b None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:51.874393 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3993f03-07f3-4d4d-aabb-ded836403f9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:51.874907 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3993f03-07f3-4d4d-aabb-ded836403f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:51.876868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3993f03-07f3-4d4d-aabb-ded836403f9b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:51.891350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 388/775] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:51.903405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3993f03-07f3-4d4d-aabb-ded836403f9b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:51.941529 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d8d41-7c45-4599-8a9b-cd7162dee42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:51.942116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d8d41-7c45-4599-8a9b-cd7162dee42e None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:51.942400 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d8d41-7c45-4599-8a9b-cd7162dee42e None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:51.944052 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d8d41-7c45-4599-8a9b-cd7162dee42e None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:51.945363 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d8d41-7c45-4599-8a9b-cd7162dee42e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:51.945676 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d8d41-7c45-4599-8a9b-cd7162dee42e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:51.947739 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d8d41-7c45-4599-8a9b-cd7162dee42e None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:51.992881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 388/776] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:52.004574 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:52.014102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d8d41-7c45-4599-8a9b-cd7162dee42e None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:52.139614 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3993f03-07f3-4d4d-aabb-ded836403f9b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:52.184943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1eea05-c28b-4cbc-af76-2987295c534e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:52.186000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1eea05-c28b-4cbc-af76-2987295c534e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:52.186475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1eea05-c28b-4cbc-af76-2987295c534e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:52.186935 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1eea05-c28b-4cbc-af76-2987295c534e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:52.202311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1eea05-c28b-4cbc-af76-2987295c534e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:52.205273 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1eea05-c28b-4cbc-af76-2987295c534e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-4f1eea05-c28b-4cbc-af76-2987295c534e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:52.226476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:52.227486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:52.228490 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:52.228490 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:52.228490 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:52.233010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 389/777] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:54:52.233010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148877a-9bf5-46a0-963b-63e3f0049bb5 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:52.233010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148877a-9bf5-46a0-963b-63e3f0049bb5 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:52.233010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148877a-9bf5-46a0-963b-63e3f0049bb5 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:52.233010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 390/778] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:52.239420 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148877a-9bf5-46a0-963b-63e3f0049bb5 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:52.248995 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d8d41-7c45-4599-8a9b-cd7162dee42e None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:52.297718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d998d3-d72f-47ee-b822-c845e93e3f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:52.299137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d998d3-d72f-47ee-b822-c845e93e3f18 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:52.299563 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d998d3-d72f-47ee-b822-c845e93e3f18 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:52.299993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d998d3-d72f-47ee-b822-c845e93e3f18 None admin] PATH_INFO: `/v3/projects/3381c0688581489b903e641f91914839/users/fbe8fa8ab8094aa69933398280810692/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:52.302812 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d998d3-d72f-47ee-b822-c845e93e3f18 None admin] RBAC: Authorizing `identity:create_grant(project_id=3381c0688581489b903e641f91914839, user_id=fbe8fa8ab8094aa69933398280810692, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:52.304618 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d998d3-d72f-47ee-b822-c845e93e3f18 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:52.321181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 389/779] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:54:52 2022] PUT /identity/v3/projects/3381c0688581489b903e641f91914839/users/fbe8fa8ab8094aa69933398280810692/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:54:52.322887 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be634a8-a2ea-4405-a6e9-11bafb3d46ff None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:52.323168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be634a8-a2ea-4405-a6e9-11bafb3d46ff None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:52.323435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be634a8-a2ea-4405-a6e9-11bafb3d46ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:52.338712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:52.348783 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-2be634a8-a2ea-4405-a6e9-11bafb3d46ff None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:52.351260 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2be634a8-a2ea-4405-a6e9-11bafb3d46ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:52.358432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:52.388426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148877a-9bf5-46a0-963b-63e3f0049bb5 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:52.448663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ee7e1-444c-4f55-bb37-ef01c8e5dbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:52.449745 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ee7e1-444c-4f55-bb37-ef01c8e5dbd2 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:52.450184 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ee7e1-444c-4f55-bb37-ef01c8e5dbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:52.450736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ee7e1-444c-4f55-bb37-ef01c8e5dbd2 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:52.451841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ee7e1-444c-4f55-bb37-ef01c8e5dbd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:52.452401 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ee7e1-444c-4f55-bb37-ef01c8e5dbd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:52.456463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 390/780] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:52.456463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad80d9-e821-45e4-b9b5-34c70baebbb2 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:52.456463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad80d9-e821-45e4-b9b5-34c70baebbb2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:52.456463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad80d9-e821-45e4-b9b5-34c70baebbb2 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:52.457659 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 391/781] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:52.458281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ee7e1-444c-4f55-bb37-ef01c8e5dbd2 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:52.468137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e556429-fd0e-4bc7-b7b8-770bf93d67d4 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:52.468137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e556429-fd0e-4bc7-b7b8-770bf93d67d4 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:52.468137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e556429-fd0e-4bc7-b7b8-770bf93d67d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:52.486964 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 391/782] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:52.494607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ee7e1-444c-4f55-bb37-ef01c8e5dbd2 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:52.510153 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-7e556429-fd0e-4bc7-b7b8-770bf93d67d4 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:52.511940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7e556429-fd0e-4bc7-b7b8-770bf93d67d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:52.716339 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 392/783] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:54:52.735036 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ee7e1-444c-4f55-bb37-ef01c8e5dbd2 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:52.809013 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e556429-fd0e-4bc7-b7b8-770bf93d67d4 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:52.838480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f79e1-5ea7-414b-865c-311df3e8f7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:52.840006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f79e1-5ea7-414b-865c-311df3e8f7cb None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:52.840763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f79e1-5ea7-414b-865c-311df3e8f7cb None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:52.841529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f79e1-5ea7-414b-865c-311df3e8f7cb None admin] PATH_INFO: `/v3/users/swift` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:52.872873 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f79e1-5ea7-414b-865c-311df3e8f7cb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:52.875772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f79e1-5ea7-414b-865c-311df3e8f7cb None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-647f79e1-5ea7-414b-865c-311df3e8f7cb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:52.928609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:52.929816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:52.930772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:52.930772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:52.930772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:52.930772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:52.930772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:52.930772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:52.930772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:52.930772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:52.930772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:54:52.930772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:52.944571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 392/784] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:52.955078 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f79e1-5ea7-414b-865c-311df3e8f7cb None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:52.990718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:53.063377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:53.106361 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e556429-fd0e-4bc7-b7b8-770bf93d67d4 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:53.149143 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127c899-864b-4594-a80e-bf02c236cb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:53.149806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127c899-864b-4594-a80e-bf02c236cb2d None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:53.150084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127c899-864b-4594-a80e-bf02c236cb2d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:53.150355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127c899-864b-4594-a80e-bf02c236cb2d None admin] PATH_INFO: `/v3/services/network` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:53.150971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127c899-864b-4594-a80e-bf02c236cb2d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:53.152675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127c899-864b-4594-a80e-bf02c236cb2d None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-9127c899-864b-4594-a80e-bf02c236cb2d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:53.163282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:53.164409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:53.165345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:53.165345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:53.165345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:53.165345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:53.165345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:53.165345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:53.165345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:53.165345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:53.165345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:53.165345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:53.165345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:54:53.165345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:54:53.165345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:54:53.165345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:53.165345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 393/785] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:52 2022] GET /identity/v3/services/network => generated 88 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:54:53.166165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127c899-864b-4594-a80e-bf02c236cb2d None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:53.186661 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f79e1-5ea7-414b-865c-311df3e8f7cb None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:53.251023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dea818-fa52-4665-bd01-4eeb2c0fe55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:53.252225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dea818-fa52-4665-bd01-4eeb2c0fe55c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:53.253009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dea818-fa52-4665-bd01-4eeb2c0fe55c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:53.253470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dea818-fa52-4665-bd01-4eeb2c0fe55c None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:53.254830 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dea818-fa52-4665-bd01-4eeb2c0fe55c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:53.255357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dea818-fa52-4665-bd01-4eeb2c0fe55c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:53.258146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dea818-fa52-4665-bd01-4eeb2c0fe55c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:53.282216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127c899-864b-4594-a80e-bf02c236cb2d None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:53.300552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 393/786] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Sep 7 12:54:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:53.302166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dea818-fa52-4665-bd01-4eeb2c0fe55c None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:53.316066 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:53.325443 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816c4e1-34a1-4bd4-ba4b-63b74f21c3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:53.326102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816c4e1-34a1-4bd4-ba4b-63b74f21c3ad None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:53.326377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816c4e1-34a1-4bd4-ba4b-63b74f21c3ad None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:53.326648 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816c4e1-34a1-4bd4-ba4b-63b74f21c3ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:53.327244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816c4e1-34a1-4bd4-ba4b-63b74f21c3ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:53.328671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816c4e1-34a1-4bd4-ba4b-63b74f21c3ad None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-e816c4e1-34a1-4bd4-ba4b-63b74f21c3ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:53.341075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:53.342658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:53.343700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:53.343700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:53.343700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:53.343700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:53.343700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:53.343700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:53.343700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:53.343700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:53.343700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:53.343700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:53.343700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:54:53.343700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:54:53.343700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:54:53.343700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:53.343700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 394/787] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Sep 7 12:54:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:53.348996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816c4e1-34a1-4bd4-ba4b-63b74f21c3ad None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:53.454775 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:53.516513 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816c4e1-34a1-4bd4-ba4b-63b74f21c3ad None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:53.527986 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dea818-fa52-4665-bd01-4eeb2c0fe55c None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:53.565904 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62b25a-954d-416d-b54e-dec8d69f0686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:53.567095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491c971-0710-4be3-9a32-1994a3446d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:53.567377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62b25a-954d-416d-b54e-dec8d69f0686 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:53.567717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491c971-0710-4be3-9a32-1994a3446d45 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:53.567971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62b25a-954d-416d-b54e-dec8d69f0686 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:53.568116 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491c971-0710-4be3-9a32-1994a3446d45 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:53.568248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491c971-0710-4be3-9a32-1994a3446d45 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:53.568667 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62b25a-954d-416d-b54e-dec8d69f0686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:53.569036 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491c971-0710-4be3-9a32-1994a3446d45 None admin] RBAC: Adding query filter params (name=network) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:53.569437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491c971-0710-4be3-9a32-1994a3446d45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:53.570856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491c971-0710-4be3-9a32-1994a3446d45 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:53.576224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 394/788] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Sep 7 12:54:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:53.577220 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491c971-0710-4be3-9a32-1994a3446d45 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:53.582847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62b25a-954d-416d-b54e-dec8d69f0686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:53.584610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62b25a-954d-416d-b54e-dec8d69f0686 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-ca62b25a-954d-416d-b54e-dec8d69f0686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:53.602567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:53.603772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:53.604884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:53.604884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:53.604884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:53.606898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 395/789] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:53.607896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62b25a-954d-416d-b54e-dec8d69f0686 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:53.676118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:53.724715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491c971-0710-4be3-9a32-1994a3446d45 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:53.757653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62b25a-954d-416d-b54e-dec8d69f0686 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:53.770793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:53.780769 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483d06d-c16c-417e-80f4-9446db7c6ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:53.781508 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483d06d-c16c-417e-80f4-9446db7c6ee3 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:53.781793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483d06d-c16c-417e-80f4-9446db7c6ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:53.782141 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483d06d-c16c-417e-80f4-9446db7c6ee3 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:53.783040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483d06d-c16c-417e-80f4-9446db7c6ee3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:53.783476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483d06d-c16c-417e-80f4-9446db7c6ee3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:53.785200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483d06d-c16c-417e-80f4-9446db7c6ee3 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:53.796144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 395/790] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Sep 7 12:54:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:53.797072 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483d06d-c16c-417e-80f4-9446db7c6ee3 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:53.816979 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0c530-a6cc-4218-80e0-8052ca94a485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:53.818096 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0c530-a6cc-4218-80e0-8052ca94a485 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:53.818534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0c530-a6cc-4218-80e0-8052ca94a485 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:53.819002 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0c530-a6cc-4218-80e0-8052ca94a485 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:53.820103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0c530-a6cc-4218-80e0-8052ca94a485 None admin] RBAC: Adding query filter params (type=network) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:53.820584 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0c530-a6cc-4218-80e0-8052ca94a485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:53.822509 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0c530-a6cc-4218-80e0-8052ca94a485 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:53.829704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 396/791] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Sep 7 12:54:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:53.831385 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0c530-a6cc-4218-80e0-8052ca94a485 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:53.919191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483d06d-c16c-417e-80f4-9446db7c6ee3 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:53.964070 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901643cb-f273-408b-810d-7fdc38b6c4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:53.964683 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901643cb-f273-408b-810d-7fdc38b6c4af None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:53.964965 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901643cb-f273-408b-810d-7fdc38b6c4af None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:53.965241 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901643cb-f273-408b-810d-7fdc38b6c4af None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:53.965918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901643cb-f273-408b-810d-7fdc38b6c4af None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:53.966228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901643cb-f273-408b-810d-7fdc38b6c4af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:53.968160 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901643cb-f273-408b-810d-7fdc38b6c4af None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:53.975480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0c530-a6cc-4218-80e0-8052ca94a485 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:53.982888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 396/792] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:53.988917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901643cb-f273-408b-810d-7fdc38b6c4af None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:53.990734 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:54.021631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaed1ea-0f7a-4be7-a319-2ac9f33b131a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:54.022500 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaed1ea-0f7a-4be7-a319-2ac9f33b131a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:54.022925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaed1ea-0f7a-4be7-a319-2ac9f33b131a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:54.023431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaed1ea-0f7a-4be7-a319-2ac9f33b131a None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:54.024338 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaed1ea-0f7a-4be7-a319-2ac9f33b131a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:54.024810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaed1ea-0f7a-4be7-a319-2ac9f33b131a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:54.026381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaed1ea-0f7a-4be7-a319-2ac9f33b131a None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:54.032913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 397/793] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Sep 7 12:54:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:54.039705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaed1ea-0f7a-4be7-a319-2ac9f33b131a None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:54.056569 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:54.125174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901643cb-f273-408b-810d-7fdc38b6c4af None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:54.170635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c20294-5df4-4a75-8ece-f4e1c5cd2073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:54.171268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c20294-5df4-4a75-8ece-f4e1c5cd2073 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:54.171548 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c20294-5df4-4a75-8ece-f4e1c5cd2073 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:54.171824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c20294-5df4-4a75-8ece-f4e1c5cd2073 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:54.172759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c20294-5df4-4a75-8ece-f4e1c5cd2073 None admin] RBAC: Adding query filter params (interface=public, service_id=15af0cd26c024ef68d8e6fdd5a68872b, region_id=RegionOne) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:54.172949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c20294-5df4-4a75-8ece-f4e1c5cd2073 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:54.174759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c20294-5df4-4a75-8ece-f4e1c5cd2073 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:54.184626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 397/794] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Sep 7 12:54:53 2022] GET /identity/v3/endpoints?service_id=15af0cd26c024ef68d8e6fdd5a68872b&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:54.185630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c20294-5df4-4a75-8ece-f4e1c5cd2073 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:54.211212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaed1ea-0f7a-4be7-a319-2ac9f33b131a None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:54.275958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e853c9-4fef-415d-b484-c6bf30ccfb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:54.277495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e853c9-4fef-415d-b484-c6bf30ccfb13 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:54.278182 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e853c9-4fef-415d-b484-c6bf30ccfb13 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:54.278840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e853c9-4fef-415d-b484-c6bf30ccfb13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:54.291695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e853c9-4fef-415d-b484-c6bf30ccfb13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:54.295003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e853c9-4fef-415d-b484-c6bf30ccfb13 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:54.316112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-e0e853c9-4fef-415d-b484-c6bf30ccfb13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:54.316112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:54.316112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:54.316112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:54.316112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:54.316112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:54.316112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:54.316112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:54.316112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:54.316112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:54.316112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:54.316112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:54.316112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:54.316112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:54.316112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:54.317127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:54.318012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:54.318012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:54.318012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:54.318012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:54.318012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:54.318012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:54.318012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:54.318012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:54.324888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 398/795] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:54.326150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e853c9-4fef-415d-b484-c6bf30ccfb13 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:54.331486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c20294-5df4-4a75-8ece-f4e1c5cd2073 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:54.362827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:54.381738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:54.393615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd75ed-858b-4ddf-9325-30a67ffd7b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:54.394280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd75ed-858b-4ddf-9325-30a67ffd7b4e None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:54.394598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd75ed-858b-4ddf-9325-30a67ffd7b4e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:54.395048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd75ed-858b-4ddf-9325-30a67ffd7b4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:54.396011 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd75ed-858b-4ddf-9325-30a67ffd7b4e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:54.397701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd75ed-858b-4ddf-9325-30a67ffd7b4e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:54.440414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 398/796] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 12:54:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:54:54.440414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd75ed-858b-4ddf-9325-30a67ffd7b4e None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:54.563697 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e853c9-4fef-415d-b484-c6bf30ccfb13 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:54.677962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56130d0a-ede5-4bc6-8c35-2e4e3cf7b66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:54.684416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56130d0a-ede5-4bc6-8c35-2e4e3cf7b66d None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:54.684416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56130d0a-ede5-4bc6-8c35-2e4e3cf7b66d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:54.684416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56130d0a-ede5-4bc6-8c35-2e4e3cf7b66d None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:54.684416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56130d0a-ede5-4bc6-8c35-2e4e3cf7b66d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:54.685031 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56130d0a-ede5-4bc6-8c35-2e4e3cf7b66d None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:54.692114 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 399/797] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Sep 7 12:54:54 2022] GET /identity/v3/services => generated 772 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:54.694414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b6d68-74c1-4e97-9afa-4a546cb9877e None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:54.694884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b6d68-74c1-4e97-9afa-4a546cb9877e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:54.695352 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b6d68-74c1-4e97-9afa-4a546cb9877e None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:54.697755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 400/798] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:54.705555 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa4395-09ab-4df5-83ed-c350aaf64d6b None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:54.705806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa4395-09ab-4df5-83ed-c350aaf64d6b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:54.706341 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa4395-09ab-4df5-83ed-c350aaf64d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:54.750549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-cbfa4395-09ab-4df5-83ed-c350aaf64d6b None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:54.752736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-cbfa4395-09ab-4df5-83ed-c350aaf64d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:54.846532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd75ed-858b-4ddf-9325-30a67ffd7b4e None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:54.886348 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 401/799] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:54:54.911656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f0902-0921-4bda-9c5c-f03d025b83a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:54.912309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f0902-0921-4bda-9c5c-f03d025b83a6 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:54.912724 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f0902-0921-4bda-9c5c-f03d025b83a6 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:54.913094 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f0902-0921-4bda-9c5c-f03d025b83a6 None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:54.913831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f0902-0921-4bda-9c5c-f03d025b83a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:54.914137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f0902-0921-4bda-9c5c-f03d025b83a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:54.915716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f0902-0921-4bda-9c5c-f03d025b83a6 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:54.931817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 399/800] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:54.938443 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa4395-09ab-4df5-83ed-c350aaf64d6b None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:54.977457 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:55.064210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa4395-09ab-4df5-83ed-c350aaf64d6b None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:55.108054 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4915a2-f672-4290-80f9-a248f24255a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:55.109075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4915a2-f672-4290-80f9-a248f24255a1 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:55.109539 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4915a2-f672-4290-80f9-a248f24255a1 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:55.110166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4915a2-f672-4290-80f9-a248f24255a1 None admin] PATH_INFO: `/v3/projects/3381c0688581489b903e641f91914839/users/f3796ca94b914fd18946551fa2bff331/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:55.113858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4915a2-f672-4290-80f9-a248f24255a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3381c0688581489b903e641f91914839, user_id=f3796ca94b914fd18946551fa2bff331, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:55.116853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4915a2-f672-4290-80f9-a248f24255a1 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:55.139450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 402/801] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:54:54 2022] PUT /identity/v3/projects/3381c0688581489b903e641f91914839/users/f3796ca94b914fd18946551fa2bff331/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:54:55.279017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f0902-0921-4bda-9c5c-f03d025b83a6 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:55.316732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:55.328398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91a478-2e98-46bc-96f5-418868ca3f56 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:55.328688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91a478-2e98-46bc-96f5-418868ca3f56 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:55.329040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91a478-2e98-46bc-96f5-418868ca3f56 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:55.331408 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 403/802] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:54:55.337506 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0e42c-067f-49ea-8277-cfee22911ad2 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:55.337809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0e42c-067f-49ea-8277-cfee22911ad2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:55.338135 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0e42c-067f-49ea-8277-cfee22911ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:55.379211 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-73b0e42c-067f-49ea-8277-cfee22911ad2 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:55.383536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-73b0e42c-067f-49ea-8277-cfee22911ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:55.471164 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f0902-0921-4bda-9c5c-f03d025b83a6 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:55.523300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3667b0-06f3-42a0-a398-5a4b97a06239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:55.524071 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3667b0-06f3-42a0-a398-5a4b97a06239 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:55.524354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3667b0-06f3-42a0-a398-5a4b97a06239 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:55.524553 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3667b0-06f3-42a0-a398-5a4b97a06239 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:55.559901 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 404/803] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:54:55.561942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3667b0-06f3-42a0-a398-5a4b97a06239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-2a3667b0-06f3-42a0-a398-5a4b97a06239 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:55.572352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:55.573467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:55.574704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:55.574704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:55.574704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:55.574704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:55.574704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:55.574704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:55.574704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:55.574704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:55.574704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:55.574704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:55.574704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:54:55.574704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:55.576710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 400/804] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:54:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:55.585137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0e42c-067f-49ea-8277-cfee22911ad2 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:55.613043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:55.780560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0e42c-067f-49ea-8277-cfee22911ad2 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:55.849583 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c789d-fe96-46c9-9449-1d98bdf2dd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:55.850315 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c789d-fe96-46c9-9449-1d98bdf2dd54 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:55.850775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c789d-fe96-46c9-9449-1d98bdf2dd54 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:55.851146 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c789d-fe96-46c9-9449-1d98bdf2dd54 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:55.852582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c789d-fe96-46c9-9449-1d98bdf2dd54 None admin] RBAC: Adding query filter params (name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:55.852582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c789d-fe96-46c9-9449-1d98bdf2dd54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:55.853988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c789d-fe96-46c9-9449-1d98bdf2dd54 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:55.871283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 405/805] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:54:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:55.882712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3667b0-06f3-42a0-a398-5a4b97a06239 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:55.914181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c789d-fe96-46c9-9449-1d98bdf2dd54 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:56.068998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:56.091433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3667b0-06f3-42a0-a398-5a4b97a06239 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:56.096797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:56.123394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c789d-fe96-46c9-9449-1d98bdf2dd54 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:56.159791 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eba9a4-356a-42dd-a9cd-2d3ff71dde42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:56.160589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eba9a4-356a-42dd-a9cd-2d3ff71dde42 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:56.160887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eba9a4-356a-42dd-a9cd-2d3ff71dde42 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:56.161194 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eba9a4-356a-42dd-a9cd-2d3ff71dde42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:56.194663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eba9a4-356a-42dd-a9cd-2d3ff71dde42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:56.196864 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eba9a4-356a-42dd-a9cd-2d3ff71dde42 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:56.216561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d6823-f3a9-4139-8301-5ae9925737bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:56.217511 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d6823-f3a9-4139-8301-5ae9925737bf None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:56.217946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d6823-f3a9-4139-8301-5ae9925737bf None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:56.218268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d6823-f3a9-4139-8301-5ae9925737bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-a2eba9a4-356a-42dd-a9cd-2d3ff71dde42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:56.242510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:56.243551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:56.244482 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:56.244482 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:56.244482 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:56.252119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 401/806] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:56.253463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eba9a4-356a-42dd-a9cd-2d3ff71dde42 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:56.254126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d6823-f3a9-4139-8301-5ae9925737bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-1d4d6823-f3a9-4139-8301-5ae9925737bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:56.260020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:56.261290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:56.262165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:56.262165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:56.262165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:56.262165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:56.262165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:56.262165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:56.262165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:56.262165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:56.262165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:56.262165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:56.262165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:56.262165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:56.264423 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 406/807] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:56.277386 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d6823-f3a9-4139-8301-5ae9925737bf None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:56.478857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d6823-f3a9-4139-8301-5ae9925737bf None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:56.556559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c389da-dd31-46da-8fbf-a693bc43c4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:56.558260 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c389da-dd31-46da-8fbf-a693bc43c4b8 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:56.558926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c389da-dd31-46da-8fbf-a693bc43c4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:56.559309 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c389da-dd31-46da-8fbf-a693bc43c4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:56.560166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c389da-dd31-46da-8fbf-a693bc43c4b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:56.560500 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c389da-dd31-46da-8fbf-a693bc43c4b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:56.562357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c389da-dd31-46da-8fbf-a693bc43c4b8 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:56.565111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eba9a4-356a-42dd-a9cd-2d3ff71dde42 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:56.565873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:56.574515 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 407/808] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:56.585597 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c389da-dd31-46da-8fbf-a693bc43c4b8 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:56.691646 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3ee38-ceb5-4725-b8a0-cb599f247d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:56.692711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3ee38-ceb5-4725-b8a0-cb599f247d40 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:56.693191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3ee38-ceb5-4725-b8a0-cb599f247d40 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:56.693678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3ee38-ceb5-4725-b8a0-cb599f247d40 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:56.694891 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3ee38-ceb5-4725-b8a0-cb599f247d40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:56.695388 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3ee38-ceb5-4725-b8a0-cb599f247d40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:56.698028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3ee38-ceb5-4725-b8a0-cb599f247d40 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:56.734665 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 402/809] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:56.741774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3ee38-ceb5-4725-b8a0-cb599f247d40 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:56.764798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:56.887014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c389da-dd31-46da-8fbf-a693bc43c4b8 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:56.911944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3ee38-ceb5-4725-b8a0-cb599f247d40 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:56.973524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce341e3-88a1-4db5-aac6-e5da3aa29c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:56.974368 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce341e3-88a1-4db5-aac6-e5da3aa29c31 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:56.974902 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce341e3-88a1-4db5-aac6-e5da3aa29c31 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:56.975241 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce341e3-88a1-4db5-aac6-e5da3aa29c31 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:56.986273 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce341e3-88a1-4db5-aac6-e5da3aa29c31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:56.988335 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce341e3-88a1-4db5-aac6-e5da3aa29c31 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-2ce341e3-88a1-4db5-aac6-e5da3aa29c31 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:57.006711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:57.007763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:57.008863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:57.008863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:57.008863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:57.008863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:57.008863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:57.008863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:57.008863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:57.008863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:57.008863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:54:57.008863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:57.010711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 403/810] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Sep 7 12:54:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:57.016326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce341e3-88a1-4db5-aac6-e5da3aa29c31 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:57.021245 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158875e-1851-48da-bbf6-276e7aa8e1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:57.022153 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158875e-1851-48da-bbf6-276e7aa8e1b3 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:57.022341 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158875e-1851-48da-bbf6-276e7aa8e1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:57.022509 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158875e-1851-48da-bbf6-276e7aa8e1b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:57.045347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158875e-1851-48da-bbf6-276e7aa8e1b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:57.046827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158875e-1851-48da-bbf6-276e7aa8e1b3 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-b158875e-1851-48da-bbf6-276e7aa8e1b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:57.085259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:57.087827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:57.090322 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:57.090322 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:57.090322 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:57.093223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 408/811] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 509 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:57.108862 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:57.110958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158875e-1851-48da-bbf6-276e7aa8e1b3 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:57.169931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce341e3-88a1-4db5-aac6-e5da3aa29c31 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:57.221647 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:57.238512 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487397f-1b62-4565-8fed-cd7dddfd285a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:57.238983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487397f-1b62-4565-8fed-cd7dddfd285a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:57.239266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487397f-1b62-4565-8fed-cd7dddfd285a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:57.239539 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487397f-1b62-4565-8fed-cd7dddfd285a None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:57.240303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487397f-1b62-4565-8fed-cd7dddfd285a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:57.240648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487397f-1b62-4565-8fed-cd7dddfd285a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:57.242240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487397f-1b62-4565-8fed-cd7dddfd285a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:57.264101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 404/812] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Sep 7 12:54:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:57.270546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487397f-1b62-4565-8fed-cd7dddfd285a None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:57.301832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158875e-1851-48da-bbf6-276e7aa8e1b3 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:57.352031 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e33034-10ff-4917-b9a0-434bfca11f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:57.352031 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e33034-10ff-4917-b9a0-434bfca11f16 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:57.352031 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e33034-10ff-4917-b9a0-434bfca11f16 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:57.354086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e33034-10ff-4917-b9a0-434bfca11f16 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:57.354266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e33034-10ff-4917-b9a0-434bfca11f16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:57.356412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e33034-10ff-4917-b9a0-434bfca11f16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:57.356412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e33034-10ff-4917-b9a0-434bfca11f16 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:57.388506 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 409/813] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:57.389914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487397f-1b62-4565-8fed-cd7dddfd285a None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:57.395999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e33034-10ff-4917-b9a0-434bfca11f16 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:57.421459 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:57.433379 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5df1e-4e5e-4559-a4cc-cab8ab90d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:57.434207 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5df1e-4e5e-4559-a4cc-cab8ab90d870 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:57.434596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5df1e-4e5e-4559-a4cc-cab8ab90d870 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:57.434975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5df1e-4e5e-4559-a4cc-cab8ab90d870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:57.446863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5df1e-4e5e-4559-a4cc-cab8ab90d870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:57.448635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5df1e-4e5e-4559-a4cc-cab8ab90d870 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-d3e5df1e-4e5e-4559-a4cc-cab8ab90d870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:57.465575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:57.467384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:57.469774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:57.469774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:57.469774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:57.469774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 405/814] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:57.474622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5df1e-4e5e-4559-a4cc-cab8ab90d870 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:57.609325 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5df1e-4e5e-4559-a4cc-cab8ab90d870 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:57.637718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e33034-10ff-4917-b9a0-434bfca11f16 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:57.653867 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd0876-ce49-43c0-9d15-10918a750e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:57.654979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd0876-ce49-43c0-9d15-10918a750e98 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:57.655447 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd0876-ce49-43c0-9d15-10918a750e98 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:57.655931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd0876-ce49-43c0-9d15-10918a750e98 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:57.656779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd0876-ce49-43c0-9d15-10918a750e98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:57.657096 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd0876-ce49-43c0-9d15-10918a750e98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:57.658833 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd0876-ce49-43c0-9d15-10918a750e98 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:57.668860 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:57.673124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 406/815] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:57.679203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd0876-ce49-43c0-9d15-10918a750e98 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:57.717647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:57.760093 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf598094-4742-4ab7-8225-282e1a10dd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:57.763035 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf598094-4742-4ab7-8225-282e1a10dd06 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:57.763327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf598094-4742-4ab7-8225-282e1a10dd06 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:57.763626 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf598094-4742-4ab7-8225-282e1a10dd06 None admin] PATH_INFO: `/v3/users/nova` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:57.783853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf598094-4742-4ab7-8225-282e1a10dd06 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:57.786664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf598094-4742-4ab7-8225-282e1a10dd06 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-cf598094-4742-4ab7-8225-282e1a10dd06 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:54:57.825436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:57.827333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:57.829262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:57.829262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:57.829262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:54:57.829262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:54:57.829262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:54:57.829262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:54:57.829262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:54:57.829262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:54:57.829262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:54:57.829262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:57.830994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd0876-ce49-43c0-9d15-10918a750e98 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:57.833825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 410/816] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Sep 7 12:54:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:54:57.840401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf598094-4742-4ab7-8225-282e1a10dd06 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:57.871637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebdb78-2491-45fb-855d-8064a3b91943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:57.872272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebdb78-2491-45fb-855d-8064a3b91943 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:57.872592 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebdb78-2491-45fb-855d-8064a3b91943 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:57.872915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebdb78-2491-45fb-855d-8064a3b91943 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:57.881773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebdb78-2491-45fb-855d-8064a3b91943 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:57.883305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebdb78-2491-45fb-855d-8064a3b91943 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:57.897449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-47ebdb78-2491-45fb-855d-8064a3b91943 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:57.897449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:57.897449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:57.897449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:57.897449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:57.897449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:57.897449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:57.897449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:57.897449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:57.897449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:57.897449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:57.897449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:57.897449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:57.897449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:57.897449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:57.898716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:57.900547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:57.900547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:57.900547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:57.900547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:57.900547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:57.900547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:57.900547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:57.900547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:57.900547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 407/817] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:57.900547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d346d9b-53dc-4920-9ffc-40927ce42799 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:57.908450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d346d9b-53dc-4920-9ffc-40927ce42799 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:57.908450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d346d9b-53dc-4920-9ffc-40927ce42799 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:57.908450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 408/818] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:57.908450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d346d9b-53dc-4920-9ffc-40927ce42799 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:58.007120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf598094-4742-4ab7-8225-282e1a10dd06 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:58.043641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:58.055596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e456918-11d9-419a-bdfb-562fd4497ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:58.056180 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d346d9b-53dc-4920-9ffc-40927ce42799 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:58.056465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e456918-11d9-419a-bdfb-562fd4497ce3 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:58.056816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e456918-11d9-419a-bdfb-562fd4497ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:58.057161 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e456918-11d9-419a-bdfb-562fd4497ce3 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:58.057977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e456918-11d9-419a-bdfb-562fd4497ce3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:58.058346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e456918-11d9-419a-bdfb-562fd4497ce3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:58.060951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e456918-11d9-419a-bdfb-562fd4497ce3 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:58.088444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 411/819] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Sep 7 12:54:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:58.088444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25a568-521a-4fb3-b490-24ee948c2dff None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:58.088444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25a568-521a-4fb3-b490-24ee948c2dff None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:58.088444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25a568-521a-4fb3-b490-24ee948c2dff None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:58.088444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 412/820] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:58.088444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfb0a9-6a03-49be-805a-22e9a0dcf109 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:58.089101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfb0a9-6a03-49be-805a-22e9a0dcf109 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:58.089176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfb0a9-6a03-49be-805a-22e9a0dcf109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:58.113426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-6ebfb0a9-6a03-49be-805a-22e9a0dcf109 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:58.114655 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6ebfb0a9-6a03-49be-805a-22e9a0dcf109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:58.120336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a75d2d-a8d2-43f0-b3fc-3134815b375f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:58.121379 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a75d2d-a8d2-43f0-b3fc-3134815b375f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:58.121936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a75d2d-a8d2-43f0-b3fc-3134815b375f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:58.122317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a75d2d-a8d2-43f0-b3fc-3134815b375f None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:58.123449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a75d2d-a8d2-43f0-b3fc-3134815b375f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:58.124262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a75d2d-a8d2-43f0-b3fc-3134815b375f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:58.126724 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a75d2d-a8d2-43f0-b3fc-3134815b375f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:58.141247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:58.150507 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 409/821] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:58.152729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a75d2d-a8d2-43f0-b3fc-3134815b375f None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:58.206522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 413/822] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:58.208095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a13d2-5a84-4d79-ac1e-6f4be3a071ab None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:58.208577 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a13d2-5a84-4d79-ac1e-6f4be3a071ab None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:58.209048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a13d2-5a84-4d79-ac1e-6f4be3a071ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:58.235934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-021a13d2-5a84-4d79-ac1e-6f4be3a071ab None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:58.237968 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-021a13d2-5a84-4d79-ac1e-6f4be3a071ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:58.300337 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a75d2d-a8d2-43f0-b3fc-3134815b375f None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:58.321200 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 414/823] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:58.322558 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a13d2-5a84-4d79-ac1e-6f4be3a071ab None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:58.343818 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa9ca6-0a3c-4c3c-baa5-21389d2e440d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:58.344759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa9ca6-0a3c-4c3c-baa5-21389d2e440d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:58.345202 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa9ca6-0a3c-4c3c-baa5-21389d2e440d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:58.345671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa9ca6-0a3c-4c3c-baa5-21389d2e440d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:58.376916 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:58.435487 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa9ca6-0a3c-4c3c-baa5-21389d2e440d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:58.437493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa9ca6-0a3c-4c3c-baa5-21389d2e440d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:58.475837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:58.491881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a13d2-5a84-4d79-ac1e-6f4be3a071ab None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:58.538396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e620dc8-b8b5-4600-a30b-50ee8a7ae315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:58.539082 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e620dc8-b8b5-4600-a30b-50ee8a7ae315 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:58.539418 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e620dc8-b8b5-4600-a30b-50ee8a7ae315 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:58.539630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e620dc8-b8b5-4600-a30b-50ee8a7ae315 None admin] PATH_INFO: `/v3/projects/3381c0688581489b903e641f91914839/users/beb2724f88054621a78b2aaa502f6538/roles/6c9336a73ed74d66a83c59fb3269efd5` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:58.561548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e620dc8-b8b5-4600-a30b-50ee8a7ae315 None admin] RBAC: Authorizing `identity:create_grant(project_id=3381c0688581489b903e641f91914839, user_id=beb2724f88054621a78b2aaa502f6538, role_id=6c9336a73ed74d66a83c59fb3269efd5)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:58.562974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 410/824] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:54:58.563663 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e620dc8-b8b5-4600-a30b-50ee8a7ae315 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:58.564283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929db9e0-9ffe-4c47-bf3f-d2038c55cfd4 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:58.564623 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929db9e0-9ffe-4c47-bf3f-d2038c55cfd4 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:58.565079 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929db9e0-9ffe-4c47-bf3f-d2038c55cfd4 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:58.571457 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 411/825] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:54:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:58.571457 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929db9e0-9ffe-4c47-bf3f-d2038c55cfd4 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:58.587316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 415/826] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:54:58 2022] PUT /identity/v3/projects/3381c0688581489b903e641f91914839/users/beb2724f88054621a78b2aaa502f6538/roles/6c9336a73ed74d66a83c59fb3269efd5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:54:58.589089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef85f5-69ef-4066-96ea-b734988df28d None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:58.589685 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef85f5-69ef-4066-96ea-b734988df28d None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:58.590170 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef85f5-69ef-4066-96ea-b734988df28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:58.616323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-96ef85f5-69ef-4066-96ea-b734988df28d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:58.618115 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-96ef85f5-69ef-4066-96ea-b734988df28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:58.687467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:58.740423 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 416/827] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:58.740423 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef85f5-69ef-4066-96ea-b734988df28d None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:58.810317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929db9e0-9ffe-4c47-bf3f-d2038c55cfd4 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:58.866537 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:58.885285 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54909f-ab0e-4d2b-8c31-9413ca51357a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:58.886910 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54909f-ab0e-4d2b-8c31-9413ca51357a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:58.887418 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54909f-ab0e-4d2b-8c31-9413ca51357a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:58.887901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54909f-ab0e-4d2b-8c31-9413ca51357a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:58.903212 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54909f-ab0e-4d2b-8c31-9413ca51357a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:58.905425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54909f-ab0e-4d2b-8c31-9413ca51357a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:58.920625 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef85f5-69ef-4066-96ea-b734988df28d None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-7a54909f-ab0e-4d2b-8c31-9413ca51357a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:58.939050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:58.940419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:58.941366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:58.941366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:58.941366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:58.941366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 412/828] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:58.946903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54909f-ab0e-4d2b-8c31-9413ca51357a None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:58.972420 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a1133-648a-4122-bb9e-3c89a5b6415b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:58.973529 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1133-648a-4122-bb9e-3c89a5b6415b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:58.974004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1133-648a-4122-bb9e-3c89a5b6415b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:58.974468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1133-648a-4122-bb9e-3c89a5b6415b None admin] PATH_INFO: `/v3/services/network` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:58.975265 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a1133-648a-4122-bb9e-3c89a5b6415b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:58.977186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a1133-648a-4122-bb9e-3c89a5b6415b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-658a1133-648a-4122-bb9e-3c89a5b6415b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:58.988356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:58.989554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:58.990520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:58.990520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:58.990520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:58.990520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:58.990520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:58.990520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:58.990520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:58.990520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:58.990520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:58.990520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:58.990520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:54:58.990520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:54:58.990520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:54:58.990520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:58.993501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 417/829] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:58 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:58.996481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a1133-648a-4122-bb9e-3c89a5b6415b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:59.065809 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54909f-ab0e-4d2b-8c31-9413ca51357a None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:59.073653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:59.105755 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2d8e9-b685-4a0b-9634-ebaf3cacc506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:59.106408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2d8e9-b685-4a0b-9634-ebaf3cacc506 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:59.106690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2d8e9-b685-4a0b-9634-ebaf3cacc506 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:59.106960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2d8e9-b685-4a0b-9634-ebaf3cacc506 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:59.107562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2d8e9-b685-4a0b-9634-ebaf3cacc506 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:59.109034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2d8e9-b685-4a0b-9634-ebaf3cacc506 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-c7c2d8e9-b685-4a0b-9634-ebaf3cacc506 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:59.121025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:59.122820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:59.125572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:59.125572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:59.125572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:59.125572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:59.125572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:59.125572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:59.125572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:59.125572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:59.125572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:59.125572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:59.125572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:54:59.125572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:54:59.125572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:54:59.125572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:54:59.126564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a1133-648a-4122-bb9e-3c89a5b6415b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:59.127717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 413/830] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:54:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:59.128915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2d8e9-b685-4a0b-9634-ebaf3cacc506 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:59.166238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:59.173282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d1b4b-6471-475b-90b2-d72d1a953f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:59.173917 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d1b4b-6471-475b-90b2-d72d1a953f74 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:59.174735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d1b4b-6471-475b-90b2-d72d1a953f74 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:59.175191 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d1b4b-6471-475b-90b2-d72d1a953f74 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:59.175865 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d1b4b-6471-475b-90b2-d72d1a953f74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:59.176172 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d1b4b-6471-475b-90b2-d72d1a953f74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:59.177621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d1b4b-6471-475b-90b2-d72d1a953f74 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:59.191776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 418/831] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:59.201843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d1b4b-6471-475b-90b2-d72d1a953f74 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:59.254989 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2d8e9-b685-4a0b-9634-ebaf3cacc506 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:59.296239 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f200a14-5c27-4da7-b10c-989c318d1640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:59.297182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f200a14-5c27-4da7-b10c-989c318d1640 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:59.297764 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f200a14-5c27-4da7-b10c-989c318d1640 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:59.298524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f200a14-5c27-4da7-b10c-989c318d1640 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:59.299763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f200a14-5c27-4da7-b10c-989c318d1640 None admin] RBAC: Adding query filter params (name=network) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:59.300278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f200a14-5c27-4da7-b10c-989c318d1640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:59.302063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f200a14-5c27-4da7-b10c-989c318d1640 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:59.309468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 414/832] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Sep 7 12:54:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:59.310575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f200a14-5c27-4da7-b10c-989c318d1640 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:59.359100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:59.367630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d1b4b-6471-475b-90b2-d72d1a953f74 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:59.426532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b7ef5-11af-4523-9b30-89981a3b62d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:59.427198 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b7ef5-11af-4523-9b30-89981a3b62d4 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:59.427471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b7ef5-11af-4523-9b30-89981a3b62d4 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:59.427736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b7ef5-11af-4523-9b30-89981a3b62d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:59.440486 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b7ef5-11af-4523-9b30-89981a3b62d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-b27b7ef5-11af-4523-9b30-89981a3b62d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:59.445681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:59.452097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:59.453109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:59.453109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:59.453109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:59.453109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:59.453109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:59.453109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:59.453109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:59.453109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:59.453109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:59.453109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:59.453109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:59.453109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:59.453109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 419/833] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:59.453109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b7ef5-11af-4523-9b30-89981a3b62d4 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:59.461017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f200a14-5c27-4da7-b10c-989c318d1640 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:59.510810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50425ba3-c1d3-45b9-b6e3-87271811b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:59.512002 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50425ba3-c1d3-45b9-b6e3-87271811b86d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:59.512303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50425ba3-c1d3-45b9-b6e3-87271811b86d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:59.512617 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50425ba3-c1d3-45b9-b6e3-87271811b86d None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:59.513470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50425ba3-c1d3-45b9-b6e3-87271811b86d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:59.513780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50425ba3-c1d3-45b9-b6e3-87271811b86d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:59.515294 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50425ba3-c1d3-45b9-b6e3-87271811b86d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:59.521009 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:59.528860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 415/834] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:54:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:59.528860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50425ba3-c1d3-45b9-b6e3-87271811b86d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:59.598740 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b7ef5-11af-4523-9b30-89981a3b62d4 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:59.646848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820b299-cacd-449a-9c71-8668f91e0d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:59.647966 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820b299-cacd-449a-9c71-8668f91e0d00 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:59.648477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820b299-cacd-449a-9c71-8668f91e0d00 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:59.648948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820b299-cacd-449a-9c71-8668f91e0d00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:59.658661 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820b299-cacd-449a-9c71-8668f91e0d00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:59.660212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820b299-cacd-449a-9c71-8668f91e0d00 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:59.673136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-9820b299-cacd-449a-9c71-8668f91e0d00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:59.673136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:59.673136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:59.673136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:59.673136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:59.673136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:59.673136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:59.673136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:59.673136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:59.673136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:59.673136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:59.673136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:59.673136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:59.673136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:59.673136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:59.674214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:59.675140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:59.675140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:59.675140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:59.675140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:59.675140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:59.675140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:59.675140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:59.675140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:54:59.675140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 420/835] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:59.675684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820b299-cacd-449a-9c71-8668f91e0d00 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:59.690659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:59.695887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50425ba3-c1d3-45b9-b6e3-87271811b86d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:59.740807 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed0481-2c0b-428f-b406-e56c96d2a188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:59.741437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed0481-2c0b-428f-b406-e56c96d2a188 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:59.741713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed0481-2c0b-428f-b406-e56c96d2a188 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:59.742057 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed0481-2c0b-428f-b406-e56c96d2a188 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:59.742708 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed0481-2c0b-428f-b406-e56c96d2a188 None admin] RBAC: Adding query filter params (type=network) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:59.743032 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed0481-2c0b-428f-b406-e56c96d2a188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:59.745217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed0481-2c0b-428f-b406-e56c96d2a188 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:59.758485 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 416/836] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Sep 7 12:54:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:59.759882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed0481-2c0b-428f-b406-e56c96d2a188 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:59.826637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820b299-cacd-449a-9c71-8668f91e0d00 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:59.843298 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:59.882698 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e43401-e743-4c8d-96cf-248688eb2893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:59.883370 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e43401-e743-4c8d-96cf-248688eb2893 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:59.883649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e43401-e743-4c8d-96cf-248688eb2893 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:59.883922 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e43401-e743-4c8d-96cf-248688eb2893 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:59.884630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e43401-e743-4c8d-96cf-248688eb2893 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:59.884936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e43401-e743-4c8d-96cf-248688eb2893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:59.888458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e43401-e743-4c8d-96cf-248688eb2893 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:59.906410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 421/837] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:59.907776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e43401-e743-4c8d-96cf-248688eb2893 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:59.916353 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed0481-2c0b-428f-b406-e56c96d2a188 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:59.975301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0152c17-5792-49d2-a997-4c2bb60e313b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:59.975939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0152c17-5792-49d2-a997-4c2bb60e313b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:59.976245 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0152c17-5792-49d2-a997-4c2bb60e313b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:59.976518 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0152c17-5792-49d2-a997-4c2bb60e313b None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:59.977169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0152c17-5792-49d2-a997-4c2bb60e313b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:59.977469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0152c17-5792-49d2-a997-4c2bb60e313b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:59.978974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0152c17-5792-49d2-a997-4c2bb60e313b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:59.992424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 417/838] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:54:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:59.992424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0152c17-5792-49d2-a997-4c2bb60e313b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:00.032408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:00.106275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e43401-e743-4c8d-96cf-248688eb2893 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:00.180247 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0152c17-5792-49d2-a997-4c2bb60e313b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:00.221517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69e0ae-3985-44f3-8a8a-36c2249a394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:00.222320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69e0ae-3985-44f3-8a8a-36c2249a394a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:00.222576 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69e0ae-3985-44f3-8a8a-36c2249a394a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:00.222842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69e0ae-3985-44f3-8a8a-36c2249a394a None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:00.223560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69e0ae-3985-44f3-8a8a-36c2249a394a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:00.223863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69e0ae-3985-44f3-8a8a-36c2249a394a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:00.226074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69e0ae-3985-44f3-8a8a-36c2249a394a None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:00.236131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac81880-ac31-4816-85ee-efb33275d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:00.236971 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac81880-ac31-4816-85ee-efb33275d152 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:00.237446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac81880-ac31-4816-85ee-efb33275d152 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:00.238990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac81880-ac31-4816-85ee-efb33275d152 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:00.239812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac81880-ac31-4816-85ee-efb33275d152 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:00.242167 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac81880-ac31-4816-85ee-efb33275d152 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:00.250739 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 422/839] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:00.251704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69e0ae-3985-44f3-8a8a-36c2249a394a None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:00.300710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 418/840] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 12:54:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:55:00.304395 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac81880-ac31-4816-85ee-efb33275d152 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:00.383811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:00.546009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:00.571661 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69e0ae-3985-44f3-8a8a-36c2249a394a None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:00.585630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac81880-ac31-4816-85ee-efb33275d152 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:00.635315 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d634129-f723-4bcf-a21d-043ccfae3d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:00.636616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d634129-f723-4bcf-a21d-043ccfae3d66 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:00.637196 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d634129-f723-4bcf-a21d-043ccfae3d66 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:00.638287 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef973c-bad6-4b48-8ee3-a106f03c3fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:00.638549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef973c-bad6-4b48-8ee3-a106f03c3fd5 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:00.638830 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef973c-bad6-4b48-8ee3-a106f03c3fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:00.639056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d634129-f723-4bcf-a21d-043ccfae3d66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:00.639155 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef973c-bad6-4b48-8ee3-a106f03c3fd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:00.640303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d634129-f723-4bcf-a21d-043ccfae3d66 None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=3381c0688581489b903e641f91914839, user.id=fbe8fa8ab8094aa69933398280810692) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:00.640920 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d634129-f723-4bcf-a21d-043ccfae3d66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:00.643805 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d634129-f723-4bcf-a21d-043ccfae3d66 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:00.651273 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 419/841] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:55:00 2022] GET /identity/v3/role_assignments?user.id=fbe8fa8ab8094aa69933398280810692&scope.project.id=3381c0688581489b903e641f91914839&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 608 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:00.677794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef973c-bad6-4b48-8ee3-a106f03c3fd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:00.679291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef973c-bad6-4b48-8ee3-a106f03c3fd5 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-04ef973c-bad6-4b48-8ee3-a106f03c3fd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:00.718996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:00.720023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:00.721078 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:00.721078 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:00.721078 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:00.721078 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 423/842] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 469 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:00.727852 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d634129-f723-4bcf-a21d-043ccfae3d66 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:00.871373 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d634129-f723-4bcf-a21d-043ccfae3d66 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:00.913722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8caa3-59ee-4e58-99cb-af52758a911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:00.914700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8caa3-59ee-4e58-99cb-af52758a911a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:00.915210 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8caa3-59ee-4e58-99cb-af52758a911a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:00.915706 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8caa3-59ee-4e58-99cb-af52758a911a None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:00.916603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8caa3-59ee-4e58-99cb-af52758a911a None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:00.917104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8caa3-59ee-4e58-99cb-af52758a911a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:00.918755 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8caa3-59ee-4e58-99cb-af52758a911a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:00.935682 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 420/843] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:00.943755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef973c-bad6-4b48-8ee3-a106f03c3fd5 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:01.077632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef973c-bad6-4b48-8ee3-a106f03c3fd5 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:01.081004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:01.116813 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d6532-b5b7-4c2c-a63e-be848311692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:01.117385 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d6532-b5b7-4c2c-a63e-be848311692a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:01.117662 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d6532-b5b7-4c2c-a63e-be848311692a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:01.117930 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d6532-b5b7-4c2c-a63e-be848311692a None admin] PATH_INFO: `/v3/users/swift` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:01.126179 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d6532-b5b7-4c2c-a63e-be848311692a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:01.127838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d6532-b5b7-4c2c-a63e-be848311692a None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:01.141866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc3f66-94cb-42cc-a7af-6a30575e0182 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:01.142197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc3f66-94cb-42cc-a7af-6a30575e0182 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:01.144301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc3f66-94cb-42cc-a7af-6a30575e0182 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-8b1d6532-b5b7-4c2c-a63e-be848311692a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:55:01.144441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:01.145785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:01.146959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:01.146959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:01.146959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:55:01.146959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:55:01.146959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:55:01.146959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:55:01.146959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:55:01.146959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:55:01.146959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:55:01.146959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:01.147636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 421/844] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:55:01.147859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 424/845] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:55:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:01.149893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc3f66-94cb-42cc-a7af-6a30575e0182 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:01.153429 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:01.155359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ad565-0108-4552-b072-760d85bf0a23 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:01.155789 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ad565-0108-4552-b072-760d85bf0a23 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:01.156073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ad565-0108-4552-b072-760d85bf0a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:01.175929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-4e2ad565-0108-4552-b072-760d85bf0a23 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:01.177282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4e2ad565-0108-4552-b072-760d85bf0a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:01.272435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 425/846] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:01.289414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc3f66-94cb-42cc-a7af-6a30575e0182 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:01.335346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4148f-d1df-4194-884d-e1003dbc3868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:01.336406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4148f-d1df-4194-884d-e1003dbc3868 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:01.336834 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4148f-d1df-4194-884d-e1003dbc3868 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:01.337266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4148f-d1df-4194-884d-e1003dbc3868 None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:01.339064 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4148f-d1df-4194-884d-e1003dbc3868 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:01.339846 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4148f-d1df-4194-884d-e1003dbc3868 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:01.342257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4148f-d1df-4194-884d-e1003dbc3868 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:01.368595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 422/847] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Sep 7 12:55:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:01.378637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ad565-0108-4552-b072-760d85bf0a23 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:01.488787 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:01.514708 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ad565-0108-4552-b072-760d85bf0a23 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:01.552986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65064f15-f9f5-4e9d-b84e-6b51c9cc578b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:01.553623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65064f15-f9f5-4e9d-b84e-6b51c9cc578b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:01.553945 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65064f15-f9f5-4e9d-b84e-6b51c9cc578b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:01.554217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65064f15-f9f5-4e9d-b84e-6b51c9cc578b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:01.610702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4148f-d1df-4194-884d-e1003dbc3868 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:01.648261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65064f15-f9f5-4e9d-b84e-6b51c9cc578b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:01.649703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65064f15-f9f5-4e9d-b84e-6b51c9cc578b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:01.684992 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:01.740071 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4148f-d1df-4194-884d-e1003dbc3868 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:01.761076 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:01.795158 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 426/848] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:55:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:55:01.801153 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65064f15-f9f5-4e9d-b84e-6b51c9cc578b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:01.802531 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd4f26-da8a-4bb8-b78e-3e9191792e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:01.803185 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd4f26-da8a-4bb8-b78e-3e9191792e67 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:01.803456 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd4f26-da8a-4bb8-b78e-3e9191792e67 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:01.803720 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd4f26-da8a-4bb8-b78e-3e9191792e67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:01.817247 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd4f26-da8a-4bb8-b78e-3e9191792e67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-29dd4f26-da8a-4bb8-b78e-3e9191792e67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:55:01.822298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:01.823558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:01.824439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:01.824439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:01.824439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:01.824439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:01.824439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:55:01.824439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:55:01.824439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:55:01.824439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:55:01.824439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:55:01.824439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:55:01.824439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:55:01.824439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:01.824439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 423/849] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:55:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:01.829663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd4f26-da8a-4bb8-b78e-3e9191792e67 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:01.925117 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65064f15-f9f5-4e9d-b84e-6b51c9cc578b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:01.949259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd4f26-da8a-4bb8-b78e-3e9191792e67 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:01.963347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e9e8e-ddde-4b5a-a1c7-f33ce066f684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:01.964051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e9e8e-ddde-4b5a-a1c7-f33ce066f684 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:01.964327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e9e8e-ddde-4b5a-a1c7-f33ce066f684 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:01.964633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e9e8e-ddde-4b5a-a1c7-f33ce066f684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:01.973555 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:01.978147 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e9e8e-ddde-4b5a-a1c7-f33ce066f684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:01.980481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e9e8e-ddde-4b5a-a1c7-f33ce066f684 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:01.990426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda6af6-6d6f-4052-8800-704c5f5180b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:01.991193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda6af6-6d6f-4052-8800-704c5f5180b1 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:01.991569 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda6af6-6d6f-4052-8800-704c5f5180b1 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:01.992016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda6af6-6d6f-4052-8800-704c5f5180b1 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:01.992858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda6af6-6d6f-4052-8800-704c5f5180b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:01.993336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda6af6-6d6f-4052-8800-704c5f5180b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:01.994925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda6af6-6d6f-4052-8800-704c5f5180b1 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-ed9e9e8e-ddde-4b5a-a1c7-f33ce066f684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:02.000594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:02.001731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:02.002889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:02.002889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:02.002889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:02.009364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 427/851] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:02.010533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e9e8e-ddde-4b5a-a1c7-f33ce066f684 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:02.011743 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 424/851] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:55:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:02.013149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda6af6-6d6f-4052-8800-704c5f5180b1 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:02.048294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:02.132820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda6af6-6d6f-4052-8800-704c5f5180b1 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:02.136679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e9e8e-ddde-4b5a-a1c7-f33ce066f684 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:02.177364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c09dac-66d7-4b9b-b9f1-d71c468f6880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:02.178103 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c09dac-66d7-4b9b-b9f1-d71c468f6880 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:02.178506 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c09dac-66d7-4b9b-b9f1-d71c468f6880 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:02.178898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c09dac-66d7-4b9b-b9f1-d71c468f6880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:02.182772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd48f4-6bbb-4711-93c2-deebc6987653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:02.183624 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd48f4-6bbb-4711-93c2-deebc6987653 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:02.184041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd48f4-6bbb-4711-93c2-deebc6987653 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:02.184474 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd48f4-6bbb-4711-93c2-deebc6987653 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:02.185389 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd48f4-6bbb-4711-93c2-deebc6987653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:02.185933 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd48f4-6bbb-4711-93c2-deebc6987653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:02.187573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd48f4-6bbb-4711-93c2-deebc6987653 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:02.193145 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c09dac-66d7-4b9b-b9f1-d71c468f6880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:02.194857 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c09dac-66d7-4b9b-b9f1-d71c468f6880 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:02.208320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 428/852] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:02.209593 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd48f4-6bbb-4711-93c2-deebc6987653 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-b4c09dac-66d7-4b9b-b9f1-d71c468f6880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:02.212257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:02.213409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:02.214701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:02.214701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:02.214701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:02.220490 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 425/853] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:02.222518 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c09dac-66d7-4b9b-b9f1-d71c468f6880 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:02.263617 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:02.320503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:02.336239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd48f4-6bbb-4711-93c2-deebc6987653 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:02.347130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c09dac-66d7-4b9b-b9f1-d71c468f6880 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:02.377007 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2c833-014e-4424-ab92-93ddbb17ad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:02.378409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2c833-014e-4424-ab92-93ddbb17ad58 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:02.378832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2c833-014e-4424-ab92-93ddbb17ad58 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:02.379520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2c833-014e-4424-ab92-93ddbb17ad58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:02.388216 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49f86f-d9d3-479a-87a3-1afafc315281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:02.388517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2c833-014e-4424-ab92-93ddbb17ad58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:02.389285 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49f86f-d9d3-479a-87a3-1afafc315281 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:02.389708 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49f86f-d9d3-479a-87a3-1afafc315281 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:02.390131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49f86f-d9d3-479a-87a3-1afafc315281 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:02.390463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2c833-014e-4424-ab92-93ddbb17ad58 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:02.391082 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49f86f-d9d3-479a-87a3-1afafc315281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:02.391713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49f86f-d9d3-479a-87a3-1afafc315281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:02.393925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49f86f-d9d3-479a-87a3-1afafc315281 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:02.404411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-b7c2c833-014e-4424-ab92-93ddbb17ad58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:02.404411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:02.404411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:02.404411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:02.404411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:02.404411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:02.404411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:02.404411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:02.404411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:02.404411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:02.404411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:02.404411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:02.404411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:55:02.404411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:55:02.404411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:02.405431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:02.406335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:55:02.406335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:55:02.406335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:55:02.406335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:55:02.406335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:55:02.406335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:55:02.406335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:02.406335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:02.411329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 429/854] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:55:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:02.412559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2c833-014e-4424-ab92-93ddbb17ad58 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:02.418094 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 426/855] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:02.421176 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49f86f-d9d3-479a-87a3-1afafc315281 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:02.538067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:02.540831 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2c833-014e-4424-ab92-93ddbb17ad58 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:02.546745 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49f86f-d9d3-479a-87a3-1afafc315281 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:02.588010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4cf09-4bf6-419f-8977-89488419f5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:02.589065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4cf09-4bf6-419f-8977-89488419f5f2 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:02.589515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4cf09-4bf6-419f-8977-89488419f5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:02.589976 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4cf09-4bf6-419f-8977-89488419f5f2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:02.591826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f484f3-1846-4394-a3d9-fe0f6794c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:02.593003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f484f3-1846-4394-a3d9-fe0f6794c7d5 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:02.594050 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f484f3-1846-4394-a3d9-fe0f6794c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:02.594050 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f484f3-1846-4394-a3d9-fe0f6794c7d5 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:02.595668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f484f3-1846-4394-a3d9-fe0f6794c7d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:02.596245 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f484f3-1846-4394-a3d9-fe0f6794c7d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:02.598981 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f484f3-1846-4394-a3d9-fe0f6794c7d5 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:02.600238 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4cf09-4bf6-419f-8977-89488419f5f2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:02.602177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4cf09-4bf6-419f-8977-89488419f5f2 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-89f4cf09-4bf6-419f-8977-89488419f5f2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:55:02.616259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:02.617453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:02.623686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:02.623686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:02.623686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:55:02.623686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:55:02.623686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:55:02.623686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:55:02.623686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:55:02.623686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:55:02.623686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:55:02.623686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:02.623686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 427/856] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Sep 7 12:55:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:02.623686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e00007-8ea8-4bf4-acf7-bb4311f626f0 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:02.623686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e00007-8ea8-4bf4-acf7-bb4311f626f0 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:02.624769 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e00007-8ea8-4bf4-acf7-bb4311f626f0 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:02.624841 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 430/857] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:55:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:02.624913 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 428/858] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:02.629636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f484f3-1846-4394-a3d9-fe0f6794c7d5 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:02.633375 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e00007-8ea8-4bf4-acf7-bb4311f626f0 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:02.643328 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:02.745755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f484f3-1846-4394-a3d9-fe0f6794c7d5 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:02.751768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e00007-8ea8-4bf4-acf7-bb4311f626f0 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:02.786941 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8fd7c-e5f3-4187-a392-5f478729e866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:02.787557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8fd7c-e5f3-4187-a392-5f478729e866 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:02.787893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8fd7c-e5f3-4187-a392-5f478729e866 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:02.788161 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8fd7c-e5f3-4187-a392-5f478729e866 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:02.788942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8fd7c-e5f3-4187-a392-5f478729e866 None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=3381c0688581489b903e641f91914839, user.id=f3796ca94b914fd18946551fa2bff331) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:02.789271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8fd7c-e5f3-4187-a392-5f478729e866 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:02.790364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def47f3-19a5-468b-a066-d288751aff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:02.790737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8fd7c-e5f3-4187-a392-5f478729e866 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:02.790979 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def47f3-19a5-468b-a066-d288751aff4d None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:02.791255 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def47f3-19a5-468b-a066-d288751aff4d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:02.791521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def47f3-19a5-468b-a066-d288751aff4d None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:02.792346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def47f3-19a5-468b-a066-d288751aff4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:02.792887 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def47f3-19a5-468b-a066-d288751aff4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:02.794465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def47f3-19a5-468b-a066-d288751aff4d None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:02.808856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 429/859] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:55:02 2022] GET /identity/v3/role_assignments?user.id=f3796ca94b914fd18946551fa2bff331&scope.project.id=3381c0688581489b903e641f91914839&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:02.808856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb526a1-f207-4be8-ad53-0d4a29d733e2 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:02.808856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb526a1-f207-4be8-ad53-0d4a29d733e2 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:02.808856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb526a1-f207-4be8-ad53-0d4a29d733e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:02.816465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 431/860] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Sep 7 12:55:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:02.822908 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def47f3-19a5-468b-a066-d288751aff4d None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:02.830094 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-ccb526a1-f207-4be8-ad53-0d4a29d733e2 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:02.831635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ccb526a1-f207-4be8-ad53-0d4a29d733e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:02.861810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:02.909453 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:02.957633 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 430/861] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:02.975321 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def47f3-19a5-468b-a066-d288751aff4d None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:03.022512 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59a378-0f3d-4563-a512-c7cbb50bbd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:03.023505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59a378-0f3d-4563-a512-c7cbb50bbd57 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:03.023932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59a378-0f3d-4563-a512-c7cbb50bbd57 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:03.024347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59a378-0f3d-4563-a512-c7cbb50bbd57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:03.112448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59a378-0f3d-4563-a512-c7cbb50bbd57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:03.114272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59a378-0f3d-4563-a512-c7cbb50bbd57 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:03.232328 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:03.253848 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb526a1-f207-4be8-ad53-0d4a29d733e2 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:03.286350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 432/862] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:55:02 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:55:03.297704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59a378-0f3d-4563-a512-c7cbb50bbd57 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:03.396427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb526a1-f207-4be8-ad53-0d4a29d733e2 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:03.434398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59a378-0f3d-4563-a512-c7cbb50bbd57 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:03.450393 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82eae3-6701-44cb-a127-0f762e630eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:03.451252 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82eae3-6701-44cb-a127-0f762e630eb5 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:03.451539 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82eae3-6701-44cb-a127-0f762e630eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:03.451811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82eae3-6701-44cb-a127-0f762e630eb5 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:03.452520 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82eae3-6701-44cb-a127-0f762e630eb5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:03.454705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82eae3-6701-44cb-a127-0f762e630eb5 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:03.480437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 431/863] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Sep 7 12:55:03 2022] POST /identity/v3/services => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:55:03.491091 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de181a26-8cdf-4edd-835b-8385d227af2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:03.491753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de181a26-8cdf-4edd-835b-8385d227af2f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:03.492024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de181a26-8cdf-4edd-835b-8385d227af2f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:03.492286 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de181a26-8cdf-4edd-835b-8385d227af2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:03.506049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de181a26-8cdf-4edd-835b-8385d227af2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:03.507608 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de181a26-8cdf-4edd-835b-8385d227af2f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-de181a26-8cdf-4edd-835b-8385d227af2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:03.525896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:03.526929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:03.527854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:03.527854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:03.527854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:03.531837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 433/864] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:03.533316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82eae3-6701-44cb-a127-0f762e630eb5 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:03.535999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3f6ba-9ac2-43fc-94ac-c1979878318f None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:03.536275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3f6ba-9ac2-43fc-94ac-c1979878318f None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:03.536607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3f6ba-9ac2-43fc-94ac-c1979878318f None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:03.538654 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 434/865] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:03.550019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1ef4d-fc91-44bc-b2c6-986faf2409d7 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:03.550392 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1ef4d-fc91-44bc-b2c6-986faf2409d7 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:03.550618 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1ef4d-fc91-44bc-b2c6-986faf2409d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:03.552668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:03.572854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-a0f1ef4d-fc91-44bc-b2c6-986faf2409d7 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:03.574409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a0f1ef4d-fc91-44bc-b2c6-986faf2409d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:03.587197 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:03.668487 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 435/866] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:03 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:03.668698 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82eae3-6701-44cb-a127-0f762e630eb5 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:03.714938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500c077-4424-405a-a8dd-75b9f37b757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:03.715571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500c077-4424-405a-a8dd-75b9f37b757c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:03.715846 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500c077-4424-405a-a8dd-75b9f37b757c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:03.716172 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500c077-4424-405a-a8dd-75b9f37b757c None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:03.716865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500c077-4424-405a-a8dd-75b9f37b757c None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:03.717173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500c077-4424-405a-a8dd-75b9f37b757c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:03.718588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500c077-4424-405a-a8dd-75b9f37b757c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:03.735392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 432/867] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:03.740401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1ef4d-fc91-44bc-b2c6-986faf2409d7 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:03.901769 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1ef4d-fc91-44bc-b2c6-986faf2409d7 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:03.943778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb48578-65f6-415c-9978-8aab91d8b5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:03.944358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb48578-65f6-415c-9978-8aab91d8b5ec None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:03.944681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb48578-65f6-415c-9978-8aab91d8b5ec None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:03.944990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb48578-65f6-415c-9978-8aab91d8b5ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:03.953367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb48578-65f6-415c-9978-8aab91d8b5ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:03.954888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb48578-65f6-415c-9978-8aab91d8b5ec None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:03.965113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500c077-4424-405a-a8dd-75b9f37b757c None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:03.968536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-bbb48578-65f6-415c-9978-8aab91d8b5ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:03.968536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:03.968536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:03.968536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:03.968536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:03.968536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:03.968536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:03.968536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:03.968536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:03.968536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:03.968536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:03.968536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:03.968536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:55:03.968536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:55:03.968536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:03.969450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:03.970368 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:55:03.970368 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:55:03.970368 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:55:03.970368 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:55:03.970368 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:55:03.970368 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:55:03.970368 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:03.970368 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:03.974913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 436/868] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:55:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:03.976268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb48578-65f6-415c-9978-8aab91d8b5ec None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:03.981199 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:04.045821 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:04.085016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500c077-4424-405a-a8dd-75b9f37b757c None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:04.119192 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb48578-65f6-415c-9978-8aab91d8b5ec None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:04.124651 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f9ec9-93c2-4665-8a35-12594f5bf691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:04.125652 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f9ec9-93c2-4665-8a35-12594f5bf691 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:04.126133 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f9ec9-93c2-4665-8a35-12594f5bf691 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:04.126601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f9ec9-93c2-4665-8a35-12594f5bf691 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:04.127447 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f9ec9-93c2-4665-8a35-12594f5bf691 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:04.129109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f9ec9-93c2-4665-8a35-12594f5bf691 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-fd3f9ec9-93c2-4665-8a35-12594f5bf691 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:04.138855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:04.139849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:04.140882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:04.140882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:04.140882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:04.140882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:04.140882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:04.140882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:04.140882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:04.140882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:04.140882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:04.140882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:04.140882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:04.140882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:04.140882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:55:04.140882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:04.148670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 433/869] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Sep 7 12:55:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:04.149993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f9ec9-93c2-4665-8a35-12594f5bf691 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:04.157920 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12e827-b5fb-4642-98ff-43533ca3e0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:04.158573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12e827-b5fb-4642-98ff-43533ca3e0d5 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:04.158846 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12e827-b5fb-4642-98ff-43533ca3e0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:04.159109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12e827-b5fb-4642-98ff-43533ca3e0d5 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:04.159963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12e827-b5fb-4642-98ff-43533ca3e0d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:04.160265 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12e827-b5fb-4642-98ff-43533ca3e0d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:04.161928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12e827-b5fb-4642-98ff-43533ca3e0d5 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:04.183483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 437/870] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:55:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:04.185106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12e827-b5fb-4642-98ff-43533ca3e0d5 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:04.258921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:04.269156 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f9ec9-93c2-4665-8a35-12594f5bf691 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:04.302534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:04.308481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08e8fd-5ee9-457a-a9ab-60dfca1ed49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:04.309252 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08e8fd-5ee9-457a-a9ab-60dfca1ed49e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:04.309630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08e8fd-5ee9-457a-a9ab-60dfca1ed49e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:04.309858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12e827-b5fb-4642-98ff-43533ca3e0d5 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:04.310081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08e8fd-5ee9-457a-a9ab-60dfca1ed49e None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:04.310830 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08e8fd-5ee9-457a-a9ab-60dfca1ed49e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:04.311231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08e8fd-5ee9-457a-a9ab-60dfca1ed49e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:04.312828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08e8fd-5ee9-457a-a9ab-60dfca1ed49e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:04.323601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 434/871] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Sep 7 12:55:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:04.325127 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08e8fd-5ee9-457a-a9ab-60dfca1ed49e None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:04.354424 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bacc7-ee86-451d-ae55-f1a031edd268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:04.355578 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bacc7-ee86-451d-ae55-f1a031edd268 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:04.356032 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bacc7-ee86-451d-ae55-f1a031edd268 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:04.356485 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bacc7-ee86-451d-ae55-f1a031edd268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:04.358121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bacc7-ee86-451d-ae55-f1a031edd268 None admin] RBAC: Adding query filter params (role.id=6c9336a73ed74d66a83c59fb3269efd5, scope.project.id=3381c0688581489b903e641f91914839, user.id=beb2724f88054621a78b2aaa502f6538) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:04.358590 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bacc7-ee86-451d-ae55-f1a031edd268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:04.360798 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bacc7-ee86-451d-ae55-f1a031edd268 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:04.377073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 438/872] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:55:04 2022] GET /identity/v3/role_assignments?user.id=beb2724f88054621a78b2aaa502f6538&scope.project.id=3381c0688581489b903e641f91914839&role.id=6c9336a73ed74d66a83c59fb3269efd5 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:04.459073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08e8fd-5ee9-457a-a9ab-60dfca1ed49e None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:04.503550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d7dd7-8e79-47b3-8ca6-f3f478283f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:04.504263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7dd7-8e79-47b3-8ca6-f3f478283f5c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:04.504573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7dd7-8e79-47b3-8ca6-f3f478283f5c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:04.504926 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7dd7-8e79-47b3-8ca6-f3f478283f5c None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:04.505754 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d7dd7-8e79-47b3-8ca6-f3f478283f5c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:04.506056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d7dd7-8e79-47b3-8ca6-f3f478283f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:04.507570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d7dd7-8e79-47b3-8ca6-f3f478283f5c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:04.513741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 435/873] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Sep 7 12:55:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:05.419389 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a838fba-1d16-457b-8bc7-8afcb6a2ea9d None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:05.420033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a838fba-1d16-457b-8bc7-8afcb6a2ea9d None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:05.420341 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a838fba-1d16-457b-8bc7-8afcb6a2ea9d None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:05.422402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 439/874] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:05.428982 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72961e48-e37a-4a89-8f40-9af9ff0eb238 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:05.429347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72961e48-e37a-4a89-8f40-9af9ff0eb238 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:05.429723 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72961e48-e37a-4a89-8f40-9af9ff0eb238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:05.453963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-72961e48-e37a-4a89-8f40-9af9ff0eb238 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:05.455224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-72961e48-e37a-4a89-8f40-9af9ff0eb238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:05.540658 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:05.558562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 436/875] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:05 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:55:05.866889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a838fba-1d16-457b-8bc7-8afcb6a2ea9d None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:05.901557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a48853-3285-4d06-b58f-4eda6ba0b9ef None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:05.901956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a48853-3285-4d06-b58f-4eda6ba0b9ef None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:05.902101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a48853-3285-4d06-b58f-4eda6ba0b9ef None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:05.903612 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 437/876] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:55:05.909199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3506658-50a8-489d-9212-21db4fbac323 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:05.909485 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3506658-50a8-489d-9212-21db4fbac323 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:05.909763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3506658-50a8-489d-9212-21db4fbac323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:05.938152 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-e3506658-50a8-489d-9212-21db4fbac323 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:05.940094 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e3506658-50a8-489d-9212-21db4fbac323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:06.021803 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a838fba-1d16-457b-8bc7-8afcb6a2ea9d None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:06.038880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 438/877] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:05 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:06.054088 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:06.064858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec417d-348b-43cc-b1f2-8383ac3da04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:06.065648 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec417d-348b-43cc-b1f2-8383ac3da04f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:06.065930 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec417d-348b-43cc-b1f2-8383ac3da04f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:06.066209 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec417d-348b-43cc-b1f2-8383ac3da04f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:06.066806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec417d-348b-43cc-b1f2-8383ac3da04f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:06.068245 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec417d-348b-43cc-b1f2-8383ac3da04f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-52ec417d-348b-43cc-b1f2-8383ac3da04f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:06.078713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:06.079755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:06.080688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:06.080688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:06.080688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:06.080688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:06.080688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:06.080688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:06.080688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:06.080688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:06.080688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:06.080688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:06.080688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:06.080688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:06.080688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:55:06.080688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:06.080688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 440/878] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Sep 7 12:55:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:06.088709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3506658-50a8-489d-9212-21db4fbac323 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:06.202975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3506658-50a8-489d-9212-21db4fbac323 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:06.228257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:06.246237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a2a67-7996-4c16-acf4-7ec3520af9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:06.246867 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a2a67-7996-4c16-acf4-7ec3520af9fe None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:06.247146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a2a67-7996-4c16-acf4-7ec3520af9fe None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:06.247420 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a2a67-7996-4c16-acf4-7ec3520af9fe None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:06.248064 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a2a67-7996-4c16-acf4-7ec3520af9fe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:06.248367 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a2a67-7996-4c16-acf4-7ec3520af9fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:06.250152 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a2a67-7996-4c16-acf4-7ec3520af9fe None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:06.256084 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 439/879] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Sep 7 12:55:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:06.262937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec417d-348b-43cc-b1f2-8383ac3da04f None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:06.307636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a2a67-7996-4c16-acf4-7ec3520af9fe None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:06.409071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec417d-348b-43cc-b1f2-8383ac3da04f None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:06.438465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a2a67-7996-4c16-acf4-7ec3520af9fe None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:06.457502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062f029-b416-433e-8932-a10a38ef7480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:06.458284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062f029-b416-433e-8932-a10a38ef7480 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:06.458284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062f029-b416-433e-8932-a10a38ef7480 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:06.458561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062f029-b416-433e-8932-a10a38ef7480 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:06.459182 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062f029-b416-433e-8932-a10a38ef7480 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:06.459467 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062f029-b416-433e-8932-a10a38ef7480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:06.461477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062f029-b416-433e-8932-a10a38ef7480 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:06.473872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 441/880] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Sep 7 12:55:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:06.488180 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb49ff-847e-4549-b6f2-dec7dace9c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:06.488883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb49ff-847e-4549-b6f2-dec7dace9c25 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:06.489164 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb49ff-847e-4549-b6f2-dec7dace9c25 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:06.489428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb49ff-847e-4549-b6f2-dec7dace9c25 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:06.490039 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb49ff-847e-4549-b6f2-dec7dace9c25 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:06.491486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb49ff-847e-4549-b6f2-dec7dace9c25 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-61cb49ff-847e-4549-b6f2-dec7dace9c25 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:06.501990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:06.503200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:06.504051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:06.504051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:06.504051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:06.504051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:06.504051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:06.504051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:06.504051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:06.504051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:06.504051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:06.504051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:06.504051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:06.504051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:06.504051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:55:06.504051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:06.504051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 440/881] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:55:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:06.509656 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062f029-b416-433e-8932-a10a38ef7480 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:06.577556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:06.629066 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062f029-b416-433e-8932-a10a38ef7480 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:06.667500 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaa404-9f02-461a-94a0-e5335c75dce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:06.668140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaa404-9f02-461a-94a0-e5335c75dce7 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:06.668582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaa404-9f02-461a-94a0-e5335c75dce7 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:06.668857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaa404-9f02-461a-94a0-e5335c75dce7 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:06.669511 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaa404-9f02-461a-94a0-e5335c75dce7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:06.669811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaa404-9f02-461a-94a0-e5335c75dce7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:06.671217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaa404-9f02-461a-94a0-e5335c75dce7 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:06.678163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 442/882] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:55:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:06.684595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb49ff-847e-4549-b6f2-dec7dace9c25 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:06.738868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:06.796696 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb49ff-847e-4549-b6f2-dec7dace9c25 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:06.833985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57bf41-f4e1-4ef7-b9fb-fc2e9fd7e725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:06.834634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57bf41-f4e1-4ef7-b9fb-fc2e9fd7e725 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:06.834918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57bf41-f4e1-4ef7-b9fb-fc2e9fd7e725 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:06.835194 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57bf41-f4e1-4ef7-b9fb-fc2e9fd7e725 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:06.835868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57bf41-f4e1-4ef7-b9fb-fc2e9fd7e725 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:06.836174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57bf41-f4e1-4ef7-b9fb-fc2e9fd7e725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:06.837695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57bf41-f4e1-4ef7-b9fb-fc2e9fd7e725 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:06.844009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 441/883] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:55:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:06.850209 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaa404-9f02-461a-94a0-e5335c75dce7 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:06.966142 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c044b-c3ac-4c6b-9231-86ccd70445a4 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:06.966557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c044b-c3ac-4c6b-9231-86ccd70445a4 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:06.966845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c044b-c3ac-4c6b-9231-86ccd70445a4 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:06.969329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 442/884] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:06.973415 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaa404-9f02-461a-94a0-e5335c75dce7 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:06.978239 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c5e89-87a1-4c31-97f8-828ba5adc722 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:06.978671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c5e89-87a1-4c31-97f8-828ba5adc722 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:06.979052 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c5e89-87a1-4c31-97f8-828ba5adc722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:06.998352 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:07.005076 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-ac1c5e89-87a1-4c31-97f8-828ba5adc722 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:07.007195 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ac1c5e89-87a1-4c31-97f8-828ba5adc722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:07.014818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf30427-c666-46bf-aa40-9826bb057d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:07.015464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf30427-c666-46bf-aa40-9826bb057d52 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:07.015808 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf30427-c666-46bf-aa40-9826bb057d52 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:07.016077 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf30427-c666-46bf-aa40-9826bb057d52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:07.016854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf30427-c666-46bf-aa40-9826bb057d52 None admin] RBAC: Adding query filter params (interface=public, service_id=535a394ca3e4498780dcf5307f511377, region_id=RegionOne) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:07.017161 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf30427-c666-46bf-aa40-9826bb057d52 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:07.018872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf30427-c666-46bf-aa40-9826bb057d52 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:07.025687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 443/885] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Sep 7 12:55:06 2022] GET /identity/v3/endpoints?service_id=535a394ca3e4498780dcf5307f511377&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:07.030832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf30427-c666-46bf-aa40-9826bb057d52 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:07.094408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 443/886] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:07.095864 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22589a19-3270-4398-a4f4-2122f833ff2e None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:07.096184 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22589a19-3270-4398-a4f4-2122f833ff2e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:07.096568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22589a19-3270-4398-a4f4-2122f833ff2e None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:07.100536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 444/887] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:07.104616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426aca3c-b73d-407c-87b9-7c7712619b5c None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:07.104874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426aca3c-b73d-407c-87b9-7c7712619b5c None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:07.105179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426aca3c-b73d-407c-87b9-7c7712619b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:07.126422 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-426aca3c-b73d-407c-87b9-7c7712619b5c None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:07.127868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-426aca3c-b73d-407c-87b9-7c7712619b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:07.159293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf30427-c666-46bf-aa40-9826bb057d52 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:07.170850 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:07.200859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e73e8-9bf7-4218-ad5b-7d659c51e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:07.201857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e73e8-9bf7-4218-ad5b-7d659c51e412 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:07.202321 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e73e8-9bf7-4218-ad5b-7d659c51e412 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:07.202802 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e73e8-9bf7-4218-ad5b-7d659c51e412 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:07.203620 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e73e8-9bf7-4218-ad5b-7d659c51e412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:07.205312 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e73e8-9bf7-4218-ad5b-7d659c51e412 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:07.217580 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 445/888] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:07.217793 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 444/889] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Sep 7 12:55:07 2022] GET /identity/v3/services => generated 1011 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 12:55:07.411074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426aca3c-b73d-407c-87b9-7c7712619b5c None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:07.501848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e73e8-9bf7-4218-ad5b-7d659c51e412 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:07.527796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426aca3c-b73d-407c-87b9-7c7712619b5c None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:07.561571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:07.570895 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea29f89-6372-45b9-8c3e-b0f38ba75452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:07.571550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea29f89-6372-45b9-8c3e-b0f38ba75452 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:07.571827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea29f89-6372-45b9-8c3e-b0f38ba75452 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:07.572093 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea29f89-6372-45b9-8c3e-b0f38ba75452 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:07.584602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea29f89-6372-45b9-8c3e-b0f38ba75452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-2ea29f89-6372-45b9-8c3e-b0f38ba75452 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:55:07.589637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:07.590659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:07.592191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:07.592191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:07.592191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:07.592191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:07.592191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:55:07.592191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:55:07.592191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:55:07.592191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:55:07.592191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:55:07.592191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:55:07.592191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:55:07.592191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:07.592191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 446/890] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Sep 7 12:55:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:07.597251 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea29f89-6372-45b9-8c3e-b0f38ba75452 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:07.627774 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e73e8-9bf7-4218-ad5b-7d659c51e412 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:07.633615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:07.666583 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347fdf5-b75a-492d-bd79-1036974bcea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:07.667565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347fdf5-b75a-492d-bd79-1036974bcea5 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:07.668251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347fdf5-b75a-492d-bd79-1036974bcea5 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:07.668771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347fdf5-b75a-492d-bd79-1036974bcea5 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:07.669640 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347fdf5-b75a-492d-bd79-1036974bcea5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:07.671230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347fdf5-b75a-492d-bd79-1036974bcea5 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:07.692595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 445/891] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Sep 7 12:55:07 2022] POST /identity/v3/services => generated 269 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:55:07.725009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea29f89-6372-45b9-8c3e-b0f38ba75452 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:07.777136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933dee9-bbb8-4db5-a12e-3444424872b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:07.778011 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933dee9-bbb8-4db5-a12e-3444424872b7 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:07.778341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933dee9-bbb8-4db5-a12e-3444424872b7 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:07.778638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933dee9-bbb8-4db5-a12e-3444424872b7 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:07.779414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933dee9-bbb8-4db5-a12e-3444424872b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:07.779841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933dee9-bbb8-4db5-a12e-3444424872b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:07.781412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933dee9-bbb8-4db5-a12e-3444424872b7 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:07.792833 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 447/892] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Sep 7 12:55:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:07.799012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347fdf5-b75a-492d-bd79-1036974bcea5 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:07.937838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347fdf5-b75a-492d-bd79-1036974bcea5 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:07.948900 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:07.979898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e589d3c-f3b9-4cfc-83aa-6b6b964a8535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:07.980770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e589d3c-f3b9-4cfc-83aa-6b6b964a8535 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:07.981050 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e589d3c-f3b9-4cfc-83aa-6b6b964a8535 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:07.981317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e589d3c-f3b9-4cfc-83aa-6b6b964a8535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:07.995754 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e589d3c-f3b9-4cfc-83aa-6b6b964a8535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:07.997296 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e589d3c-f3b9-4cfc-83aa-6b6b964a8535 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-6e589d3c-f3b9-4cfc-83aa-6b6b964a8535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:08.015068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:08.016092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:08.017768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:08.017768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:08.017768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:08.017768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 446/893] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:08.022624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933dee9-bbb8-4db5-a12e-3444424872b7 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:08.132303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933dee9-bbb8-4db5-a12e-3444424872b7 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:08.134055 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:08.169101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4f119-6c3c-4962-a001-7a8aa60a1b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:08.169720 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4f119-6c3c-4962-a001-7a8aa60a1b06 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:08.169998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4f119-6c3c-4962-a001-7a8aa60a1b06 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:08.170266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4f119-6c3c-4962-a001-7a8aa60a1b06 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:08.170924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4f119-6c3c-4962-a001-7a8aa60a1b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:08.171223 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4f119-6c3c-4962-a001-7a8aa60a1b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:08.172715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4f119-6c3c-4962-a001-7a8aa60a1b06 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:08.188244 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 448/894] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:08.194468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e589d3c-f3b9-4cfc-83aa-6b6b964a8535 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:08.309486 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e589d3c-f3b9-4cfc-83aa-6b6b964a8535 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:08.351249 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a52d8-d6e3-4e9f-9747-e8098f31d6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:08.352279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a52d8-d6e3-4e9f-9747-e8098f31d6fc None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:08.352820 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a52d8-d6e3-4e9f-9747-e8098f31d6fc None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:08.353290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a52d8-d6e3-4e9f-9747-e8098f31d6fc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:08.362512 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a52d8-d6e3-4e9f-9747-e8098f31d6fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:08.364432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a52d8-d6e3-4e9f-9747-e8098f31d6fc None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-6a0a52d8-d6e3-4e9f-9747-e8098f31d6fc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:55:08.381642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:08.382926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:08.383931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:08.383931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:08.383931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:55:08.383931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:55:08.383931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:55:08.383931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:55:08.383931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:55:08.383931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:55:08.383931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:55:08.383931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:08.387517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 447/895] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Sep 7 12:55:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:08.393675 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4f119-6c3c-4962-a001-7a8aa60a1b06 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:08.508781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4f119-6c3c-4962-a001-7a8aa60a1b06 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:08.553343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c2285-9003-47fb-8a31-65355130f449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:08.554048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c2285-9003-47fb-8a31-65355130f449 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:08.554328 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c2285-9003-47fb-8a31-65355130f449 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:08.554778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c2285-9003-47fb-8a31-65355130f449 None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:08.555670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c2285-9003-47fb-8a31-65355130f449 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:08.555976 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c2285-9003-47fb-8a31-65355130f449 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:08.557926 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c2285-9003-47fb-8a31-65355130f449 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:08.581812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 449/896] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Sep 7 12:55:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:08.587252 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a52d8-d6e3-4e9f-9747-e8098f31d6fc None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:08.614006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:08.705893 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a52d8-d6e3-4e9f-9747-e8098f31d6fc None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:08.745815 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df384b16-e0b6-4ac5-be60-c39aa38f54a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:08.746858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df384b16-e0b6-4ac5-be60-c39aa38f54a6 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:08.747358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df384b16-e0b6-4ac5-be60-c39aa38f54a6 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:08.747829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df384b16-e0b6-4ac5-be60-c39aa38f54a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:08.834003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df384b16-e0b6-4ac5-be60-c39aa38f54a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:08.837280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df384b16-e0b6-4ac5-be60-c39aa38f54a6 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:08.890359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:08.984358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 448/897] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:55:08 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:55:08.990115 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c2285-9003-47fb-8a31-65355130f449 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:09.009055 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:09.049645 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54741b6c-6c14-4952-8032-a803deec7d99 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:09.050051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54741b6c-6c14-4952-8032-a803deec7d99 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:09.050384 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54741b6c-6c14-4952-8032-a803deec7d99 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:09.052551 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 449/898] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:09.058494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad2664-bda9-4f5b-9467-32b91005c1c0 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:09.058771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad2664-bda9-4f5b-9467-32b91005c1c0 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:09.059191 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad2664-bda9-4f5b-9467-32b91005c1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:09.083111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-a1ad2664-bda9-4f5b-9467-32b91005c1c0 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:09.084432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a1ad2664-bda9-4f5b-9467-32b91005c1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:09.109525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c2285-9003-47fb-8a31-65355130f449 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:09.150183 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc0ff0-2fd4-43b0-859f-5bbdce39ec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:09.151207 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc0ff0-2fd4-43b0-859f-5bbdce39ec79 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:09.151678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc0ff0-2fd4-43b0-859f-5bbdce39ec79 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:09.152167 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc0ff0-2fd4-43b0-859f-5bbdce39ec79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:09.164652 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc0ff0-2fd4-43b0-859f-5bbdce39ec79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:09.166556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc0ff0-2fd4-43b0-859f-5bbdce39ec79 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-f1dc0ff0-2fd4-43b0-859f-5bbdce39ec79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:09.183361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:09.184398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:09.185323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:09.185323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:09.185323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:09.191845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 450/900] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:55:09.192216 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 450/900] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:09.194109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad2664-bda9-4f5b-9467-32b91005c1c0 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:09.249303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:09.307879 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad2664-bda9-4f5b-9467-32b91005c1c0 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:09.346317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d279c8-f2eb-48f0-88e3-c1916ca76218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:09.346983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d279c8-f2eb-48f0-88e3-c1916ca76218 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:09.347388 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d279c8-f2eb-48f0-88e3-c1916ca76218 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:09.347715 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d279c8-f2eb-48f0-88e3-c1916ca76218 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:09.348455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d279c8-f2eb-48f0-88e3-c1916ca76218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:09.348759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d279c8-f2eb-48f0-88e3-c1916ca76218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:09.350163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d279c8-f2eb-48f0-88e3-c1916ca76218 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:09.363345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 451/901] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:09.368938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc0ff0-2fd4-43b0-859f-5bbdce39ec79 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:09.447322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:09.500224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc0ff0-2fd4-43b0-859f-5bbdce39ec79 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:09.529830 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d279c8-f2eb-48f0-88e3-c1916ca76218 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:09.537970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f502a60-0d88-4755-834e-3b4081efce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:09.538614 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f502a60-0d88-4755-834e-3b4081efce7d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:09.538900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f502a60-0d88-4755-834e-3b4081efce7d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:09.539174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f502a60-0d88-4755-834e-3b4081efce7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:09.546652 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f502a60-0d88-4755-834e-3b4081efce7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:09.548199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f502a60-0d88-4755-834e-3b4081efce7d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:09.563622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-5f502a60-0d88-4755-834e-3b4081efce7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:09.563622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:09.563622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:09.563622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:09.563622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:09.563622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:09.563622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:09.563622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:09.563622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:09.563622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:09.563622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:09.563622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:09.563622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:55:09.563622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:55:09.563622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:09.564710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:09.565628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:55:09.565628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:55:09.565628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:55:09.565628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:55:09.565628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:55:09.565628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:55:09.565628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:09.565628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:09.565628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 451/902] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:55:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:09.566853 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f24d76-de60-467c-a32f-a190b27bdb07 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:09.567293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f24d76-de60-467c-a32f-a190b27bdb07 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:09.567674 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f24d76-de60-467c-a32f-a190b27bdb07 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:09.569481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 452/903] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:09.570998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f24d76-de60-467c-a32f-a190b27bdb07 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:09.666358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d279c8-f2eb-48f0-88e3-c1916ca76218 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:09.678942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:09.706896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f8ac9-fb1f-4676-b372-cf29432d8be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:09.707926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f8ac9-fb1f-4676-b372-cf29432d8be3 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:09.708495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f8ac9-fb1f-4676-b372-cf29432d8be3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:09.708781 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f8ac9-fb1f-4676-b372-cf29432d8be3 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:09.709517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f8ac9-fb1f-4676-b372-cf29432d8be3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:09.710867 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f8ac9-fb1f-4676-b372-cf29432d8be3 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:09.711076 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f24d76-de60-467c-a32f-a190b27bdb07 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:09.736409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 452/904] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Sep 7 12:55:09 2022] POST /identity/v3/services => generated 241 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:55:09.736409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580bfb8-f10e-497d-b419-5034a4c5e618 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:09.736409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580bfb8-f10e-497d-b419-5034a4c5e618 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:09.736409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580bfb8-f10e-497d-b419-5034a4c5e618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:09.737591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:09.762490 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb625ee-8fdb-4e37-a070-c6cdbd8aea84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:09.763083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb625ee-8fdb-4e37-a070-c6cdbd8aea84 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:09.763316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-1580bfb8-f10e-497d-b419-5034a4c5e618 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:09.763436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb625ee-8fdb-4e37-a070-c6cdbd8aea84 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:09.766611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb625ee-8fdb-4e37-a070-c6cdbd8aea84 None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:09.766798 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-1580bfb8-f10e-497d-b419-5034a4c5e618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:09.766888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb625ee-8fdb-4e37-a070-c6cdbd8aea84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:09.766888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb625ee-8fdb-4e37-a070-c6cdbd8aea84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:09.766888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb625ee-8fdb-4e37-a070-c6cdbd8aea84 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:09.786040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 453/905] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:55:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:09.792448 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb625ee-8fdb-4e37-a070-c6cdbd8aea84 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:09.889045 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 453/906] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:09.940554 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb625ee-8fdb-4e37-a070-c6cdbd8aea84 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:09.983977 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c2399-5e22-443b-b0ec-dccb7979d66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:09.984671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c2399-5e22-443b-b0ec-dccb7979d66d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:09.984922 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c2399-5e22-443b-b0ec-dccb7979d66d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:09.985196 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c2399-5e22-443b-b0ec-dccb7979d66d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:09.985965 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c2399-5e22-443b-b0ec-dccb7979d66d None admin] RBAC: Adding query filter params (role.id=5ffeac2dbda44d9eac33c133a025f37e, scope.project.id=3381c0688581489b903e641f91914839, user.id=beb2724f88054621a78b2aaa502f6538) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:09.986275 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c2399-5e22-443b-b0ec-dccb7979d66d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:09.987924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c2399-5e22-443b-b0ec-dccb7979d66d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:09.995301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 454/907] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:55:09 2022] GET /identity/v3/role_assignments?user.id=beb2724f88054621a78b2aaa502f6538&scope.project.id=3381c0688581489b903e641f91914839&role.id=5ffeac2dbda44d9eac33c133a025f37e => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:10.240091 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effe089-5f37-4e9f-974e-14869e10355a None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:10.240483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effe089-5f37-4e9f-974e-14869e10355a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:10.240929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effe089-5f37-4e9f-974e-14869e10355a None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:10.243308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 454/908] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:10.249988 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f59d73-be69-4587-a985-0e4f3a73bb2b None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:10.250438 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f59d73-be69-4587-a985-0e4f3a73bb2b None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:10.250859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f59d73-be69-4587-a985-0e4f3a73bb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:10.259222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effe089-5f37-4e9f-974e-14869e10355a None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:10.278237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-66f59d73-be69-4587-a985-0e4f3a73bb2b None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:10.281042 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-66f59d73-be69-4587-a985-0e4f3a73bb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:10.341063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:10.386624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 455/909] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:55:10.409572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:10.418703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effe089-5f37-4e9f-974e-14869e10355a None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:10.472972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44974315-9ed3-4169-bae9-2978e23edbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:10.474462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44974315-9ed3-4169-bae9-2978e23edbd9 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:10.475190 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44974315-9ed3-4169-bae9-2978e23edbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:10.475944 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44974315-9ed3-4169-bae9-2978e23edbd9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:10.477267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44974315-9ed3-4169-bae9-2978e23edbd9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:10.480270 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44974315-9ed3-4169-bae9-2978e23edbd9 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-44974315-9ed3-4169-bae9-2978e23edbd9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:10.499401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:10.501700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:10.504043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:10.504043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:10.504043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:10.504043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:10.504043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:10.504043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:10.504043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:10.504043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:10.504043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:10.504043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:10.504043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:10.504043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:10.504043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:55:10.504043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:10.512864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 455/910] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:55:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:10.519962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f59d73-be69-4587-a985-0e4f3a73bb2b None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:10.656731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44974315-9ed3-4169-bae9-2978e23edbd9 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:10.663124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f59d73-be69-4587-a985-0e4f3a73bb2b None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:10.705744 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2fa8e-6799-44f0-9133-23a1dd90cde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:10.706540 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2fa8e-6799-44f0-9133-23a1dd90cde6 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:10.707112 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2fa8e-6799-44f0-9133-23a1dd90cde6 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:10.707493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2fa8e-6799-44f0-9133-23a1dd90cde6 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:10.708263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2fa8e-6799-44f0-9133-23a1dd90cde6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:10.708696 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2fa8e-6799-44f0-9133-23a1dd90cde6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:10.710232 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2fa8e-6799-44f0-9133-23a1dd90cde6 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:10.716745 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 456/911] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:55:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:10.725795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2fa8e-6799-44f0-9133-23a1dd90cde6 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:10.786767 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:10.842270 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44974315-9ed3-4169-bae9-2978e23edbd9 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:10.906391 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2fa8e-6799-44f0-9133-23a1dd90cde6 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:10.917745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb555cf3-9573-4c9a-ae80-95e74fd84fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:10.919499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb555cf3-9573-4c9a-ae80-95e74fd84fd5 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:10.920464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb555cf3-9573-4c9a-ae80-95e74fd84fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:10.921226 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb555cf3-9573-4c9a-ae80-95e74fd84fd5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:10.922068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb555cf3-9573-4c9a-ae80-95e74fd84fd5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:10.925578 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb555cf3-9573-4c9a-ae80-95e74fd84fd5 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-fb555cf3-9573-4c9a-ae80-95e74fd84fd5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:10.942699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:10.943921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:10.945413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:10.945413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:10.945413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:10.945413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:10.945413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:10.945413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:10.945413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:10.945413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:10.945413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:10.945413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:10.945413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:10.945413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:10.945413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:55:10.945413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:10.949209 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 456/912] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Sep 7 12:55:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:10.955429 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb555cf3-9573-4c9a-ae80-95e74fd84fd5 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:10.957343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cb4e8-1df9-4165-bbef-105b15eab296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:10.958434 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cb4e8-1df9-4165-bbef-105b15eab296 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:10.959055 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cb4e8-1df9-4165-bbef-105b15eab296 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:10.959645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cb4e8-1df9-4165-bbef-105b15eab296 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:10.960985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cb4e8-1df9-4165-bbef-105b15eab296 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:10.962631 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cb4e8-1df9-4165-bbef-105b15eab296 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:10.964788 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cb4e8-1df9-4165-bbef-105b15eab296 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:10.980963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 457/913] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Sep 7 12:55:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:10.982542 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cb4e8-1df9-4165-bbef-105b15eab296 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:10.999630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:11.122378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb555cf3-9573-4c9a-ae80-95e74fd84fd5 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:11.132983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:11.138449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cb4e8-1df9-4165-bbef-105b15eab296 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:11.185774 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a888c-a06b-4353-89ac-dec4050bc78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:11.186871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5e77d-3d06-457f-8085-396bdbecf2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:11.187075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a888c-a06b-4353-89ac-dec4050bc78b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:11.187534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a888c-a06b-4353-89ac-dec4050bc78b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:11.187661 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5e77d-3d06-457f-8085-396bdbecf2c6 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:11.187942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5e77d-3d06-457f-8085-396bdbecf2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:11.188278 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a888c-a06b-4353-89ac-dec4050bc78b None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:11.188424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5e77d-3d06-457f-8085-396bdbecf2c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:11.189243 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5e77d-3d06-457f-8085-396bdbecf2c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:11.189522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a888c-a06b-4353-89ac-dec4050bc78b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:11.190289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a888c-a06b-4353-89ac-dec4050bc78b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:11.191626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5e77d-3d06-457f-8085-396bdbecf2c6 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:11.192324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a888c-a06b-4353-89ac-dec4050bc78b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:11.200307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 457/914] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Sep 7 12:55:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:11.210612 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a888c-a06b-4353-89ac-dec4050bc78b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:11.228643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 458/915] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 12:55:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:55:11.353628 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:11.366389 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a888c-a06b-4353-89ac-dec4050bc78b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:11.423094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f67081-4cc9-4350-9842-90f13b8bff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:11.423643 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f67081-4cc9-4350-9842-90f13b8bff86 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:11.423993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f67081-4cc9-4350-9842-90f13b8bff86 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:11.424439 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f67081-4cc9-4350-9842-90f13b8bff86 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:11.425341 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f67081-4cc9-4350-9842-90f13b8bff86 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:11.425641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f67081-4cc9-4350-9842-90f13b8bff86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:11.427111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f67081-4cc9-4350-9842-90f13b8bff86 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:11.436703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 458/916] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Sep 7 12:55:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:11.439504 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5e77d-3d06-457f-8085-396bdbecf2c6 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:11.557147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5e77d-3d06-457f-8085-396bdbecf2c6 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:11.600350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233a738-abfe-4674-ad2a-11e2ed971e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:11.601067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233a738-abfe-4674-ad2a-11e2ed971e43 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:11.601351 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233a738-abfe-4674-ad2a-11e2ed971e43 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:11.601623 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233a738-abfe-4674-ad2a-11e2ed971e43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:11.602344 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233a738-abfe-4674-ad2a-11e2ed971e43 None admin] RBAC: Adding query filter params (interface=public, service_id=6a56009c064c45dd9750dbf38535fcd6, region_id=RegionOne) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:11.602806 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233a738-abfe-4674-ad2a-11e2ed971e43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:11.604206 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233a738-abfe-4674-ad2a-11e2ed971e43 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:11.615897 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 459/917] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Sep 7 12:55:11 2022] GET /identity/v3/endpoints?service_id=6a56009c064c45dd9750dbf38535fcd6&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:11.617304 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f67081-4cc9-4350-9842-90f13b8bff86 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:11.747305 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f67081-4cc9-4350-9842-90f13b8bff86 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:11.795486 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106ca29-50ed-4389-b1de-7d14a7ea7dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:11.796108 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106ca29-50ed-4389-b1de-7d14a7ea7dd9 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:11.796409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106ca29-50ed-4389-b1de-7d14a7ea7dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:11.796974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106ca29-50ed-4389-b1de-7d14a7ea7dd9 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:11.797598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106ca29-50ed-4389-b1de-7d14a7ea7dd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:11.798982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106ca29-50ed-4389-b1de-7d14a7ea7dd9 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:11.812530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 459/918] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Sep 7 12:55:11 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 12:55:12.317167 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d963b6-6f9d-4c8e-b595-279215f5a6cb None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:12.317968 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d963b6-6f9d-4c8e-b595-279215f5a6cb None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:12.317968 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d963b6-6f9d-4c8e-b595-279215f5a6cb None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:12.319943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 460/919] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:55:12.326398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afb419-f00d-43dd-8a7d-3c657bfea2f2 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:12.327193 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afb419-f00d-43dd-8a7d-3c657bfea2f2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:12.327193 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afb419-f00d-43dd-8a7d-3c657bfea2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:12.347651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-39afb419-f00d-43dd-8a7d-3c657bfea2f2 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:12.348942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-39afb419-f00d-43dd-8a7d-3c657bfea2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:12.369106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:12.444651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 460/920] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:12.456033 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27558a-d5b9-4b84-a2b3-00e1df0797e4 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:12.456314 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27558a-d5b9-4b84-a2b3-00e1df0797e4 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:12.456620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27558a-d5b9-4b84-a2b3-00e1df0797e4 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:12.458279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 461/921] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:12.463676 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b460ef7-094e-4e2e-9032-1344b410d100 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:12.463958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b460ef7-094e-4e2e-9032-1344b410d100 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:12.464232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b460ef7-094e-4e2e-9032-1344b410d100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:12.483850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-3b460ef7-094e-4e2e-9032-1344b410d100 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:12.485163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3b460ef7-094e-4e2e-9032-1344b410d100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:12.557114 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 461/922] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:12.725582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27558a-d5b9-4b84-a2b3-00e1df0797e4 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:12.747080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:12.833895 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b460ef7-094e-4e2e-9032-1344b410d100 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:12.841693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27558a-d5b9-4b84-a2b3-00e1df0797e4 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:12.888701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56de2d2-ecd0-482c-9bf5-9f3f34460e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:12.889388 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56de2d2-ecd0-482c-9bf5-9f3f34460e11 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:12.889669 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56de2d2-ecd0-482c-9bf5-9f3f34460e11 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:12.889942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56de2d2-ecd0-482c-9bf5-9f3f34460e11 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:12.891398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56de2d2-ecd0-482c-9bf5-9f3f34460e11 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:12.893180 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56de2d2-ecd0-482c-9bf5-9f3f34460e11 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-e56de2d2-ecd0-482c-9bf5-9f3f34460e11 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:12.908933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:12.910077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:12.910939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:12.910939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:12.910939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:12.910939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:12.910939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:12.910939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:12.910939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:12.910939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:12.910939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:12.910939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:12.910939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:12.910939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:12.910939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:55:12.910939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:12.913981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 462/923] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Sep 7 12:55:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:12.920978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56de2d2-ecd0-482c-9bf5-9f3f34460e11 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:12.952364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:12.985725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b460ef7-094e-4e2e-9032-1344b410d100 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:13.024398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:13.049265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56de2d2-ecd0-482c-9bf5-9f3f34460e11 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:13.057199 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc60d2-3084-4ee2-b2b4-2befd3175613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:13.058211 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc60d2-3084-4ee2-b2b4-2befd3175613 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:13.059506 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc60d2-3084-4ee2-b2b4-2befd3175613 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:13.059999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc60d2-3084-4ee2-b2b4-2befd3175613 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:13.075403 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc60d2-3084-4ee2-b2b4-2befd3175613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-62bc60d2-3084-4ee2-b2b4-2befd3175613 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:55:13.083016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:13.084049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:13.084963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:13.084963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:13.084963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:13.084963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:13.084963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:55:13.084963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:55:13.084963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:55:13.084963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:55:13.084963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:55:13.084963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:55:13.084963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:55:13.084963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:13.091070 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 462/924] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Sep 7 12:55:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:13.093502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc60d2-3084-4ee2-b2b4-2befd3175613 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:13.100092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928d346-0105-4a2a-87b5-64e02911381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:13.100827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928d346-0105-4a2a-87b5-64e02911381c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:13.101230 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928d346-0105-4a2a-87b5-64e02911381c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:13.101692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928d346-0105-4a2a-87b5-64e02911381c None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:13.102630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928d346-0105-4a2a-87b5-64e02911381c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:13.102942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928d346-0105-4a2a-87b5-64e02911381c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:13.104928 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928d346-0105-4a2a-87b5-64e02911381c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:13.117295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 463/925] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Sep 7 12:55:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:13.118840 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928d346-0105-4a2a-87b5-64e02911381c None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:13.230083 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc60d2-3084-4ee2-b2b4-2befd3175613 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:13.272755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464286e-ca55-4efe-a55a-cde897468fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:13.273399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464286e-ca55-4efe-a55a-cde897468fa3 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:13.273788 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464286e-ca55-4efe-a55a-cde897468fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:13.274160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464286e-ca55-4efe-a55a-cde897468fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:13.274397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928d346-0105-4a2a-87b5-64e02911381c None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:13.274961 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464286e-ca55-4efe-a55a-cde897468fa3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:13.275327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464286e-ca55-4efe-a55a-cde897468fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:13.276938 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464286e-ca55-4efe-a55a-cde897468fa3 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:13.279859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:13.295207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 463/926] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Sep 7 12:55:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:13.299146 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464286e-ca55-4efe-a55a-cde897468fa3 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:13.329338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604cdc3-50da-4eac-9f06-d2601acbae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:13.330872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604cdc3-50da-4eac-9f06-d2601acbae23 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:13.331296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604cdc3-50da-4eac-9f06-d2601acbae23 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:13.331724 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604cdc3-50da-4eac-9f06-d2601acbae23 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:13.332567 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604cdc3-50da-4eac-9f06-d2601acbae23 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:13.333279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604cdc3-50da-4eac-9f06-d2601acbae23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:13.335670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604cdc3-50da-4eac-9f06-d2601acbae23 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:13.343873 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 464/927] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Sep 7 12:55:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:13.357103 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604cdc3-50da-4eac-9f06-d2601acbae23 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:13.375095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:13.446137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464286e-ca55-4efe-a55a-cde897468fa3 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:13.488337 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a46d6-9e2a-479f-9757-823a982cfacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:13.489251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a46d6-9e2a-479f-9757-823a982cfacf None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:13.489744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a46d6-9e2a-479f-9757-823a982cfacf None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:13.490029 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a46d6-9e2a-479f-9757-823a982cfacf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:13.503819 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a46d6-9e2a-479f-9757-823a982cfacf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:13.505564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a46d6-9e2a-479f-9757-823a982cfacf None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:13.508265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604cdc3-50da-4eac-9f06-d2601acbae23 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-3c3a46d6-9e2a-479f-9757-823a982cfacf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:13.523033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:13.524242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:13.525401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:13.525401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:13.525401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:13.532010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 464/928] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:13.533408 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a46d6-9e2a-479f-9757-823a982cfacf None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:13.575059 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebfd15-2e1f-4c7d-9740-21b15cd87f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:13.577968 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebfd15-2e1f-4c7d-9740-21b15cd87f8d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:13.578671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebfd15-2e1f-4c7d-9740-21b15cd87f8d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:13.579346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebfd15-2e1f-4c7d-9740-21b15cd87f8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:13.580802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebfd15-2e1f-4c7d-9740-21b15cd87f8d None admin] RBAC: Adding query filter params (interface=public, service_id=4f30d482b2114284b72830824398c84b, region_id=RegionOne) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:13.581551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebfd15-2e1f-4c7d-9740-21b15cd87f8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:13.584817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebfd15-2e1f-4c7d-9740-21b15cd87f8d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:13.596909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:13.605192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 465/929] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Sep 7 12:55:13 2022] GET /identity/v3/endpoints?service_id=4f30d482b2114284b72830824398c84b&interface=public®ion_id=RegionOne => generated 194 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:13.606837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebfd15-2e1f-4c7d-9740-21b15cd87f8d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:13.673903 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a46d6-9e2a-479f-9757-823a982cfacf None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:13.716685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:13.717825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef207c8f-2695-4796-8f2f-b345ece14724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:13.718448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef207c8f-2695-4796-8f2f-b345ece14724 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:13.718728 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef207c8f-2695-4796-8f2f-b345ece14724 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:13.718998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef207c8f-2695-4796-8f2f-b345ece14724 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:13.720039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef207c8f-2695-4796-8f2f-b345ece14724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:13.720360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef207c8f-2695-4796-8f2f-b345ece14724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:13.722091 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef207c8f-2695-4796-8f2f-b345ece14724 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:13.740653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 465/930] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:13.740653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988d52f-eb3d-4e81-b0ad-bd4f3e991c79 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:13.740653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988d52f-eb3d-4e81-b0ad-bd4f3e991c79 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:13.740653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988d52f-eb3d-4e81-b0ad-bd4f3e991c79 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:13.740653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 466/931] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:13.743369 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988d52f-eb3d-4e81-b0ad-bd4f3e991c79 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:13.758379 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebfd15-2e1f-4c7d-9740-21b15cd87f8d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:13.798297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c40417-f739-4bb2-97dd-2b6a398187a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:13.799371 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c40417-f739-4bb2-97dd-2b6a398187a2 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:13.799707 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c40417-f739-4bb2-97dd-2b6a398187a2 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:13.800049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c40417-f739-4bb2-97dd-2b6a398187a2 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:13.800773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c40417-f739-4bb2-97dd-2b6a398187a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:13.802242 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c40417-f739-4bb2-97dd-2b6a398187a2 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:13.809645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 466/932] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Sep 7 12:55:13 2022] GET /identity/v3/services => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 12:55:13.810839 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d674bed-6a6f-4f4a-91f2-431dea66f723 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:13.811122 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d674bed-6a6f-4f4a-91f2-431dea66f723 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:13.811392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d674bed-6a6f-4f4a-91f2-431dea66f723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:13.834058 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-8d674bed-6a6f-4f4a-91f2-431dea66f723 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:13.835311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8d674bed-6a6f-4f4a-91f2-431dea66f723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:13.902315 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988d52f-eb3d-4e81-b0ad-bd4f3e991c79 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:13.916468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:13.959675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc7c56-3b9b-433b-aba4-4b89a6a2c987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:13.959922 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 467/933] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:13.960769 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc7c56-3b9b-433b-aba4-4b89a6a2c987 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:13.961058 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc7c56-3b9b-433b-aba4-4b89a6a2c987 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:13.961475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc7c56-3b9b-433b-aba4-4b89a6a2c987 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:13.969749 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc7c56-3b9b-433b-aba4-4b89a6a2c987 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:13.971715 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc7c56-3b9b-433b-aba4-4b89a6a2c987 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-61fc7c56-3b9b-433b-aba4-4b89a6a2c987 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:55:14.004801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:14.005837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:14.006811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:14.006811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:14.006811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:55:14.006811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:55:14.006811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:55:14.006811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:55:14.006811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:55:14.006811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:55:14.006811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:55:14.006811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:14.009720 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 467/934] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Sep 7 12:55:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:14.015887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d674bed-6a6f-4f4a-91f2-431dea66f723 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:14.091561 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:14.129153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d674bed-6a6f-4f4a-91f2-431dea66f723 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:14.167519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bbc92-f16d-4ade-9acc-d3895db684b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:14.168593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bbc92-f16d-4ade-9acc-d3895db684b8 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:14.169099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bbc92-f16d-4ade-9acc-d3895db684b8 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:14.169566 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bbc92-f16d-4ade-9acc-d3895db684b8 None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:14.170530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bbc92-f16d-4ade-9acc-d3895db684b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:14.171026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bbc92-f16d-4ade-9acc-d3895db684b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:14.172751 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bbc92-f16d-4ade-9acc-d3895db684b8 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:14.193232 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 468/935] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Sep 7 12:55:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:14.199372 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc7c56-3b9b-433b-aba4-4b89a6a2c987 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:14.236019 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bbc92-f16d-4ade-9acc-d3895db684b8 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:14.335256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc7c56-3b9b-433b-aba4-4b89a6a2c987 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:14.386998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bbc92-f16d-4ade-9acc-d3895db684b8 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:14.393001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1d86b-a099-4012-9bc7-29dc3fab6f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:14.393988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1d86b-a099-4012-9bc7-29dc3fab6f1c None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:14.394307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1d86b-a099-4012-9bc7-29dc3fab6f1c None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:14.394584 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1d86b-a099-4012-9bc7-29dc3fab6f1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:14.412914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1d86b-a099-4012-9bc7-29dc3fab6f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:14.416755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1d86b-a099-4012-9bc7-29dc3fab6f1c None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:14.428407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-bda1d86b-a099-4012-9bc7-29dc3fab6f1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:14.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:14.440206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:14.441897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:14.441897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:14.441897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:14.441897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 468/936] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:14.446070 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1d86b-a099-4012-9bc7-29dc3fab6f1c None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:14.448565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcfb93-bf38-496d-8f00-ad633904d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:14.450917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcfb93-bf38-496d-8f00-ad633904d0d8 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:14.451432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcfb93-bf38-496d-8f00-ad633904d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:14.451899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcfb93-bf38-496d-8f00-ad633904d0d8 None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:14.452840 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcfb93-bf38-496d-8f00-ad633904d0d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:14.454583 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcfb93-bf38-496d-8f00-ad633904d0d8 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:14.458314 dv-cinder-853315-7-smb devstack@keystone.service[104922]: WARNING keystone.server.flask.common [None req-8abcfb93-bf38-496d-8f00-ad633904d0d8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 07 12:55:14.482711 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:14.488794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.sql.core [None req-8abcfb93-bf38-496d-8f00-ad633904d0d8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 12:55:14.488794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 07 12:55:14.488794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [parameters: {'id': '4e031cc454184fe5b1771220355231ab', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 07 12:55:14.488794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=104922) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 12:55:14.497362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-8abcfb93-bf38-496d-8f00-ad633904d0d8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4e031cc454184fe5b1771220355231ab.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4e031cc454184fe5b1771220355231ab. Sep 07 12:55:14.497362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:14.497362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:55:14.497362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 12:55:14.497362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:55:14.497362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 12:55:14.497362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:55:14.497362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 12:55:14.497362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:55:14.497362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application conn.query(q) Sep 07 12:55:14.497362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:55:14.497362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:55:14.497362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application result.read() Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 07 12:55:14.498320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application next(self.gen) Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application yield resource Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application next(self.gen) Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise self.value Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application session.commit() Sep 07 12:55:14.499649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self.session.flush() Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application compat.raise_( Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 12:55:14.500692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 12:55:14.501643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 12:55:14.501643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 12:55:14.501643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 12:55:14.501643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 12:55:14.501643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 07 12:55:14.501643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 07 12:55:14.501643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 12:55:14.501643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 12:55:14.501643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 12:55:14.501643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 12:55:14.501643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 12:55:14.501643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 12:55:14.501643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 12:55:14.501643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 12:55:14.501643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application conn.query(q) Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application result.read() Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:55:14.502519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 12:55:14.503589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:55:14.503589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 12:55:14.503589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:55:14.503589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 12:55:14.503589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:55:14.503589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 12:55:14.503589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 12:55:14.503589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 07 12:55:14.503589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [parameters: {'id': '4e031cc454184fe5b1771220355231ab', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 07 12:55:14.503589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 12:55:14.503589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:14.503589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:14.503589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:14.503589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:14.503589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:14.506214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:14.513392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:14.513392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 07 12:55:14.513392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 07 12:55:14.513392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:14.513392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:14.513392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 07 12:55:14.513392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 07 12:55:14.513392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4e031cc454184fe5b1771220355231ab. Sep 07 12:55:14.513392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:14.513392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 469/937] 10.222.0.30 () {60 vars in 1140 bytes} [Wed Sep 7 12:55:14 2022] POST /identity/v3/projects => generated 262 bytes in 263 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:14.513392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5d1c8-aa4f-4836-92b1-f449fef92de3 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:14.513392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5d1c8-aa4f-4836-92b1-f449fef92de3 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:14.514046 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5d1c8-aa4f-4836-92b1-f449fef92de3 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:14.514046 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 470/938] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:14.514046 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5d1c8-aa4f-4836-92b1-f449fef92de3 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:14.590501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1d86b-a099-4012-9bc7-29dc3fab6f1c None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:14.644109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc69a46-4879-49a0-81c0-2214fa164314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:14.644686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc69a46-4879-49a0-81c0-2214fa164314 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:14.644968 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc69a46-4879-49a0-81c0-2214fa164314 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:14.645418 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc69a46-4879-49a0-81c0-2214fa164314 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:14.646515 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc69a46-4879-49a0-81c0-2214fa164314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:14.646824 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc69a46-4879-49a0-81c0-2214fa164314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:14.648411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc69a46-4879-49a0-81c0-2214fa164314 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:14.650548 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5d1c8-aa4f-4836-92b1-f449fef92de3 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:14.666294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 469/939] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:14.667385 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52975b-d0ac-48d7-b18e-2f319c0438f8 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:14.667677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52975b-d0ac-48d7-b18e-2f319c0438f8 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:14.667940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52975b-d0ac-48d7-b18e-2f319c0438f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:14.694424 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ee52975b-d0ac-48d7-b18e-2f319c0438f8 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:14.696508 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ee52975b-d0ac-48d7-b18e-2f319c0438f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:14.721516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d552e1-d5c6-4335-ab84-5819a4624a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:14.722640 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d552e1-d5c6-4335-ab84-5819a4624a47 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:14.723093 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d552e1-d5c6-4335-ab84-5819a4624a47 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:14.723526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d552e1-d5c6-4335-ab84-5819a4624a47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:14.734857 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d552e1-d5c6-4335-ab84-5819a4624a47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:14.738097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d552e1-d5c6-4335-ab84-5819a4624a47 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:14.761136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-a9d552e1-d5c6-4335-ab84-5819a4624a47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:14.761136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:14.761136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:14.761136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:14.761136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:14.761136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:14.761136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:14.761136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:14.761136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:14.761136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:14.761136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:14.761136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:14.761136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:55:14.761136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:55:14.761136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:14.762279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:14.763166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:55:14.763166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:55:14.763166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:55:14.763166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:55:14.763166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:55:14.763166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:55:14.763166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:14.763166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:14.763166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 471/940] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:55:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:14.771336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d552e1-d5c6-4335-ab84-5819a4624a47 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:14.821137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 470/941] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:14.822103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52975b-d0ac-48d7-b18e-2f319c0438f8 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:14.836281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:14.851969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:14.927807 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d552e1-d5c6-4335-ab84-5819a4624a47 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:14.968163 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8747a45-e1b8-44bf-ab15-11617fd9a49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:14.968859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8747a45-e1b8-44bf-ab15-11617fd9a49f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:14.969139 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8747a45-e1b8-44bf-ab15-11617fd9a49f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:14.969414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8747a45-e1b8-44bf-ab15-11617fd9a49f None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:14.977496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8747a45-e1b8-44bf-ab15-11617fd9a49f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:14.979048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8747a45-e1b8-44bf-ab15-11617fd9a49f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:14.992771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-f8747a45-e1b8-44bf-ab15-11617fd9a49f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:14.992771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:14.992771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:14.992771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:14.992771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:14.992771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:14.992771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:14.992771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:14.992771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:14.992771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:14.992771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:14.992771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:14.992771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:55:14.992771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:55:14.992771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:14.993794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:14.995083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:55:14.995083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:55:14.995083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:55:14.995083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:55:14.995083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:55:14.995083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:55:14.995083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:14.995083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:14.999112 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 472/942] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:55:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:15.000531 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8747a45-e1b8-44bf-ab15-11617fd9a49f None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:15.005693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52975b-d0ac-48d7-b18e-2f319c0438f8 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:15.056919 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651ac57-5519-4d86-8bd1-f112c0e55490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:15.058664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651ac57-5519-4d86-8bd1-f112c0e55490 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:15.059320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651ac57-5519-4d86-8bd1-f112c0e55490 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:15.059776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651ac57-5519-4d86-8bd1-f112c0e55490 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:15.061073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651ac57-5519-4d86-8bd1-f112c0e55490 None admin] RBAC: Adding query filter params (name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:15.062085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651ac57-5519-4d86-8bd1-f112c0e55490 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:15.063747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651ac57-5519-4d86-8bd1-f112c0e55490 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:15.091022 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 471/943] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Sep 7 12:55:14 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:15.106116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651ac57-5519-4d86-8bd1-f112c0e55490 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:15.129363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8747a45-e1b8-44bf-ab15-11617fd9a49f None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:15.132720 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:15.200418 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328111d5-0166-48dd-94fe-b731230d0734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:15.201369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328111d5-0166-48dd-94fe-b731230d0734 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:15.201721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328111d5-0166-48dd-94fe-b731230d0734 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:15.202163 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328111d5-0166-48dd-94fe-b731230d0734 None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:15.203270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328111d5-0166-48dd-94fe-b731230d0734 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:15.203646 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328111d5-0166-48dd-94fe-b731230d0734 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:15.204783 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:15.206341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328111d5-0166-48dd-94fe-b731230d0734 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:15.221497 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 473/944] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:55:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:15.240421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328111d5-0166-48dd-94fe-b731230d0734 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:15.263049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651ac57-5519-4d86-8bd1-f112c0e55490 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:15.305367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251efde-4ff9-469e-9c4e-90726fc35be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:15.305820 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251efde-4ff9-469e-9c4e-90726fc35be1 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:15.306042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251efde-4ff9-469e-9c4e-90726fc35be1 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:15.306316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251efde-4ff9-469e-9c4e-90726fc35be1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:15.307758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251efde-4ff9-469e-9c4e-90726fc35be1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:15.309323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251efde-4ff9-469e-9c4e-90726fc35be1 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-4251efde-4ff9-469e-9c4e-90726fc35be1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:15.321074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:15.322101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:15.322992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:15.322992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:15.322992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:15.322992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:15.322992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:15.322992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:15.322992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:15.322992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:15.322992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:15.322992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:15.322992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:15.322992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:15.322992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:55:15.322992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:15.322992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 472/945] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Sep 7 12:55:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:15.333785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251efde-4ff9-469e-9c4e-90726fc35be1 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:15.398447 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328111d5-0166-48dd-94fe-b731230d0734 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:15.452410 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3780f-ef33-46b7-a1df-cd52ce5d5209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:15.453530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3780f-ef33-46b7-a1df-cd52ce5d5209 None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:15.454021 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3780f-ef33-46b7-a1df-cd52ce5d5209 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:15.454507 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3780f-ef33-46b7-a1df-cd52ce5d5209 None admin] PATH_INFO: `/v3/projects/3381c0688581489b903e641f91914839/users/beb2724f88054621a78b2aaa502f6538/roles/5ffeac2dbda44d9eac33c133a025f37e` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:15.458631 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3780f-ef33-46b7-a1df-cd52ce5d5209 None admin] RBAC: Authorizing `identity:create_grant(project_id=3381c0688581489b903e641f91914839, user_id=beb2724f88054621a78b2aaa502f6538, role_id=5ffeac2dbda44d9eac33c133a025f37e)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:15.461463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3780f-ef33-46b7-a1df-cd52ce5d5209 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:15.488544 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 474/946] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:55:15 2022] PUT /identity/v3/projects/3381c0688581489b903e641f91914839/users/beb2724f88054621a78b2aaa502f6538/roles/5ffeac2dbda44d9eac33c133a025f37e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:55:15.500092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251efde-4ff9-469e-9c4e-90726fc35be1 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:15.542922 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d884bef-3fd4-4c94-8c90-f5cb5568a895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:15.543924 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d884bef-3fd4-4c94-8c90-f5cb5568a895 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:15.544440 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d884bef-3fd4-4c94-8c90-f5cb5568a895 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:15.544887 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d884bef-3fd4-4c94-8c90-f5cb5568a895 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:15.545803 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d884bef-3fd4-4c94-8c90-f5cb5568a895 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:15.546350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d884bef-3fd4-4c94-8c90-f5cb5568a895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:15.547961 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d884bef-3fd4-4c94-8c90-f5cb5568a895 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:15.552786 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:15.555384 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 473/947] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Sep 7 12:55:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:15.561342 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3780f-ef33-46b7-a1df-cd52ce5d5209 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:15.590000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:15.693187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3780f-ef33-46b7-a1df-cd52ce5d5209 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:15.740717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4e148-82e1-4469-bf26-89f06a2667f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:15.741794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4e148-82e1-4469-bf26-89f06a2667f4 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:15.742076 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4e148-82e1-4469-bf26-89f06a2667f4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:15.742350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4e148-82e1-4469-bf26-89f06a2667f4 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:15.743008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4e148-82e1-4469-bf26-89f06a2667f4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:15.743322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4e148-82e1-4469-bf26-89f06a2667f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:15.744783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4e148-82e1-4469-bf26-89f06a2667f4 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:15.753322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 475/948] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Sep 7 12:55:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:15.759277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d884bef-3fd4-4c94-8c90-f5cb5568a895 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:15.866617 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d884bef-3fd4-4c94-8c90-f5cb5568a895 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:15.903673 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4484c-c9d2-4e60-a8d2-7ad758224885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:15.904356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4484c-c9d2-4e60-a8d2-7ad758224885 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:15.904672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4484c-c9d2-4e60-a8d2-7ad758224885 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:15.904927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4484c-c9d2-4e60-a8d2-7ad758224885 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:15.905596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4484c-c9d2-4e60-a8d2-7ad758224885 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:15.906970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4484c-c9d2-4e60-a8d2-7ad758224885 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:15.940418 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 474/949] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 12:55:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:55:16.252341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a907d03-4fe7-45b8-8f3a-9d524eddd042 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:16.252826 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a907d03-4fe7-45b8-8f3a-9d524eddd042 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:16.253197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a907d03-4fe7-45b8-8f3a-9d524eddd042 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:16.254578 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 476/950] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:16.260992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33a45e-bf9d-4e30-84a9-b647d1fc53fb None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:16.261314 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33a45e-bf9d-4e30-84a9-b647d1fc53fb None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:16.261537 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33a45e-bf9d-4e30-84a9-b647d1fc53fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:16.282333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ce33a45e-bf9d-4e30-84a9-b647d1fc53fb None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:16.283649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ce33a45e-bf9d-4e30-84a9-b647d1fc53fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:16.349366 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:16.375421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 475/951] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:55:16.652120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a907d03-4fe7-45b8-8f3a-9d524eddd042 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:16.752503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:16.770626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a907d03-4fe7-45b8-8f3a-9d524eddd042 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:16.808564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e900f89-5b4e-4a6c-9207-1c36b8aa904e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:16.809298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e900f89-5b4e-4a6c-9207-1c36b8aa904e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:16.809581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e900f89-5b4e-4a6c-9207-1c36b8aa904e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:16.809858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e900f89-5b4e-4a6c-9207-1c36b8aa904e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:16.810533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e900f89-5b4e-4a6c-9207-1c36b8aa904e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:16.811942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e900f89-5b4e-4a6c-9207-1c36b8aa904e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-8e900f89-5b4e-4a6c-9207-1c36b8aa904e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:16.822088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:16.823332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:16.824211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:16.824211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:16.824211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:16.824211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:16.824211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:16.824211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:16.824211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:16.824211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:16.824211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:16.824211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:16.824211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:16.824211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:16.824211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:55:16.824211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:16.824211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 477/952] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Sep 7 12:55:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:16.829477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33a45e-bf9d-4e30-84a9-b647d1fc53fb None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:16.941503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33a45e-bf9d-4e30-84a9-b647d1fc53fb None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:16.977087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f5b2b-d8f9-4a5a-b4c2-d847b4793c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:16.977703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f5b2b-d8f9-4a5a-b4c2-d847b4793c1e None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:16.977981 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f5b2b-d8f9-4a5a-b4c2-d847b4793c1e None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:16.978256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f5b2b-d8f9-4a5a-b4c2-d847b4793c1e None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:16.978890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f5b2b-d8f9-4a5a-b4c2-d847b4793c1e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:16.979190 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f5b2b-d8f9-4a5a-b4c2-d847b4793c1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:16.980668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f5b2b-d8f9-4a5a-b4c2-d847b4793c1e None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:16.985881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 476/953] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Sep 7 12:55:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:16.991519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e900f89-5b4e-4a6c-9207-1c36b8aa904e None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:17.103291 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e900f89-5b4e-4a6c-9207-1c36b8aa904e None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:17.139316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399c0b5-5ea1-40da-8476-33a70c1b1ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:17.139929 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399c0b5-5ea1-40da-8476-33a70c1b1ea2 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:17.140206 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399c0b5-5ea1-40da-8476-33a70c1b1ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:17.140508 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399c0b5-5ea1-40da-8476-33a70c1b1ea2 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:17.141151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399c0b5-5ea1-40da-8476-33a70c1b1ea2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:17.141461 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399c0b5-5ea1-40da-8476-33a70c1b1ea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:17.142862 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399c0b5-5ea1-40da-8476-33a70c1b1ea2 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:17.148865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 478/954] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Sep 7 12:55:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:17.154406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f5b2b-d8f9-4a5a-b4c2-d847b4793c1e None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:17.206498 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:17.266532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f5b2b-d8f9-4a5a-b4c2-d847b4793c1e None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:17.304422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003f557-c229-4032-a47c-4f2e5cb4dbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:17.305641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003f557-c229-4032-a47c-4f2e5cb4dbed None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:17.306123 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003f557-c229-4032-a47c-4f2e5cb4dbed None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:17.306637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003f557-c229-4032-a47c-4f2e5cb4dbed None admin] PATH_INFO: `/v3/endpoints` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:17.307545 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003f557-c229-4032-a47c-4f2e5cb4dbed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:17.309355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003f557-c229-4032-a47c-4f2e5cb4dbed None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:17.334191 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 477/955] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 12:55:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:55:17.759517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d58493-f7ff-4179-afff-eeae005469d2 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:17.760460 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d58493-f7ff-4179-afff-eeae005469d2 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:17.760893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d58493-f7ff-4179-afff-eeae005469d2 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:17.762798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 479/956] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:17.769259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f6310-aefa-4db5-98be-e93ad556bff8 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:17.769905 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f6310-aefa-4db5-98be-e93ad556bff8 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:17.770383 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f6310-aefa-4db5-98be-e93ad556bff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:17.790392 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-428f6310-aefa-4db5-98be-e93ad556bff8 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:17.792040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-428f6310-aefa-4db5-98be-e93ad556bff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:17.887554 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ff4f9-04ac-4eb3-aa2a-ab00df50a16f None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:17.888320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ff4f9-04ac-4eb3-aa2a-ab00df50a16f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:17.888842 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ff4f9-04ac-4eb3-aa2a-ab00df50a16f None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:17.890084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 478/957] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:17.891214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 480/958] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:55:17.896830 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c88ec3-904d-4a2e-93ac-baeb94cd087f None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:17.897113 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c88ec3-904d-4a2e-93ac-baeb94cd087f None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:17.897398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c88ec3-904d-4a2e-93ac-baeb94cd087f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:17.917951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-29c88ec3-904d-4a2e-93ac-baeb94cd087f None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:17.919185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-29c88ec3-904d-4a2e-93ac-baeb94cd087f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:17.946483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:17.996270 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 479/959] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:18.177386 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ff4f9-04ac-4eb3-aa2a-ab00df50a16f None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:18.195966 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:18.223820 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd726f2-cf15-410f-9bb8-3751406bd790 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:18.224110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd726f2-cf15-410f-9bb8-3751406bd790 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:18.224397 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd726f2-cf15-410f-9bb8-3751406bd790 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:18.225745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 480/960] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:55:18.232602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d489f87-d43b-4878-97c7-228f8a303a4e None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:18.233120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d489f87-d43b-4878-97c7-228f8a303a4e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:18.233567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d489f87-d43b-4878-97c7-228f8a303a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:18.253067 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-6d489f87-d43b-4878-97c7-228f8a303a4e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:18.254662 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6d489f87-d43b-4878-97c7-228f8a303a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:18.298769 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ff4f9-04ac-4eb3-aa2a-ab00df50a16f None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:18.332038 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 481/961] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:18.333312 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d489f87-d43b-4878-97c7-228f8a303a4e None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:18.343900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707046f-0ce9-423e-a474-e9fd71833c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:18.344816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707046f-0ce9-423e-a474-e9fd71833c04 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:18.345269 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707046f-0ce9-423e-a474-e9fd71833c04 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:18.345712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707046f-0ce9-423e-a474-e9fd71833c04 None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:18.346787 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707046f-0ce9-423e-a474-e9fd71833c04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:18.348623 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707046f-0ce9-423e-a474-e9fd71833c04 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:18.365535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.sql.core [None req-d707046f-0ce9-423e-a474-e9fd71833c04 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 12:55:18.365535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 07 12:55:18.365535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [parameters: {'user_id': 'ea4d8d59606d40dc814ae50816ad0ac1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 07 12:55:18.365535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=104922) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 12:55:18.374993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-d707046f-0ce9-423e-a474-e9fd71833c04 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 07 12:55:18.374993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:18.374993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:55:18.374993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 12:55:18.374993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:55:18.374993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 12:55:18.374993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:55:18.374993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 12:55:18.374993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:55:18.374993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application conn.query(q) Sep 07 12:55:18.374993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:55:18.374993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:55:18.374993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:55:18.374993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application result.read() Sep 07 12:55:18.374993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 12:55:18.375961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application next(self.gen) Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application yield resource Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application next(self.gen) Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise self.value Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application session.commit() Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 12:55:18.376956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self.session.flush() Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application compat.raise_( Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 12:55:18.377958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:55:18.379023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application conn.query(q) Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application result.read() Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:55:18.380054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 12:55:18.381124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:55:18.381124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 12:55:18.381124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:55:18.381124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 12:55:18.381124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 12:55:18.381124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 07 12:55:18.381124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ea4d8d59606d40dc814ae50816ad0ac1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 07 12:55:18.381124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 12:55:18.381124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:18.381124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:18.381124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:18.381124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:18.381124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:18.381124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:18.381124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 07 12:55:18.382694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 07 12:55:18.384641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 07 12:55:18.384641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 07 12:55:18.384641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 12:55:18.384641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 12:55:18.384641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 07 12:55:18.384641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:18.392800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 481/962] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Sep 7 12:55:18 2022] POST /identity/v3/users => generated 160 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:18.394905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707046f-0ce9-423e-a474-e9fd71833c04 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:18.457771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:18.474203 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d489f87-d43b-4878-97c7-228f8a303a4e None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:18.490998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:18.520470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707046f-0ce9-423e-a474-e9fd71833c04 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:18.522728 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7816c9-9a39-4399-a8ef-0ac4082a73da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:18.523462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7816c9-9a39-4399-a8ef-0ac4082a73da None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:18.524613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7816c9-9a39-4399-a8ef-0ac4082a73da None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:18.526522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7816c9-9a39-4399-a8ef-0ac4082a73da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:18.542267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7816c9-9a39-4399-a8ef-0ac4082a73da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-0b7816c9-9a39-4399-a8ef-0ac4082a73da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:55:18.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:18.549664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:18.556048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:18.556048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:18.556048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:18.556048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:18.556048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:55:18.556048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:55:18.556048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:55:18.556048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:55:18.556048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:55:18.556048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:55:18.556048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:55:18.556048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:18.556048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 482/963] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Sep 7 12:55:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:18.556048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7816c9-9a39-4399-a8ef-0ac4082a73da None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:18.565399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070922c2-9df8-479f-b778-0f548f337ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:18.566507 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070922c2-9df8-479f-b778-0f548f337ef7 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:18.566800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070922c2-9df8-479f-b778-0f548f337ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:18.567077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070922c2-9df8-479f-b778-0f548f337ef7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:18.577698 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070922c2-9df8-479f-b778-0f548f337ef7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:18.579372 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070922c2-9df8-479f-b778-0f548f337ef7 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-070922c2-9df8-479f-b778-0f548f337ef7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:55:18.595620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:18.596878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:18.601747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:18.601747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:18.601747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:55:18.601747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:55:18.601747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:55:18.601747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:55:18.601747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:55:18.601747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:55:18.601747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:55:18.601747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:18.601747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 482/964] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:55:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:18.605331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070922c2-9df8-479f-b778-0f548f337ef7 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:18.681297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7816c9-9a39-4399-a8ef-0ac4082a73da None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:18.720613 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070922c2-9df8-479f-b778-0f548f337ef7 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:18.725015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695e9b4-784a-4fce-b989-b3f51e81f504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:18.725827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695e9b4-784a-4fce-b989-b3f51e81f504 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:18.726261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695e9b4-784a-4fce-b989-b3f51e81f504 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:18.726734 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695e9b4-784a-4fce-b989-b3f51e81f504 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:18.727561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695e9b4-784a-4fce-b989-b3f51e81f504 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:18.728018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695e9b4-784a-4fce-b989-b3f51e81f504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:18.730154 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695e9b4-784a-4fce-b989-b3f51e81f504 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:18.745023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 483/965] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Sep 7 12:55:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:18.746742 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695e9b4-784a-4fce-b989-b3f51e81f504 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:18.757760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f0524-231b-4a68-8922-e4c58fe29a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:18.758406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f0524-231b-4a68-8922-e4c58fe29a1e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:18.758856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f0524-231b-4a68-8922-e4c58fe29a1e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:18.759135 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f0524-231b-4a68-8922-e4c58fe29a1e None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:18.759850 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f0524-231b-4a68-8922-e4c58fe29a1e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:18.760498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f0524-231b-4a68-8922-e4c58fe29a1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:18.761389 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:18.761800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f0524-231b-4a68-8922-e4c58fe29a1e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:18.775518 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:18.807245 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 483/966] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Sep 7 12:55:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:18.808342 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f0524-231b-4a68-8922-e4c58fe29a1e None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:18.896843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695e9b4-784a-4fce-b989-b3f51e81f504 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:18.946551 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f131dea-d6a9-4c5b-b326-cff166144a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:18.947624 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f131dea-d6a9-4c5b-b326-cff166144a33 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:18.947761 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f0524-231b-4a68-8922-e4c58fe29a1e None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:18.948236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f131dea-d6a9-4c5b-b326-cff166144a33 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:18.948766 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f131dea-d6a9-4c5b-b326-cff166144a33 None admin] PATH_INFO: `/v3/services/compute` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:18.949812 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f131dea-d6a9-4c5b-b326-cff166144a33 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:18.951725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f131dea-d6a9-4c5b-b326-cff166144a33 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-9f131dea-d6a9-4c5b-b326-cff166144a33 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:18.962932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:18.964018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:18.964918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:18.964918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:18.964918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:18.964918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:18.964918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:18.964918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:18.964918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:18.964918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:18.964918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:18.964918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:18.964918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:18.964918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:18.964918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:55:18.964918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:18.968927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 484/967] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:55:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:18.979575 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f131dea-d6a9-4c5b-b326-cff166144a33 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:18.998755 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36081fc9-af90-487b-a87b-754d276f2723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:18.999705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36081fc9-af90-487b-a87b-754d276f2723 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:18.999983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36081fc9-af90-487b-a87b-754d276f2723 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:19.000253 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36081fc9-af90-487b-a87b-754d276f2723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:19.017635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36081fc9-af90-487b-a87b-754d276f2723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:19.020078 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36081fc9-af90-487b-a87b-754d276f2723 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-36081fc9-af90-487b-a87b-754d276f2723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:19.037942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:19.039157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:19.040174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:19.040174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:19.040174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:19.040174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 484/968] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:19.045400 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36081fc9-af90-487b-a87b-754d276f2723 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:19.089480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:19.097189 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:19.131565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f131dea-d6a9-4c5b-b326-cff166144a33 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:19.161843 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36081fc9-af90-487b-a87b-754d276f2723 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:19.175426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea20443-78de-47c8-a843-874e675a7879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:19.176050 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea20443-78de-47c8-a843-874e675a7879 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:19.176329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea20443-78de-47c8-a843-874e675a7879 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:19.176641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea20443-78de-47c8-a843-874e675a7879 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:19.177287 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea20443-78de-47c8-a843-874e675a7879 None admin] RBAC: Adding query filter params (name=compute) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:19.177590 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea20443-78de-47c8-a843-874e675a7879 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:19.178979 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea20443-78de-47c8-a843-874e675a7879 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:19.185222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 485/969] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Sep 7 12:55:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:19.191526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea20443-78de-47c8-a843-874e675a7879 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:19.207436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3858f0e-3052-4a71-9c94-2c96e773d76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:19.208063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3858f0e-3052-4a71-9c94-2c96e773d76a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:19.208342 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3858f0e-3052-4a71-9c94-2c96e773d76a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:19.208641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3858f0e-3052-4a71-9c94-2c96e773d76a None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:19.209295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3858f0e-3052-4a71-9c94-2c96e773d76a None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:19.209594 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3858f0e-3052-4a71-9c94-2c96e773d76a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:19.210989 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3858f0e-3052-4a71-9c94-2c96e773d76a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:19.223697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 485/970] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:19.229710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3858f0e-3052-4a71-9c94-2c96e773d76a None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:19.301822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea20443-78de-47c8-a843-874e675a7879 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:19.338667 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca6f76-2c50-4aa6-b02e-6233c90aec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:19.339284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca6f76-2c50-4aa6-b02e-6233c90aec1e None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:19.339637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca6f76-2c50-4aa6-b02e-6233c90aec1e None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:19.339881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca6f76-2c50-4aa6-b02e-6233c90aec1e None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:19.340489 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca6f76-2c50-4aa6-b02e-6233c90aec1e None admin] RBAC: Adding query filter params (type=compute) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:19.340788 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca6f76-2c50-4aa6-b02e-6233c90aec1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:19.342171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca6f76-2c50-4aa6-b02e-6233c90aec1e None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:19.343256 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3858f0e-3052-4a71-9c94-2c96e773d76a None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:19.347767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 486/971] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Sep 7 12:55:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:19.352601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:19.388314 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be2ec5-e713-45f9-b9fc-1feff65a8b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:19.389011 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be2ec5-e713-45f9-b9fc-1feff65a8b06 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:19.389293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be2ec5-e713-45f9-b9fc-1feff65a8b06 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:19.389573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be2ec5-e713-45f9-b9fc-1feff65a8b06 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:19.398802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be2ec5-e713-45f9-b9fc-1feff65a8b06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:19.400753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be2ec5-e713-45f9-b9fc-1feff65a8b06 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-c4be2ec5-e713-45f9-b9fc-1feff65a8b06 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:55:19.414801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:19.415947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:19.417407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:19.417407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:19.417407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:55:19.417407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:55:19.417407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:55:19.417407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:55:19.417407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:55:19.417407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:55:19.417407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:55:19.417407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:19.422173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 486/972] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Sep 7 12:55:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:19.425733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca6f76-2c50-4aa6-b02e-6233c90aec1e None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:19.428848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:19.563161 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca6f76-2c50-4aa6-b02e-6233c90aec1e None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:19.594829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b17a55-b15a-4d34-b927-f6849ac457ba None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:19.595574 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b17a55-b15a-4d34-b927-f6849ac457ba None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:19.595857 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b17a55-b15a-4d34-b927-f6849ac457ba None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:19.598415 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 487/973] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:55:19.604211 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5990d0d-c9f0-4f41-9352-401988864535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:19.604617 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576c2ba-72f0-49cf-8f3a-9373b9bdb57a None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:19.604801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576c2ba-72f0-49cf-8f3a-9373b9bdb57a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:19.604920 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5990d0d-c9f0-4f41-9352-401988864535 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:19.605078 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576c2ba-72f0-49cf-8f3a-9373b9bdb57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:19.605170 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5990d0d-c9f0-4f41-9352-401988864535 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:19.605440 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5990d0d-c9f0-4f41-9352-401988864535 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:19.606209 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5990d0d-c9f0-4f41-9352-401988864535 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:19.606513 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5990d0d-c9f0-4f41-9352-401988864535 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:19.607995 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5990d0d-c9f0-4f41-9352-401988864535 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:19.626126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-d576c2ba-72f0-49cf-8f3a-9373b9bdb57a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:19.628151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d576c2ba-72f0-49cf-8f3a-9373b9bdb57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:19.630064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 487/974] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Sep 7 12:55:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:19.635617 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5990d0d-c9f0-4f41-9352-401988864535 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:19.710837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 488/975] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:55:19.714139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:19.761274 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5990d0d-c9f0-4f41-9352-401988864535 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:19.800512 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932afed-5de4-4ef2-a414-e3c1849bf3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:19.801159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932afed-5de4-4ef2-a414-e3c1849bf3ab None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:19.801433 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932afed-5de4-4ef2-a414-e3c1849bf3ab None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:19.801703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932afed-5de4-4ef2-a414-e3c1849bf3ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:19.879516 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932afed-5de4-4ef2-a414-e3c1849bf3ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:19.881052 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932afed-5de4-4ef2-a414-e3c1849bf3ab None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:19.945987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:19.980866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576c2ba-72f0-49cf-8f3a-9373b9bdb57a None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:19.994972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 488/976] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:55:19 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 12:55:20.000933 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932afed-5de4-4ef2-a414-e3c1849bf3ab None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:20.087222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:20.095362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576c2ba-72f0-49cf-8f3a-9373b9bdb57a None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:20.113045 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932afed-5de4-4ef2-a414-e3c1849bf3ab None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:20.137461 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7bfdc-05ff-4ffe-9f2b-5a407d83ac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:20.138122 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7bfdc-05ff-4ffe-9f2b-5a407d83ac57 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:20.138515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7bfdc-05ff-4ffe-9f2b-5a407d83ac57 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:20.138677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7bfdc-05ff-4ffe-9f2b-5a407d83ac57 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:20.139468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7bfdc-05ff-4ffe-9f2b-5a407d83ac57 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:20.140719 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7bfdc-05ff-4ffe-9f2b-5a407d83ac57 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-20d7bfdc-05ff-4ffe-9f2b-5a407d83ac57 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:20.150465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:20.151535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:20.153111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:20.153111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:20.153111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:20.153111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:20.153111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:20.153111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:20.153111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:20.153111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:20.153111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:20.153111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:20.153111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:20.153111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:20.153111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:55:20.153111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:20.153111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 489/977] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Sep 7 12:55:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:20.153937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fb033-031c-4311-9863-9e617b6f81c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:20.153937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fb033-031c-4311-9863-9e617b6f81c9 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:20.153937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fb033-031c-4311-9863-9e617b6f81c9 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:20.154149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fb033-031c-4311-9863-9e617b6f81c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:20.157518 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7bfdc-05ff-4ffe-9f2b-5a407d83ac57 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:20.166205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fb033-031c-4311-9863-9e617b6f81c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:20.167751 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fb033-031c-4311-9863-9e617b6f81c9 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-708fb033-031c-4311-9863-9e617b6f81c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:20.184817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:20.185837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:20.186886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:20.186886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:20.186886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:20.186886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 489/978] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:20.192592 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fb033-031c-4311-9863-9e617b6f81c9 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:20.209726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:20.290229 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7bfdc-05ff-4ffe-9f2b-5a407d83ac57 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:20.324549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fb033-031c-4311-9863-9e617b6f81c9 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:20.328583 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59437026-7e1d-4730-bacc-4fb94795dc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:20.329207 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59437026-7e1d-4730-bacc-4fb94795dc09 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:20.329490 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59437026-7e1d-4730-bacc-4fb94795dc09 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:20.329760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59437026-7e1d-4730-bacc-4fb94795dc09 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:20.330396 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59437026-7e1d-4730-bacc-4fb94795dc09 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:20.330875 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59437026-7e1d-4730-bacc-4fb94795dc09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:20.332195 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59437026-7e1d-4730-bacc-4fb94795dc09 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:20.337687 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 490/979] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Sep 7 12:55:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:20.343486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59437026-7e1d-4730-bacc-4fb94795dc09 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:20.365491 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29686304-6a72-42ef-be87-a4e83f49e76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:20.365996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29686304-6a72-42ef-be87-a4e83f49e76a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:20.366251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29686304-6a72-42ef-be87-a4e83f49e76a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:20.366528 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29686304-6a72-42ef-be87-a4e83f49e76a None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:20.367170 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29686304-6a72-42ef-be87-a4e83f49e76a None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:20.367447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29686304-6a72-42ef-be87-a4e83f49e76a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:20.368869 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29686304-6a72-42ef-be87-a4e83f49e76a None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:20.377196 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:20.382877 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 490/980] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:20.388850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29686304-6a72-42ef-be87-a4e83f49e76a None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:20.469591 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:20.470216 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59437026-7e1d-4730-bacc-4fb94795dc09 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:20.505494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29686304-6a72-42ef-be87-a4e83f49e76a None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:20.510436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9298d0-4837-468e-b43a-aba5da796bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:20.511141 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9298d0-4837-468e-b43a-aba5da796bd4 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:20.511421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9298d0-4837-468e-b43a-aba5da796bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:20.511693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9298d0-4837-468e-b43a-aba5da796bd4 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:20.512356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9298d0-4837-468e-b43a-aba5da796bd4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:20.512770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9298d0-4837-468e-b43a-aba5da796bd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:20.514239 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9298d0-4837-468e-b43a-aba5da796bd4 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:20.525111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 491/981] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Sep 7 12:55:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:20.526851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9298d0-4837-468e-b43a-aba5da796bd4 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:20.557618 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30835cd-aa8f-4568-a834-ba15306f7387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:20.558777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30835cd-aa8f-4568-a834-ba15306f7387 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:20.559364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30835cd-aa8f-4568-a834-ba15306f7387 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:20.559648 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30835cd-aa8f-4568-a834-ba15306f7387 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:20.573089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30835cd-aa8f-4568-a834-ba15306f7387 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:20.574560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30835cd-aa8f-4568-a834-ba15306f7387 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:20.587534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-b30835cd-aa8f-4568-a834-ba15306f7387 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:20.587534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:20.587534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:20.587534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:20.587534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:20.587534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:20.587534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:20.587534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:20.587534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:20.587534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:20.587534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:20.587534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:20.587534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:55:20.587534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:55:20.587534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:20.588671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:20.589567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:55:20.589567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:55:20.589567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:55:20.589567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:55:20.589567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:55:20.589567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:55:20.589567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:20.589567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:20.592579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 491/982] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:55:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:20.595083 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30835cd-aa8f-4568-a834-ba15306f7387 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:20.629923 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:20.643749 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9298d0-4837-468e-b43a-aba5da796bd4 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:20.682684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5301043-494e-4bce-a9c2-709202f78c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:20.683306 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5301043-494e-4bce-a9c2-709202f78c01 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:20.683585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5301043-494e-4bce-a9c2-709202f78c01 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:20.683851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5301043-494e-4bce-a9c2-709202f78c01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:20.684594 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5301043-494e-4bce-a9c2-709202f78c01 None admin] RBAC: Adding query filter params (interface=admin, service_id=4f30d482b2114284b72830824398c84b, region_id=RegionOne) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:20.685019 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5301043-494e-4bce-a9c2-709202f78c01 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:20.686547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5301043-494e-4bce-a9c2-709202f78c01 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:20.697945 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 492/983] 10.222.0.30 () {56 vars in 1249 bytes} [Wed Sep 7 12:55:20 2022] GET /identity/v3/endpoints?service_id=4f30d482b2114284b72830824398c84b&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:20.698773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5301043-494e-4bce-a9c2-709202f78c01 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:20.705759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30835cd-aa8f-4568-a834-ba15306f7387 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:20.737954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:20.744103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f0b12-56db-4f0a-a4b1-cea4ba9a7e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:20.744796 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f0b12-56db-4f0a-a4b1-cea4ba9a7e06 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:20.745088 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f0b12-56db-4f0a-a4b1-cea4ba9a7e06 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:20.745344 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f0b12-56db-4f0a-a4b1-cea4ba9a7e06 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:20.746048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f0b12-56db-4f0a-a4b1-cea4ba9a7e06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:20.746354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f0b12-56db-4f0a-a4b1-cea4ba9a7e06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:20.747797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f0b12-56db-4f0a-a4b1-cea4ba9a7e06 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:20.765963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 492/984] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:55:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:20.766890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f0b12-56db-4f0a-a4b1-cea4ba9a7e06 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:20.810712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5301043-494e-4bce-a9c2-709202f78c01 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:20.853786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6482aac-9c27-4b37-b30e-bac65235606c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:20.855335 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482aac-9c27-4b37-b30e-bac65235606c None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:20.855609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482aac-9c27-4b37-b30e-bac65235606c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:20.855878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482aac-9c27-4b37-b30e-bac65235606c None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:20.856533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6482aac-9c27-4b37-b30e-bac65235606c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:20.857943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6482aac-9c27-4b37-b30e-bac65235606c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:20.876406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 493/985] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Sep 7 12:55:20 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 12:55:20.903044 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f0b12-56db-4f0a-a4b1-cea4ba9a7e06 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:20.947201 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895891c7-ea06-4659-8c40-c3eb3ddb1b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:20.947856 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895891c7-ea06-4659-8c40-c3eb3ddb1b77 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:20.948088 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895891c7-ea06-4659-8c40-c3eb3ddb1b77 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:20.948306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895891c7-ea06-4659-8c40-c3eb3ddb1b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:20.949129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895891c7-ea06-4659-8c40-c3eb3ddb1b77 None admin] RBAC: Adding query filter params (role.id=5ffeac2dbda44d9eac33c133a025f37e, scope.project.id=3381c0688581489b903e641f91914839, user.id=beb2724f88054621a78b2aaa502f6538) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:20.949431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895891c7-ea06-4659-8c40-c3eb3ddb1b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:20.950903 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895891c7-ea06-4659-8c40-c3eb3ddb1b77 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:20.958233 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 493/986] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:55:20 2022] GET /identity/v3/role_assignments?user.id=beb2724f88054621a78b2aaa502f6538&scope.project.id=3381c0688581489b903e641f91914839&role.id=5ffeac2dbda44d9eac33c133a025f37e => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:21.581367 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe6123-72af-4a99-a8ae-5ecf50c2c1ff None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:21.581945 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe6123-72af-4a99-a8ae-5ecf50c2c1ff None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:21.582027 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe6123-72af-4a99-a8ae-5ecf50c2c1ff None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:21.583741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 494/987] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:21.589891 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea45c6-f0a9-4d7d-914f-606dbec9c094 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:21.590299 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea45c6-f0a9-4d7d-914f-606dbec9c094 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:21.590431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea45c6-f0a9-4d7d-914f-606dbec9c094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:21.611158 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-5aea45c6-f0a9-4d7d-914f-606dbec9c094 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:21.612443 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5aea45c6-f0a9-4d7d-914f-606dbec9c094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:21.673881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:21.696684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 494/988] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:55:21.966093 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe6123-72af-4a99-a8ae-5ecf50c2c1ff None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:21.986073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:22.082689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe6123-72af-4a99-a8ae-5ecf50c2c1ff None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:22.123474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e89827-76b0-4b03-8a73-6e8adcf95fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:22.124071 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e89827-76b0-4b03-8a73-6e8adcf95fa7 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:22.124352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e89827-76b0-4b03-8a73-6e8adcf95fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:22.124970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e89827-76b0-4b03-8a73-6e8adcf95fa7 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:22.125677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e89827-76b0-4b03-8a73-6e8adcf95fa7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:22.127116 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e89827-76b0-4b03-8a73-6e8adcf95fa7 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:22.144425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 495/989] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Sep 7 12:55:21 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:55:23.764155 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff05a40-38b9-4307-b6f5-c7176f34d376 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:23.764785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff05a40-38b9-4307-b6f5-c7176f34d376 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:23.765095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff05a40-38b9-4307-b6f5-c7176f34d376 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:23.767488 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 495/990] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:23.776508 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991421c3-9cd1-4811-8d64-92653c93f405 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:23.777103 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991421c3-9cd1-4811-8d64-92653c93f405 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:23.777625 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991421c3-9cd1-4811-8d64-92653c93f405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:23.806675 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-991421c3-9cd1-4811-8d64-92653c93f405 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:23.808441 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-991421c3-9cd1-4811-8d64-92653c93f405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:23.943751 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 496/991] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:23.965011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65badc62-9e41-4b22-9bcb-ee1ab6bb2312 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:23.965294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65badc62-9e41-4b22-9bcb-ee1ab6bb2312 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:23.965696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65badc62-9e41-4b22-9bcb-ee1ab6bb2312 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:23.967190 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 496/992] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:23.973855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11858dc8-cff3-455d-a1d8-0ec7a2383e8f None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:23.974171 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11858dc8-cff3-455d-a1d8-0ec7a2383e8f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:23.974407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11858dc8-cff3-455d-a1d8-0ec7a2383e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:23.981422 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:23.997950 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-11858dc8-cff3-455d-a1d8-0ec7a2383e8f None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:23.999183 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-11858dc8-cff3-455d-a1d8-0ec7a2383e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:24.074505 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 497/993] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:24.220724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65badc62-9e41-4b22-9bcb-ee1ab6bb2312 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:24.335642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65badc62-9e41-4b22-9bcb-ee1ab6bb2312 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:24.344340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11858dc8-cff3-455d-a1d8-0ec7a2383e8f None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:24.373173 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04944642-571e-4ce3-bfbd-da11fa0a8e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:24.373822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04944642-571e-4ce3-bfbd-da11fa0a8e4d None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:24.374097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04944642-571e-4ce3-bfbd-da11fa0a8e4d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:24.374367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04944642-571e-4ce3-bfbd-da11fa0a8e4d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:24.375262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04944642-571e-4ce3-bfbd-da11fa0a8e4d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:24.376692 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04944642-571e-4ce3-bfbd-da11fa0a8e4d None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-04944642-571e-4ce3-bfbd-da11fa0a8e4d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:24.386188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:24.387371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:24.388215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:24.388215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:24.388215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:24.388215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:24.388215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:24.388215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:24.388215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:24.388215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:24.388215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:24.388215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:24.388215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:24.388215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:24.388215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:55:24.388215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:24.388215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 497/994] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Sep 7 12:55:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:24.393810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009261b-c6ba-4627-9a72-2d261c228847 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:24.394097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009261b-c6ba-4627-9a72-2d261c228847 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:24.394358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009261b-c6ba-4627-9a72-2d261c228847 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:24.395702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 498/995] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:24.396547 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009261b-c6ba-4627-9a72-2d261c228847 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:24.455807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:24.460004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11858dc8-cff3-455d-a1d8-0ec7a2383e8f None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:24.490606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:24.498107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d737507-67d7-4214-844d-0de05f0d991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:24.498741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d737507-67d7-4214-844d-0de05f0d991a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:24.499016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d737507-67d7-4214-844d-0de05f0d991a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:24.499266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d737507-67d7-4214-844d-0de05f0d991a None admin] PATH_INFO: `/v3/services/image` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:24.500154 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d737507-67d7-4214-844d-0de05f0d991a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:24.501630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d737507-67d7-4214-844d-0de05f0d991a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:24.510797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009261b-c6ba-4627-9a72-2d261c228847 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-6d737507-67d7-4214-844d-0de05f0d991a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:24.511169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:24.512153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:24.513336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:24.513336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:24.513336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:24.513336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:24.513336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:24.513336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:24.513336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:24.513336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:24.513336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:24.513336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:24.513336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:24.513336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:24.513336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:55:24.513336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:24.513336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 498/996] 10.222.0.30 () {56 vars in 1105 bytes} [Wed Sep 7 12:55:24 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:24.514145 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1559ff-077e-40a3-975f-67659f7d6faa None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:24.514145 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1559ff-077e-40a3-975f-67659f7d6faa None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:24.514340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1559ff-077e-40a3-975f-67659f7d6faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:24.533546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-2e1559ff-077e-40a3-975f-67659f7d6faa None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:24.534788 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-2e1559ff-077e-40a3-975f-67659f7d6faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:24.551323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa00a4-b5cb-4d1d-8cd0-2140b49e742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:24.552071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa00a4-b5cb-4d1d-8cd0-2140b49e742e None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:24.552504 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa00a4-b5cb-4d1d-8cd0-2140b49e742e None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:24.552909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa00a4-b5cb-4d1d-8cd0-2140b49e742e None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:24.553653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa00a4-b5cb-4d1d-8cd0-2140b49e742e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:24.554059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa00a4-b5cb-4d1d-8cd0-2140b49e742e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:24.555630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa00a4-b5cb-4d1d-8cd0-2140b49e742e None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:24.560672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 499/997] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Sep 7 12:55:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:24.561470 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa00a4-b5cb-4d1d-8cd0-2140b49e742e None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:24.606211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 499/998] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:24.606555 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1559ff-077e-40a3-975f-67659f7d6faa None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:24.684859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa00a4-b5cb-4d1d-8cd0-2140b49e742e None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:24.702721 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:24.727886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1559ff-077e-40a3-975f-67659f7d6faa None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:24.728269 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efc32f-3d98-463d-b496-e53ef64da82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:24.728819 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efc32f-3d98-463d-b496-e53ef64da82f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:24.729247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efc32f-3d98-463d-b496-e53ef64da82f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:24.729582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efc32f-3d98-463d-b496-e53ef64da82f None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:24.730272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efc32f-3d98-463d-b496-e53ef64da82f None admin] RBAC: Adding query filter params (name=image) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:24.730579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efc32f-3d98-463d-b496-e53ef64da82f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:24.732207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efc32f-3d98-463d-b496-e53ef64da82f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:24.738378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 500/999] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:24.744083 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efc32f-3d98-463d-b496-e53ef64da82f None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:24.763659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:24.773889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e5c68-5754-42d7-a5be-a6ffd28cf83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:24.774576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e5c68-5754-42d7-a5be-a6ffd28cf83e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:24.774848 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e5c68-5754-42d7-a5be-a6ffd28cf83e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:24.775119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e5c68-5754-42d7-a5be-a6ffd28cf83e None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:24.775869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e5c68-5754-42d7-a5be-a6ffd28cf83e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:24.776144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e5c68-5754-42d7-a5be-a6ffd28cf83e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:24.777631 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e5c68-5754-42d7-a5be-a6ffd28cf83e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:24.788892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 500/1000] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Sep 7 12:55:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:24.790170 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e5c68-5754-42d7-a5be-a6ffd28cf83e None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:24.868771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efc32f-3d98-463d-b496-e53ef64da82f None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:24.906857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cb82f-584a-4054-816d-cd10cce79b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:24.907480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cb82f-584a-4054-816d-cd10cce79b85 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:24.907764 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cb82f-584a-4054-816d-cd10cce79b85 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:24.908032 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cb82f-584a-4054-816d-cd10cce79b85 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:24.909016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cb82f-584a-4054-816d-cd10cce79b85 None admin] RBAC: Adding query filter params (type=image) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:24.909524 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cb82f-584a-4054-816d-cd10cce79b85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:24.911117 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cb82f-584a-4054-816d-cd10cce79b85 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:24.911691 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e5c68-5754-42d7-a5be-a6ffd28cf83e None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:24.915991 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 501/1001] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:24.917281 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cb82f-584a-4054-816d-cd10cce79b85 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:24.966642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e424c35-b512-45fc-a7e1-99acfd689df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:24.967600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e424c35-b512-45fc-a7e1-99acfd689df4 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:24.968085 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e424c35-b512-45fc-a7e1-99acfd689df4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:24.968579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e424c35-b512-45fc-a7e1-99acfd689df4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:24.969470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e424c35-b512-45fc-a7e1-99acfd689df4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:24.971418 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e424c35-b512-45fc-a7e1-99acfd689df4 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:24.975879 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:24.996017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 501/1002] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 12:55:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:55:25.069491 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cb82f-584a-4054-816d-cd10cce79b85 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:25.125390 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4d8ea-2d5c-4313-96f4-30dc27f8e854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:25.126185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4d8ea-2d5c-4313-96f4-30dc27f8e854 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:25.126468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4d8ea-2d5c-4313-96f4-30dc27f8e854 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:25.126723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4d8ea-2d5c-4313-96f4-30dc27f8e854 None admin] PATH_INFO: `/v3/services/compute` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:25.127325 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4d8ea-2d5c-4313-96f4-30dc27f8e854 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:25.128880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4d8ea-2d5c-4313-96f4-30dc27f8e854 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-3fe4d8ea-2d5c-4313-96f4-30dc27f8e854 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:25.140223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:25.141898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:25.142939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:25.142939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:25.142939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:25.142939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:25.142939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:25.142939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:25.142939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:25.142939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:25.142939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:25.142939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:25.142939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:25.142939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:25.142939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:55:25.142939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:25.142939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 502/1003] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:55:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:25.153046 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e424c35-b512-45fc-a7e1-99acfd689df4 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:25.236973 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:25.319050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e424c35-b512-45fc-a7e1-99acfd689df4 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:25.361727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b53e4e-56c4-42ed-b74c-9b9666c15562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:25.362405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b53e4e-56c4-42ed-b74c-9b9666c15562 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:25.362698 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b53e4e-56c4-42ed-b74c-9b9666c15562 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:25.362968 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b53e4e-56c4-42ed-b74c-9b9666c15562 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:25.363618 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b53e4e-56c4-42ed-b74c-9b9666c15562 None admin] RBAC: Adding query filter params (name=compute) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:25.363924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b53e4e-56c4-42ed-b74c-9b9666c15562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:25.365356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b53e4e-56c4-42ed-b74c-9b9666c15562 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:25.371478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 502/1004] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Sep 7 12:55:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:25.378139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4d8ea-2d5c-4313-96f4-30dc27f8e854 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:25.503972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4d8ea-2d5c-4313-96f4-30dc27f8e854 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:25.505647 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:25.548846 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d76c75-1a95-4b62-8b45-9186dc3b2952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:25.549902 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d76c75-1a95-4b62-8b45-9186dc3b2952 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:25.550374 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d76c75-1a95-4b62-8b45-9186dc3b2952 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:25.550916 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d76c75-1a95-4b62-8b45-9186dc3b2952 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:25.551657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d76c75-1a95-4b62-8b45-9186dc3b2952 None admin] RBAC: Adding query filter params (type=compute) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:25.551965 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d76c75-1a95-4b62-8b45-9186dc3b2952 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:25.553484 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d76c75-1a95-4b62-8b45-9186dc3b2952 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:25.568098 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 503/1005] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Sep 7 12:55:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:25.569588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b53e4e-56c4-42ed-b74c-9b9666c15562 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:25.708536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b53e4e-56c4-42ed-b74c-9b9666c15562 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:25.726606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:25.756356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3415ac-8f19-4e3c-8bed-a24a4daacad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:25.757031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3415ac-8f19-4e3c-8bed-a24a4daacad3 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:25.757311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3415ac-8f19-4e3c-8bed-a24a4daacad3 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:25.757583 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3415ac-8f19-4e3c-8bed-a24a4daacad3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:25.758302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3415ac-8f19-4e3c-8bed-a24a4daacad3 None admin] RBAC: Adding query filter params (interface=public, service_id=6de7cad842ff4ab8af1b961314685b0f, region_id=RegionOne) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:25.758732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3415ac-8f19-4e3c-8bed-a24a4daacad3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:25.760028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3415ac-8f19-4e3c-8bed-a24a4daacad3 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:25.766199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 503/1006] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Sep 7 12:55:25 2022] GET /identity/v3/endpoints?service_id=6de7cad842ff4ab8af1b961314685b0f&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:25.772049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d76c75-1a95-4b62-8b45-9186dc3b2952 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:25.921669 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d76c75-1a95-4b62-8b45-9186dc3b2952 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:25.969920 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fea33-be20-43bc-8f45-a09dbced9e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:25.970573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fea33-be20-43bc-8f45-a09dbced9e9e None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:25.970854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fea33-be20-43bc-8f45-a09dbced9e9e None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:25.971147 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fea33-be20-43bc-8f45-a09dbced9e9e None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:25.971815 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fea33-be20-43bc-8f45-a09dbced9e9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:25.973302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fea33-be20-43bc-8f45-a09dbced9e9e None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:25.981529 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 504/1007] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Sep 7 12:55:25 2022] GET /identity/v3/services => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 12:55:27.239136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347450c-5163-465a-8bce-e7518d0e6524 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:27.239722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347450c-5163-465a-8bce-e7518d0e6524 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:27.239722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347450c-5163-465a-8bce-e7518d0e6524 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:27.241375 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 504/1008] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:27.247123 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895535d1-61a6-469c-8585-ee4cd8ab35f1 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:27.247735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895535d1-61a6-469c-8585-ee4cd8ab35f1 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:27.247735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895535d1-61a6-469c-8585-ee4cd8ab35f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:27.270625 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-895535d1-61a6-469c-8585-ee4cd8ab35f1 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:27.271862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-895535d1-61a6-469c-8585-ee4cd8ab35f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:27.302427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:27.342262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c33a87-2aae-4339-aeaa-553ad6daca23 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:27.342589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c33a87-2aae-4339-aeaa-553ad6daca23 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:27.342898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c33a87-2aae-4339-aeaa-553ad6daca23 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:27.344766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 505/1009] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:27.351458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b2139-8e93-4f03-a1bc-8d5e5a904192 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:27.351741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b2139-8e93-4f03-a1bc-8d5e5a904192 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:27.352014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b2139-8e93-4f03-a1bc-8d5e5a904192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:27.376075 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-0d5b2139-8e93-4f03-a1bc-8d5e5a904192 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:27.377364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0d5b2139-8e93-4f03-a1bc-8d5e5a904192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:27.379996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 505/1010] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:27 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:27.470988 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 506/1011] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:27 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:55:27.654699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895535d1-61a6-469c-8585-ee4cd8ab35f1 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:27.754317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b2139-8e93-4f03-a1bc-8d5e5a904192 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:27.783983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895535d1-61a6-469c-8585-ee4cd8ab35f1 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:27.826289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f6e28-08a3-468d-a5dc-d7e09b975b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:27.827262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f6e28-08a3-468d-a5dc-d7e09b975b57 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:27.827688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f6e28-08a3-468d-a5dc-d7e09b975b57 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:27.828141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f6e28-08a3-468d-a5dc-d7e09b975b57 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:27.829139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f6e28-08a3-468d-a5dc-d7e09b975b57 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:27.831111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f6e28-08a3-468d-a5dc-d7e09b975b57 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:27.856455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 506/1012] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Sep 7 12:55:27 2022] POST /identity/v3/services => generated 242 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:55:27.900401 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b2139-8e93-4f03-a1bc-8d5e5a904192 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:27.912468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:27.970017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cf0d4-8888-48f2-b482-5cfc1a08e2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:27.970671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cf0d4-8888-48f2-b482-5cfc1a08e2d0 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:27.970946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cf0d4-8888-48f2-b482-5cfc1a08e2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:27.971289 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cf0d4-8888-48f2-b482-5cfc1a08e2d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:27.972623 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cf0d4-8888-48f2-b482-5cfc1a08e2d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:27.974786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cf0d4-8888-48f2-b482-5cfc1a08e2d0 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:27.977655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 507/1013] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:27.984536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f6e28-08a3-468d-a5dc-d7e09b975b57 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:28.012127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:28.133969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f6e28-08a3-468d-a5dc-d7e09b975b57 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:28.198091 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e16ec6-67ba-4116-80ee-c52853760fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:28.199395 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e16ec6-67ba-4116-80ee-c52853760fd9 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:28.200086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e16ec6-67ba-4116-80ee-c52853760fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:28.200778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e16ec6-67ba-4116-80ee-c52853760fd9 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:28.202117 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e16ec6-67ba-4116-80ee-c52853760fd9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:28.205095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e16ec6-67ba-4116-80ee-c52853760fd9 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:28.238183 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe8f40-ef94-4e8e-97b3-21cad3564b94 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:28.238663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe8f40-ef94-4e8e-97b3-21cad3564b94 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:28.239105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe8f40-ef94-4e8e-97b3-21cad3564b94 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:28.241522 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 508/1014] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:28.248450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31398f4-5c9f-4b90-be5d-c100b6bff06a None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:28.248766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31398f4-5c9f-4b90-be5d-c100b6bff06a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:28.249006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31398f4-5c9f-4b90-be5d-c100b6bff06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:28.250999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 507/1015] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Sep 7 12:55:27 2022] POST /identity/v3/projects => generated 311 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:55:28.271605 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-a31398f4-5c9f-4b90-be5d-c100b6bff06a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:28.272917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a31398f4-5c9f-4b90-be5d-c100b6bff06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:28.355528 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 509/1016] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:28 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:55:28.635550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e16ec6-67ba-4116-80ee-c52853760fd9 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:28.719621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:28.776457 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e16ec6-67ba-4116-80ee-c52853760fd9 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:28.832926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e1927-de25-4c30-b336-112f54a6b20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:28.833578 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e1927-de25-4c30-b336-112f54a6b20d None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:28.833859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e1927-de25-4c30-b336-112f54a6b20d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:28.834127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e1927-de25-4c30-b336-112f54a6b20d None admin] PATH_INFO: `/v3/services/compute` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:28.834719 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e1927-de25-4c30-b336-112f54a6b20d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:28.836104 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e1927-de25-4c30-b336-112f54a6b20d None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-d87e1927-de25-4c30-b336-112f54a6b20d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:28.848422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:28.849845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:28.850785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:28.850785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:28.850785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:28.850785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:28.850785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:28.850785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:28.850785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:28.850785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:28.850785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:28.850785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:28.850785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:28.850785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:28.850785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:55:28.850785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:28.850785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 508/1017] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:55:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:28.858125 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31398f4-5c9f-4b90-be5d-c100b6bff06a None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:28.977975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31398f4-5c9f-4b90-be5d-c100b6bff06a None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:28.979673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:29.020730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2c185-0216-4897-9949-cc7525d8565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:29.021358 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2c185-0216-4897-9949-cc7525d8565e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:29.021626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2c185-0216-4897-9949-cc7525d8565e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:29.021898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2c185-0216-4897-9949-cc7525d8565e None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:29.022542 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2c185-0216-4897-9949-cc7525d8565e None admin] RBAC: Adding query filter params (name=compute) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:29.022845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2c185-0216-4897-9949-cc7525d8565e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:29.024255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2c185-0216-4897-9949-cc7525d8565e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:29.034721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 510/1018] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Sep 7 12:55:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:29.036429 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e1927-de25-4c30-b336-112f54a6b20d None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:29.147755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e1927-de25-4c30-b336-112f54a6b20d None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:29.184622 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc5866-fcf8-4b61-be2c-c34a8d1a218c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:29.185402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc5866-fcf8-4b61-be2c-c34a8d1a218c None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:29.185544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc5866-fcf8-4b61-be2c-c34a8d1a218c None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:29.186068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc5866-fcf8-4b61-be2c-c34a8d1a218c None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:29.186668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc5866-fcf8-4b61-be2c-c34a8d1a218c None admin] RBAC: Adding query filter params (type=compute) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:29.186849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc5866-fcf8-4b61-be2c-c34a8d1a218c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:29.188434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc5866-fcf8-4b61-be2c-c34a8d1a218c None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:29.190781 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:29.200097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 509/1019] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Sep 7 12:55:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:29.202022 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2c185-0216-4897-9949-cc7525d8565e None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:29.326323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2c185-0216-4897-9949-cc7525d8565e None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:29.364897 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419df68-700a-4fdc-892c-a48f4fc532b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:29.365503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419df68-700a-4fdc-892c-a48f4fc532b9 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:29.365752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419df68-700a-4fdc-892c-a48f4fc532b9 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:29.366048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419df68-700a-4fdc-892c-a48f4fc532b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:29.366720 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419df68-700a-4fdc-892c-a48f4fc532b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:29.368103 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419df68-700a-4fdc-892c-a48f4fc532b9 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:29.400414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 511/1020] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 12:55:29 2022] POST /identity/v3/endpoints => generated 334 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:55:30.179753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205f110-8f26-4c6d-b5e8-77dea589b398 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:30.180275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205f110-8f26-4c6d-b5e8-77dea589b398 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:30.180275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205f110-8f26-4c6d-b5e8-77dea589b398 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:30.184401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 510/1021] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:30.187419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7348ea-3044-4aef-9216-748c26f9a2ca None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:30.187810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7348ea-3044-4aef-9216-748c26f9a2ca None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:30.188085 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7348ea-3044-4aef-9216-748c26f9a2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:30.207989 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-1a7348ea-3044-4aef-9216-748c26f9a2ca None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:30.209225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1a7348ea-3044-4aef-9216-748c26f9a2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:30.228589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:30.300422 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 512/1022] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:30.598301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205f110-8f26-4c6d-b5e8-77dea589b398 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:30.608315 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256ce98-0a5c-4464-b8b9-30e18817443a None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:30.609200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256ce98-0a5c-4464-b8b9-30e18817443a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:30.609200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256ce98-0a5c-4464-b8b9-30e18817443a None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:30.610067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 513/1023] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:55:30.616101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed81c9-0a34-4b2b-b7c0-ee1193ee954e None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:30.616402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed81c9-0a34-4b2b-b7c0-ee1193ee954e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:30.616699 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed81c9-0a34-4b2b-b7c0-ee1193ee954e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:30.636849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-02ed81c9-0a34-4b2b-b7c0-ee1193ee954e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:30.638048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-02ed81c9-0a34-4b2b-b7c0-ee1193ee954e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:30.713377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205f110-8f26-4c6d-b5e8-77dea589b398 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:30.751568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 514/1024] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:55:30.755964 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e8a60-1a35-4124-8b59-41de0e4c4253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:30.756664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e8a60-1a35-4124-8b59-41de0e4c4253 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:30.756946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e8a60-1a35-4124-8b59-41de0e4c4253 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:30.757213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e8a60-1a35-4124-8b59-41de0e4c4253 None admin] PATH_INFO: `/v3/services/image` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:30.757804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e8a60-1a35-4124-8b59-41de0e4c4253 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:30.759294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e8a60-1a35-4124-8b59-41de0e4c4253 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-d96e8a60-1a35-4124-8b59-41de0e4c4253 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:30.770398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:30.771520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:30.772559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:30.772559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:30.772559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:30.772559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:30.772559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:30.772559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:30.772559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:30.772559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:30.772559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:30.772559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:30.772559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:30.772559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:30.772559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:55:30.772559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:30.772559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 511/1025] 10.222.0.30 () {56 vars in 1105 bytes} [Wed Sep 7 12:55:30 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:30.777603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed81c9-0a34-4b2b-b7c0-ee1193ee954e None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:30.873751 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:30.903444 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed81c9-0a34-4b2b-b7c0-ee1193ee954e None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:30.948526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5c06f-d719-4481-bba3-f8423e8643d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:30.949658 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5c06f-d719-4481-bba3-f8423e8643d0 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:30.950152 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5c06f-d719-4481-bba3-f8423e8643d0 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:30.950630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5c06f-d719-4481-bba3-f8423e8643d0 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:30.951493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5c06f-d719-4481-bba3-f8423e8643d0 None admin] RBAC: Adding query filter params (name=image) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:30.952009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5c06f-d719-4481-bba3-f8423e8643d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:30.953673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5c06f-d719-4481-bba3-f8423e8643d0 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:30.960485 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 515/1026] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:30.966557 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e8a60-1a35-4124-8b59-41de0e4c4253 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:31.034927 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5c06f-d719-4481-bba3-f8423e8643d0 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:31.050219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:31.098532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e8a60-1a35-4124-8b59-41de0e4c4253 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:31.155088 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da37662-2e67-4220-8ed2-8bc7209768f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:31.155628 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da37662-2e67-4220-8ed2-8bc7209768f1 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:31.155904 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da37662-2e67-4220-8ed2-8bc7209768f1 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:31.156173 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da37662-2e67-4220-8ed2-8bc7209768f1 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:31.156881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da37662-2e67-4220-8ed2-8bc7209768f1 None admin] RBAC: Adding query filter params (type=image) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:31.157187 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da37662-2e67-4220-8ed2-8bc7209768f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:31.158589 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da37662-2e67-4220-8ed2-8bc7209768f1 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:31.172422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 512/1027] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:31.175657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da37662-2e67-4220-8ed2-8bc7209768f1 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:31.177312 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5c06f-d719-4481-bba3-f8423e8643d0 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:31.222261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40af7f-54c4-4456-9d2e-ee36444ad4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:31.223288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40af7f-54c4-4456-9d2e-ee36444ad4ec None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:31.223758 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40af7f-54c4-4456-9d2e-ee36444ad4ec None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:31.224228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40af7f-54c4-4456-9d2e-ee36444ad4ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:31.226106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40af7f-54c4-4456-9d2e-ee36444ad4ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:31.229446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40af7f-54c4-4456-9d2e-ee36444ad4ec None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:31.229863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 516/1028] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:31.235770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40af7f-54c4-4456-9d2e-ee36444ad4ec None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:31.254064 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:31.315692 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da37662-2e67-4220-8ed2-8bc7209768f1 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:31.353698 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:31.363955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778d251-ad93-4203-8051-fd6bc311136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:31.364684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778d251-ad93-4203-8051-fd6bc311136f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:31.364956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778d251-ad93-4203-8051-fd6bc311136f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:31.365223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778d251-ad93-4203-8051-fd6bc311136f None admin] PATH_INFO: `/v3/endpoints` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:31.365948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778d251-ad93-4203-8051-fd6bc311136f None admin] RBAC: Adding query filter params (interface=public, service_id=1ff9164295ff4098ae005871e9968207, region_id=RegionOne) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:31.366261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778d251-ad93-4203-8051-fd6bc311136f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:31.367713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778d251-ad93-4203-8051-fd6bc311136f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:31.376084 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40af7f-54c4-4456-9d2e-ee36444ad4ec None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:31.377360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 513/1029] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Sep 7 12:55:31 2022] GET /identity/v3/endpoints?service_id=1ff9164295ff4098ae005871e9968207&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:31.385056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778d251-ad93-4203-8051-fd6bc311136f None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:31.425870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78405e7-9a30-4051-8d5c-9980440c19e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:31.426408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78405e7-9a30-4051-8d5c-9980440c19e7 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:31.426683 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78405e7-9a30-4051-8d5c-9980440c19e7 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:31.426959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78405e7-9a30-4051-8d5c-9980440c19e7 None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:31.427634 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78405e7-9a30-4051-8d5c-9980440c19e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:31.429129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78405e7-9a30-4051-8d5c-9980440c19e7 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:31.466576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 517/1030] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:55:31 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:55:31.528631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778d251-ad93-4203-8051-fd6bc311136f None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:31.571993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1187606-5e77-4aac-8afa-ca6088b9941f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:31.572649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1187606-5e77-4aac-8afa-ca6088b9941f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:31.572925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1187606-5e77-4aac-8afa-ca6088b9941f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:31.573190 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1187606-5e77-4aac-8afa-ca6088b9941f None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:31.573806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1187606-5e77-4aac-8afa-ca6088b9941f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:31.575215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1187606-5e77-4aac-8afa-ca6088b9941f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:31.584745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 514/1031] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Sep 7 12:55:31 2022] GET /identity/v3/services => generated 1957 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 12:55:31.820448 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be4d85-9138-489c-b6ab-b013e03b56ac None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:31.820983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be4d85-9138-489c-b6ab-b013e03b56ac None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:31.821432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be4d85-9138-489c-b6ab-b013e03b56ac None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:31.824151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 518/1032] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:31.833148 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b32548-881e-4f01-8166-3821e9b9f9c8 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:31.833739 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b32548-881e-4f01-8166-3821e9b9f9c8 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:31.834197 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b32548-881e-4f01-8166-3821e9b9f9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:31.855957 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-d5b32548-881e-4f01-8166-3821e9b9f9c8 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:31.857246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d5b32548-881e-4f01-8166-3821e9b9f9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:31.932932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:31.955107 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 515/1033] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:32.249019 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be4d85-9138-489c-b6ab-b013e03b56ac None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:32.362488 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:32.439086 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be4d85-9138-489c-b6ab-b013e03b56ac None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:32.505361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24590bbf-541e-434d-a68a-ba0e924d51ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:32.506382 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24590bbf-541e-434d-a68a-ba0e924d51ec None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:32.506886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24590bbf-541e-434d-a68a-ba0e924d51ec None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:32.507383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24590bbf-541e-434d-a68a-ba0e924d51ec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:32.531290 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24590bbf-541e-434d-a68a-ba0e924d51ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-24590bbf-541e-434d-a68a-ba0e924d51ec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:55:32.541859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:32.542917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:32.543817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:32.543817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:32.543817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:32.543817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:32.543817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:55:32.543817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:55:32.543817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:55:32.543817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:55:32.543817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:55:32.543817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:55:32.543817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:55:32.543817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:32.548887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 519/1034] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Sep 7 12:55:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:32.555174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b32548-881e-4f01-8166-3821e9b9f9c8 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:32.709970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b32548-881e-4f01-8166-3821e9b9f9c8 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:32.745656 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88777a09-00c4-4bf9-84d2-0f8d0ad674f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:32.746263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88777a09-00c4-4bf9-84d2-0f8d0ad674f0 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:32.746541 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88777a09-00c4-4bf9-84d2-0f8d0ad674f0 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:32.746810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88777a09-00c4-4bf9-84d2-0f8d0ad674f0 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:32.747473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88777a09-00c4-4bf9-84d2-0f8d0ad674f0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:32.747773 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88777a09-00c4-4bf9-84d2-0f8d0ad674f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:32.749182 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88777a09-00c4-4bf9-84d2-0f8d0ad674f0 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:32.758520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 516/1035] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Sep 7 12:55:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:32.764132 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24590bbf-541e-434d-a68a-ba0e924d51ec None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:32.879219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24590bbf-541e-434d-a68a-ba0e924d51ec None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:32.910611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:32.921606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f20105-dbad-4d2c-9ee5-caec8c1f2683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:32.922339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f20105-dbad-4d2c-9ee5-caec8c1f2683 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:32.922624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f20105-dbad-4d2c-9ee5-caec8c1f2683 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:32.922902 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f20105-dbad-4d2c-9ee5-caec8c1f2683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:32.946824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f20105-dbad-4d2c-9ee5-caec8c1f2683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:32.949734 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f20105-dbad-4d2c-9ee5-caec8c1f2683 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-72f20105-dbad-4d2c-9ee5-caec8c1f2683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:32.972794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:32.973883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:32.974799 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:32.974799 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:32.974799 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:32.974799 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 520/1036] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:32.980684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88777a09-00c4-4bf9-84d2-0f8d0ad674f0 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:33.043241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:33.110807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88777a09-00c4-4bf9-84d2-0f8d0ad674f0 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:33.164257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dbea3-d91f-4a57-a112-61920619b251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:33.165074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dbea3-d91f-4a57-a112-61920619b251 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:33.165275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dbea3-d91f-4a57-a112-61920619b251 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:33.165553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dbea3-d91f-4a57-a112-61920619b251 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:33.166231 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dbea3-d91f-4a57-a112-61920619b251 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:33.166536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dbea3-d91f-4a57-a112-61920619b251 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:33.167994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dbea3-d91f-4a57-a112-61920619b251 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:33.188263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 517/1037] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:33.189571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f20105-dbad-4d2c-9ee5-caec8c1f2683 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:33.320647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f20105-dbad-4d2c-9ee5-caec8c1f2683 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:33.366487 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99a015-6898-47d6-b3bd-45a45ef90631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:33.367147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99a015-6898-47d6-b3bd-45a45ef90631 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:33.367429 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99a015-6898-47d6-b3bd-45a45ef90631 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:33.367764 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99a015-6898-47d6-b3bd-45a45ef90631 None admin] PATH_INFO: `/v3/users/nova` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:33.378357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99a015-6898-47d6-b3bd-45a45ef90631 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:33.379782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99a015-6898-47d6-b3bd-45a45ef90631 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-7b99a015-6898-47d6-b3bd-45a45ef90631 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:55:33.392731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:33.396224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:33.397655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:33.397655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:33.397655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:55:33.397655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:55:33.397655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:55:33.397655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:55:33.397655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:55:33.397655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:55:33.397655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:55:33.397655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:33.398775 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 521/1038] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Sep 7 12:55:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:33.400733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dbea3-d91f-4a57-a112-61920619b251 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:33.596542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dbea3-d91f-4a57-a112-61920619b251 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:33.612607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:33.661705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420d776-ada5-45c9-a5ba-58be40145c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:33.662870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420d776-ada5-45c9-a5ba-58be40145c31 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:33.662870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420d776-ada5-45c9-a5ba-58be40145c31 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:33.663970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420d776-ada5-45c9-a5ba-58be40145c31 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:33.664692 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420d776-ada5-45c9-a5ba-58be40145c31 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:33.665078 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420d776-ada5-45c9-a5ba-58be40145c31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:33.667802 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420d776-ada5-45c9-a5ba-58be40145c31 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:33.699899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 518/1039] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Sep 7 12:55:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:33.708653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99a015-6898-47d6-b3bd-45a45ef90631 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:33.757889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:33.835269 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99a015-6898-47d6-b3bd-45a45ef90631 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:33.836971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ad3a7-827f-4953-821c-dc928ba40875 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:33.837392 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ad3a7-827f-4953-821c-dc928ba40875 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:33.837794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ad3a7-827f-4953-821c-dc928ba40875 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:33.840032 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 519/1040] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:33.849133 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b1f5b-06e3-469b-a220-5698429094d4 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:33.849943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b1f5b-06e3-469b-a220-5698429094d4 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:33.850513 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b1f5b-06e3-469b-a220-5698429094d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:33.885452 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-c85b1f5b-06e3-469b-a220-5698429094d4 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:33.887072 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c85b1f5b-06e3-469b-a220-5698429094d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:33.889335 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e8caa-64c6-46c5-950d-1a551e39fbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:33.890038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e8caa-64c6-46c5-950d-1a551e39fbd7 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:33.890337 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e8caa-64c6-46c5-950d-1a551e39fbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:33.890592 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e8caa-64c6-46c5-950d-1a551e39fbd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:33.973184 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 520/1041] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:33.977810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666274e-47b0-4df4-91f0-96b388287438 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:33.978104 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666274e-47b0-4df4-91f0-96b388287438 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:33.978355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666274e-47b0-4df4-91f0-96b388287438 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:33.980824 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 521/1042] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:33.983111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e8caa-64c6-46c5-950d-1a551e39fbd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:33.985007 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e8caa-64c6-46c5-950d-1a551e39fbd7 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:33.986838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a204-d0eb-4bcc-babd-0c797c0b0654 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:33.987542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a204-d0eb-4bcc-babd-0c797c0b0654 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:33.987818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a204-d0eb-4bcc-babd-0c797c0b0654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:34.011276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-6155a204-d0eb-4bcc-babd-0c797c0b0654 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:34.012517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6155a204-d0eb-4bcc-babd-0c797c0b0654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:34.041124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:34.112485 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 522/1043] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:34.132074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 522/1044] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:55:33 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:55:34.139621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155a204-d0eb-4bcc-babd-0c797c0b0654 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:34.181388 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:34.262992 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e8caa-64c6-46c5-950d-1a551e39fbd7 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:34.283222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155a204-d0eb-4bcc-babd-0c797c0b0654 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:34.339358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9640b3-99b4-4126-bb57-bff57dd28be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:34.340397 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9640b3-99b4-4126-bb57-bff57dd28be3 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:34.340695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9640b3-99b4-4126-bb57-bff57dd28be3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:34.341126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9640b3-99b4-4126-bb57-bff57dd28be3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:34.354903 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9640b3-99b4-4126-bb57-bff57dd28be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:34.356470 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9640b3-99b4-4126-bb57-bff57dd28be3 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-2e9640b3-99b4-4126-bb57-bff57dd28be3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:34.377854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:34.379615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:34.380693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:34.380693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:34.380693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:34.380693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 523/1045] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:34.380693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9640b3-99b4-4126-bb57-bff57dd28be3 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:34.429308 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e8caa-64c6-46c5-950d-1a551e39fbd7 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:34.471181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b120df-5d9e-41fc-a452-a0a7498810f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:34.472434 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b120df-5d9e-41fc-a452-a0a7498810f8 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:34.472729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b120df-5d9e-41fc-a452-a0a7498810f8 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:34.473000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b120df-5d9e-41fc-a452-a0a7498810f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:34.480648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:34.485528 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:34.487053 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b120df-5d9e-41fc-a452-a0a7498810f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-48b120df-5d9e-41fc-a452-a0a7498810f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:55:34.492278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:34.493481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:34.494443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:34.494443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:34.494443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:34.494443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:34.494443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:55:34.494443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:55:34.494443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:55:34.494443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:55:34.494443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:55:34.494443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:55:34.494443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:55:34.494443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:34.494443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 523/1046] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:55:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:34.494443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b120df-5d9e-41fc-a452-a0a7498810f8 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:34.516688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9640b3-99b4-4126-bb57-bff57dd28be3 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:34.556355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b91b8-917b-41b6-a0a1-cebda1ebccb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:34.557063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b91b8-917b-41b6-a0a1-cebda1ebccb1 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:34.557338 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b91b8-917b-41b6-a0a1-cebda1ebccb1 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:34.557610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b91b8-917b-41b6-a0a1-cebda1ebccb1 None admin] PATH_INFO: `/v3/services/image` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:34.558199 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b91b8-917b-41b6-a0a1-cebda1ebccb1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:34.559603 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b91b8-917b-41b6-a0a1-cebda1ebccb1 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-160b91b8-917b-41b6-a0a1-cebda1ebccb1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:34.569227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:34.571178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:34.573241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:34.573241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:34.573241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:34.573241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:34.573241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:34.573241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:34.573241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:34.573241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:34.573241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:34.573241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:34.573241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:55:34.573241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:55:34.573241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:55:34.573241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:34.573241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 524/1047] 10.222.0.30 () {56 vars in 1105 bytes} [Wed Sep 7 12:55:34 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:34.575575 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b91b8-917b-41b6-a0a1-cebda1ebccb1 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:34.635075 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b120df-5d9e-41fc-a452-a0a7498810f8 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:34.671472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd5ac6-2e01-45b5-8000-42ab9c1b92d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:34.672088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd5ac6-2e01-45b5-8000-42ab9c1b92d0 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:34.672340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd5ac6-2e01-45b5-8000-42ab9c1b92d0 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:34.672677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd5ac6-2e01-45b5-8000-42ab9c1b92d0 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:34.673317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd5ac6-2e01-45b5-8000-42ab9c1b92d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:34.673620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd5ac6-2e01-45b5-8000-42ab9c1b92d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:34.675057 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd5ac6-2e01-45b5-8000-42ab9c1b92d0 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:34.687350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 524/1048] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:34.688191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd5ac6-2e01-45b5-8000-42ab9c1b92d0 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:34.689289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b91b8-917b-41b6-a0a1-cebda1ebccb1 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:34.727705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc5e5f-a324-4062-bdd5-2dbdf7a197af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:34.728323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc5e5f-a324-4062-bdd5-2dbdf7a197af None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:34.728631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc5e5f-a324-4062-bdd5-2dbdf7a197af None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:34.728898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc5e5f-a324-4062-bdd5-2dbdf7a197af None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:34.729571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc5e5f-a324-4062-bdd5-2dbdf7a197af None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:34.729872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc5e5f-a324-4062-bdd5-2dbdf7a197af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:34.731253 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc5e5f-a324-4062-bdd5-2dbdf7a197af None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:34.741112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 525/1049] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:55:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:34.741921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc5e5f-a324-4062-bdd5-2dbdf7a197af None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:34.745739 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:34.760176 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:34.802311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd5ac6-2e01-45b5-8000-42ab9c1b92d0 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:34.838925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb0ac1-c833-4c1a-aaed-69b704af0a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:34.839577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb0ac1-c833-4c1a-aaed-69b704af0a65 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:34.839858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb0ac1-c833-4c1a-aaed-69b704af0a65 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:34.840129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb0ac1-c833-4c1a-aaed-69b704af0a65 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:34.840828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb0ac1-c833-4c1a-aaed-69b704af0a65 None admin] RBAC: Adding query filter params (name=image) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:34.841138 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb0ac1-c833-4c1a-aaed-69b704af0a65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:34.842533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb0ac1-c833-4c1a-aaed-69b704af0a65 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:34.848019 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 525/1050] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:34.848900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb0ac1-c833-4c1a-aaed-69b704af0a65 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:34.853046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc5e5f-a324-4062-bdd5-2dbdf7a197af None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:34.889750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c77bc-1646-4028-9ee5-c22fe653792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:34.890291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c77bc-1646-4028-9ee5-c22fe653792a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:34.890588 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c77bc-1646-4028-9ee5-c22fe653792a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:34.890842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c77bc-1646-4028-9ee5-c22fe653792a None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:34.897985 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c77bc-1646-4028-9ee5-c22fe653792a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:34.899450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c77bc-1646-4028-9ee5-c22fe653792a None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:34.912331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-556c77bc-1646-4028-9ee5-c22fe653792a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:34.912331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:34.912331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:34.912331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:34.912331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:34.912331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:34.912331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:34.912331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:34.912331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:34.912331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:34.912331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:34.912331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:34.912331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:55:34.912331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:55:34.912331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:34.913378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:34.914542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:55:34.914542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:55:34.914542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:55:34.914542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:55:34.914542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:55:34.914542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:55:34.914542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:34.914542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:34.914542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 526/1051] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:55:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:34.914542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c77bc-1646-4028-9ee5-c22fe653792a None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:34.963009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb0ac1-c833-4c1a-aaed-69b704af0a65 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:34.981036 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:34.987999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:35.002889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1c8bb-863e-40aa-960c-b3c9645b8ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:35.003557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1c8bb-863e-40aa-960c-b3c9645b8ca1 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:35.003823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1c8bb-863e-40aa-960c-b3c9645b8ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:35.004089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1c8bb-863e-40aa-960c-b3c9645b8ca1 None admin] PATH_INFO: `/v3/users/7ee631b066fa4087936ed61cb643cfc5` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:35.018295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1c8bb-863e-40aa-960c-b3c9645b8ca1 None admin] RBAC: Authorizing `identity:get_user(user_id=7ee631b066fa4087936ed61cb643cfc5)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:35.019794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1c8bb-863e-40aa-960c-b3c9645b8ca1 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:35.021550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 526/1052] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:55:34 2022] GET /identity/v3/users/7ee631b066fa4087936ed61cb643cfc5 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:35.021757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c77bc-1646-4028-9ee5-c22fe653792a None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:35.022324 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1c8bb-863e-40aa-960c-b3c9645b8ca1 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:35.058166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb5f72-4af2-44e1-98a1-125002366dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:35.058776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb5f72-4af2-44e1-98a1-125002366dfa None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:35.059055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb5f72-4af2-44e1-98a1-125002366dfa None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:35.059285 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb5f72-4af2-44e1-98a1-125002366dfa None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:35.059915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb5f72-4af2-44e1-98a1-125002366dfa None admin] RBAC: Adding query filter params (type=image) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:35.060221 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb5f72-4af2-44e1-98a1-125002366dfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:35.061641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb5f72-4af2-44e1-98a1-125002366dfa None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:35.066709 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 527/1053] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:35.067494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb5f72-4af2-44e1-98a1-125002366dfa None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:35.134495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1c8bb-863e-40aa-960c-b3c9645b8ca1 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:35.170562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df269e65-7f12-490f-83f6-6c45fef77c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:35.171085 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269e65-7f12-490f-83f6-6c45fef77c9f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:35.171813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269e65-7f12-490f-83f6-6c45fef77c9f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:35.171813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269e65-7f12-490f-83f6-6c45fef77c9f None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:35.172257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb5f72-4af2-44e1-98a1-125002366dfa None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:35.172391 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df269e65-7f12-490f-83f6-6c45fef77c9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:35.172653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df269e65-7f12-490f-83f6-6c45fef77c9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:35.174111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df269e65-7f12-490f-83f6-6c45fef77c9f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:35.187095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 527/1054] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:55:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:35.188063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df269e65-7f12-490f-83f6-6c45fef77c9f None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:35.200794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:35.210615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c96cb3-5f02-4e4f-b3dc-40aa24d039b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:35.211234 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c96cb3-5f02-4e4f-b3dc-40aa24d039b8 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:35.211511 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c96cb3-5f02-4e4f-b3dc-40aa24d039b8 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:35.211780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c96cb3-5f02-4e4f-b3dc-40aa24d039b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:35.239649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:35.285892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c96cb3-5f02-4e4f-b3dc-40aa24d039b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:35.287371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c96cb3-5f02-4e4f-b3dc-40aa24d039b8 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:35.304694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df269e65-7f12-490f-83f6-6c45fef77c9f None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:35.341527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7626fc-7dc6-43cb-b009-0a8a75072583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:35.342150 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7626fc-7dc6-43cb-b009-0a8a75072583 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:35.342431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7626fc-7dc6-43cb-b009-0a8a75072583 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:35.342703 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7626fc-7dc6-43cb-b009-0a8a75072583 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:35.343377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7626fc-7dc6-43cb-b009-0a8a75072583 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:35.344803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7626fc-7dc6-43cb-b009-0a8a75072583 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:35.367203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 528/1055] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 12:55:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:55:35.368044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7626fc-7dc6-43cb-b009-0a8a75072583 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:35.407390 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 528/1056] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:55:35 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:55:35.413807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c96cb3-5f02-4e4f-b3dc-40aa24d039b8 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:35.447629 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:35.504443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:35.522392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7626fc-7dc6-43cb-b009-0a8a75072583 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:35.534067 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c96cb3-5f02-4e4f-b3dc-40aa24d039b8 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:35.567056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b58064-92c0-49f7-a9f6-ce69c6316a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:35.567680 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b58064-92c0-49f7-a9f6-ce69c6316a6b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:35.567960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b58064-92c0-49f7-a9f6-ce69c6316a6b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:35.568229 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b58064-92c0-49f7-a9f6-ce69c6316a6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:35.569081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b58064-92c0-49f7-a9f6-ce69c6316a6b None admin] RBAC: Adding query filter params (role.id=5ffeac2dbda44d9eac33c133a025f37e, scope.project.id=3381c0688581489b903e641f91914839, user.id=fbe8fa8ab8094aa69933398280810692) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:35.569387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b58064-92c0-49f7-a9f6-ce69c6316a6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:35.570861 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b58064-92c0-49f7-a9f6-ce69c6316a6b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:35.576917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 529/1057] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:55:35 2022] GET /identity/v3/role_assignments?user.id=fbe8fa8ab8094aa69933398280810692&scope.project.id=3381c0688581489b903e641f91914839&role.id=5ffeac2dbda44d9eac33c133a025f37e => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:35.577105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36d0df-e428-4b06-a9bc-bf637d04d8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:35.577758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36d0df-e428-4b06-a9bc-bf637d04d8d4 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:35.578035 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36d0df-e428-4b06-a9bc-bf637d04d8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:35.578301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36d0df-e428-4b06-a9bc-bf637d04d8d4 None admin] PATH_INFO: `/v3/projects/0f099db852624d36b747e0868f04f72f` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:35.579495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36d0df-e428-4b06-a9bc-bf637d04d8d4 None admin] RBAC: Authorizing `identity:get_project(project_id=0f099db852624d36b747e0868f04f72f)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:35.581839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36d0df-e428-4b06-a9bc-bf637d04d8d4 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:35.584420 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 529/1058] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:55:35 2022] GET /identity/v3/projects/0f099db852624d36b747e0868f04f72f => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:35.590403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b58064-92c0-49f7-a9f6-ce69c6316a6b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:35.719879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b58064-92c0-49f7-a9f6-ce69c6316a6b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:35.759905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2e0f0-f3f1-4ac6-a845-51b10b18c30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:35.760550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2e0f0-f3f1-4ac6-a845-51b10b18c30f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:35.760889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2e0f0-f3f1-4ac6-a845-51b10b18c30f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:35.761231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2e0f0-f3f1-4ac6-a845-51b10b18c30f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:35.762058 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2e0f0-f3f1-4ac6-a845-51b10b18c30f None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=0f099db852624d36b747e0868f04f72f, user.id=7ee631b066fa4087936ed61cb643cfc5) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:35.762427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2e0f0-f3f1-4ac6-a845-51b10b18c30f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:35.764026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2e0f0-f3f1-4ac6-a845-51b10b18c30f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:35.770750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 530/1059] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:55:35 2022] GET /identity/v3/role_assignments?user.id=7ee631b066fa4087936ed61cb643cfc5&scope.project.id=0f099db852624d36b747e0868f04f72f&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:37.883275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91dd45-492a-46f9-8e3b-5e74ce232ab1 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:37.883844 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91dd45-492a-46f9-8e3b-5e74ce232ab1 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:37.883844 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91dd45-492a-46f9-8e3b-5e74ce232ab1 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:37.885395 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 530/1060] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:55:37.891023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f33e71-d421-40b0-8ae1-32fbb97795a8 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:37.891530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f33e71-d421-40b0-8ae1-32fbb97795a8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:37.891605 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f33e71-d421-40b0-8ae1-32fbb97795a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:37.901087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa737f-180a-40a9-abfd-bad3a7da414a None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:37.901434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa737f-180a-40a9-abfd-bad3a7da414a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:37.901657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa737f-180a-40a9-abfd-bad3a7da414a None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:37.903219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 531/1061] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:55:37.909994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bae45-b4b4-4019-93f0-2bb1a9920aba None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:37.910287 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bae45-b4b4-4019-93f0-2bb1a9920aba None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:37.910617 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bae45-b4b4-4019-93f0-2bb1a9920aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:37.914778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-f1f33e71-d421-40b0-8ae1-32fbb97795a8 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:37.916227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f1f33e71-d421-40b0-8ae1-32fbb97795a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:37.931173 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-351bae45-b4b4-4019-93f0-2bb1a9920aba None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:37.932448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-351bae45-b4b4-4019-93f0-2bb1a9920aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:37.935932 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:38.016999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 531/1062] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:38.017448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 532/1063] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:38.194355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f377e9-28ea-49f9-a206-92a4fba08fe3 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:38.194537 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f377e9-28ea-49f9-a206-92a4fba08fe3 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:38.194849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f377e9-28ea-49f9-a206-92a4fba08fe3 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:38.196433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 532/1064] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:38.203163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e3861-062a-4b79-991d-5da30d3ec603 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:38.203440 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e3861-062a-4b79-991d-5da30d3ec603 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:38.203859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e3861-062a-4b79-991d-5da30d3ec603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:38.231522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-811e3861-062a-4b79-991d-5da30d3ec603 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:38.233010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-811e3861-062a-4b79-991d-5da30d3ec603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:38.267758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:38.328080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 533/1065] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:55:38.334932 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f377e9-28ea-49f9-a206-92a4fba08fe3 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:38.362362 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e3861-062a-4b79-991d-5da30d3ec603 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:38.479228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f377e9-28ea-49f9-a206-92a4fba08fe3 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:38.513008 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e3861-062a-4b79-991d-5da30d3ec603 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:38.522781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3d349-af84-4ebc-848a-542644e214c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:38.523546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d349-af84-4ebc-848a-542644e214c3 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:38.523911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d349-af84-4ebc-848a-542644e214c3 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:38.524091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d349-af84-4ebc-848a-542644e214c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:38.545262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:38.548831 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80026f-c58d-4875-98de-c18f63692b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:38.549497 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80026f-c58d-4875-98de-c18f63692b21 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:38.549853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80026f-c58d-4875-98de-c18f63692b21 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:38.550154 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80026f-c58d-4875-98de-c18f63692b21 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:38.560960 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80026f-c58d-4875-98de-c18f63692b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-2b80026f-c58d-4875-98de-c18f63692b21 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:55:38.565996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:38.566958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:38.567811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:38.567811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:38.567811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:38.567811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:38.567811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:55:38.567811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:55:38.567811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:55:38.567811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:55:38.567811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:55:38.567811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:55:38.567811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:55:38.567811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:38.567811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 534/1066] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Sep 7 12:55:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:38.573361 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80026f-c58d-4875-98de-c18f63692b21 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:38.592902 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:38.608181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3d349-af84-4ebc-848a-542644e214c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:38.609820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3d349-af84-4ebc-848a-542644e214c3 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:38.680564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80026f-c58d-4875-98de-c18f63692b21 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:38.715159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22545ca-f0f5-4a97-b1e7-f289e6d2b35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:38.715762 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22545ca-f0f5-4a97-b1e7-f289e6d2b35f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:38.716036 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22545ca-f0f5-4a97-b1e7-f289e6d2b35f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:38.716302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22545ca-f0f5-4a97-b1e7-f289e6d2b35f None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:38.716987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22545ca-f0f5-4a97-b1e7-f289e6d2b35f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:38.717285 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22545ca-f0f5-4a97-b1e7-f289e6d2b35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:38.717523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 533/1067] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:55:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:55:38.718378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3d349-af84-4ebc-848a-542644e214c3 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:38.718661 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22545ca-f0f5-4a97-b1e7-f289e6d2b35f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:38.727620 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 535/1068] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Sep 7 12:55:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:38.728280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22545ca-f0f5-4a97-b1e7-f289e6d2b35f None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:38.772956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:38.815467 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:38.823656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3d349-af84-4ebc-848a-542644e214c3 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:38.838481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22545ca-f0f5-4a97-b1e7-f289e6d2b35f None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:38.858699 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d00f63-46ac-4669-8bc0-fe9dd70b6577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:38.859378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d00f63-46ac-4669-8bc0-fe9dd70b6577 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:38.859660 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d00f63-46ac-4669-8bc0-fe9dd70b6577 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:38.859932 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d00f63-46ac-4669-8bc0-fe9dd70b6577 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:38.870772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d00f63-46ac-4669-8bc0-fe9dd70b6577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:55:38.874733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a533760-7db5-43f4-9b82-71e64b83f4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:38.875665 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a533760-7db5-43f4-9b82-71e64b83f4ec None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-65d00f63-46ac-4669-8bc0-fe9dd70b6577 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:55:38.875908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:38.877031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:38.877921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:38.877921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:38.877921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:38.877921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:38.877921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:55:38.877921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:55:38.877921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:55:38.877921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:55:38.877921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:55:38.877921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:55:38.877921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:55:38.877921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:38.878706 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a533760-7db5-43f4-9b82-71e64b83f4ec None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:38.878706 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a533760-7db5-43f4-9b82-71e64b83f4ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:38.878859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 534/1069] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:55:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:38.878859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d00f63-46ac-4669-8bc0-fe9dd70b6577 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:38.890583 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a533760-7db5-43f4-9b82-71e64b83f4ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:38.892087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a533760-7db5-43f4-9b82-71e64b83f4ec None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-0a533760-7db5-43f4-9b82-71e64b83f4ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:38.906797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:38.907827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:38.908913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:38.908913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:38.908913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:38.908913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 536/1070] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:38.908913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a533760-7db5-43f4-9b82-71e64b83f4ec None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:38.994828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d00f63-46ac-4669-8bc0-fe9dd70b6577 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:39.006414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:39.020692 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a533760-7db5-43f4-9b82-71e64b83f4ec None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:39.030296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe216b0-4ce7-487c-bca3-572e64336f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:39.030859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe216b0-4ce7-487c-bca3-572e64336f81 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:39.031138 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe216b0-4ce7-487c-bca3-572e64336f81 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:39.031406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe216b0-4ce7-487c-bca3-572e64336f81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:39.041693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe216b0-4ce7-487c-bca3-572e64336f81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:39.043160 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe216b0-4ce7-487c-bca3-572e64336f81 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:39.050806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:39.057595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd47322-c915-44f5-acd2-d7aacd39483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-1fe216b0-4ce7-487c-bca3-572e64336f81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:39.057893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:39.058823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:39.059760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:39.059760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:39.059760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:39.059945 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd47322-c915-44f5-acd2-d7aacd39483d None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:39.059945 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd47322-c915-44f5-acd2-d7aacd39483d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:39.059945 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd47322-c915-44f5-acd2-d7aacd39483d None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:39.060355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 535/1071] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:39.060453 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd47322-c915-44f5-acd2-d7aacd39483d None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:39.060453 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd47322-c915-44f5-acd2-d7aacd39483d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:39.060611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe216b0-4ce7-487c-bca3-572e64336f81 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:39.061155 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd47322-c915-44f5-acd2-d7aacd39483d None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:39.070557 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 537/1072] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:55:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:39.071379 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd47322-c915-44f5-acd2-d7aacd39483d None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:39.168662 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe216b0-4ce7-487c-bca3-572e64336f81 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:39.172205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd47322-c915-44f5-acd2-d7aacd39483d None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:39.205546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1868d-0805-4318-a07f-2c8d7ba3804b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:39.206226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1868d-0805-4318-a07f-2c8d7ba3804b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:39.206502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1c98b-d567-4b72-9e99-bf4712b0247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:39.206644 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1868d-0805-4318-a07f-2c8d7ba3804b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:39.206765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1868d-0805-4318-a07f-2c8d7ba3804b None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:39.207108 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1c98b-d567-4b72-9e99-bf4712b0247f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:39.207386 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1c98b-d567-4b72-9e99-bf4712b0247f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:39.207478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1868d-0805-4318-a07f-2c8d7ba3804b None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:39.207660 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1c98b-d567-4b72-9e99-bf4712b0247f None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:39.207773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1868d-0805-4318-a07f-2c8d7ba3804b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:39.208297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1c98b-d567-4b72-9e99-bf4712b0247f None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:39.208619 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1c98b-d567-4b72-9e99-bf4712b0247f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:39.209109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1868d-0805-4318-a07f-2c8d7ba3804b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:39.209967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1c98b-d567-4b72-9e99-bf4712b0247f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:39.221338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 536/1073] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:39.227241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 538/1074] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:39.227447 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1868d-0805-4318-a07f-2c8d7ba3804b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:39.228171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1c98b-d567-4b72-9e99-bf4712b0247f None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:39.259744 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:39.293684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:39.353573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1c98b-d567-4b72-9e99-bf4712b0247f None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:39.353833 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1868d-0805-4318-a07f-2c8d7ba3804b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:39.393786 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb3b05-6f67-4c94-a58e-6853e04a1e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:39.394614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb3b05-6f67-4c94-a58e-6853e04a1e9a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:39.395049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb3b05-6f67-4c94-a58e-6853e04a1e9a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:39.395490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb3b05-6f67-4c94-a58e-6853e04a1e9a None admin] PATH_INFO: `/v3/users/nova` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:39.397865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694bde1-418d-48e0-b990-c4f23612d598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:39.398739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694bde1-418d-48e0-b990-c4f23612d598 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:39.399017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694bde1-418d-48e0-b990-c4f23612d598 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:39.399840 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694bde1-418d-48e0-b990-c4f23612d598 None admin] PATH_INFO: `/v3/users/7ee631b066fa4087936ed61cb643cfc5` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:39.400517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694bde1-418d-48e0-b990-c4f23612d598 None admin] RBAC: Authorizing `identity:get_user(user_id=7ee631b066fa4087936ed61cb643cfc5)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:39.401984 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694bde1-418d-48e0-b990-c4f23612d598 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:39.403767 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 537/1075] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:55:39 2022] GET /identity/v3/users/7ee631b066fa4087936ed61cb643cfc5 => generated 285 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:39.406238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb3b05-6f67-4c94-a58e-6853e04a1e9a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:39.407691 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb3b05-6f67-4c94-a58e-6853e04a1e9a None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:39.409525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694bde1-418d-48e0-b990-c4f23612d598 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-1fdb3b05-6f67-4c94-a58e-6853e04a1e9a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:55:39.420181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:39.421256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:39.422256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:39.422256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:39.422256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:55:39.422256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:55:39.422256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:55:39.422256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:55:39.422256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:55:39.422256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:55:39.422256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:55:39.422256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:39.425949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 539/1076] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Sep 7 12:55:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:39.428208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb3b05-6f67-4c94-a58e-6853e04a1e9a None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:39.521433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:39.536270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694bde1-418d-48e0-b990-c4f23612d598 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:39.547165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb3b05-6f67-4c94-a58e-6853e04a1e9a None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:39.564614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:39.573254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830c106-f1ea-4303-a8b0-3871e74a589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:39.573891 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830c106-f1ea-4303-a8b0-3871e74a589b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:39.574173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830c106-f1ea-4303-a8b0-3871e74a589b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:39.574442 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830c106-f1ea-4303-a8b0-3871e74a589b None admin] PATH_INFO: `/v3/projects/0f099db852624d36b747e0868f04f72f` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:39.575562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830c106-f1ea-4303-a8b0-3871e74a589b None admin] RBAC: Authorizing `identity:get_project(project_id=0f099db852624d36b747e0868f04f72f)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:39.577039 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830c106-f1ea-4303-a8b0-3871e74a589b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:39.578680 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 538/1077] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:55:39 2022] GET /identity/v3/projects/0f099db852624d36b747e0868f04f72f => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:39.584963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830c106-f1ea-4303-a8b0-3871e74a589b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:39.587257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa638954-da97-4630-b845-9a4d269ee009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:39.587878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa638954-da97-4630-b845-9a4d269ee009 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:39.588157 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa638954-da97-4630-b845-9a4d269ee009 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:39.588478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa638954-da97-4630-b845-9a4d269ee009 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:39.589220 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa638954-da97-4630-b845-9a4d269ee009 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:39.589527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa638954-da97-4630-b845-9a4d269ee009 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:39.590977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa638954-da97-4630-b845-9a4d269ee009 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:39.609228 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 540/1078] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Sep 7 12:55:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:39.619212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa638954-da97-4630-b845-9a4d269ee009 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:39.692241 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830c106-f1ea-4303-a8b0-3871e74a589b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:39.723398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa638954-da97-4630-b845-9a4d269ee009 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:39.727345 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957c73b-1cc7-4485-b399-821f477ef10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:39.728007 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957c73b-1cc7-4485-b399-821f477ef10e None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:39.728286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957c73b-1cc7-4485-b399-821f477ef10e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:39.728568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957c73b-1cc7-4485-b399-821f477ef10e None admin] PATH_INFO: `/v3/projects/0f099db852624d36b747e0868f04f72f/users/7ee631b066fa4087936ed61cb643cfc5/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:39.730511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957c73b-1cc7-4485-b399-821f477ef10e None admin] RBAC: Authorizing `identity:create_grant(project_id=0f099db852624d36b747e0868f04f72f, user_id=7ee631b066fa4087936ed61cb643cfc5, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:39.732073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957c73b-1cc7-4485-b399-821f477ef10e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:39.746276 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 539/1079] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:55:39 2022] PUT /identity/v3/projects/0f099db852624d36b747e0868f04f72f/users/7ee631b066fa4087936ed61cb643cfc5/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:55:39.765531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b55a-fd93-45ae-a32a-8d886b41b4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:39.766201 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b55a-fd93-45ae-a32a-8d886b41b4b7 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:39.766483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b55a-fd93-45ae-a32a-8d886b41b4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:39.766752 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b55a-fd93-45ae-a32a-8d886b41b4b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:39.779545 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821b55a-fd93-45ae-a32a-8d886b41b4b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:39.781082 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821b55a-fd93-45ae-a32a-8d886b41b4b7 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-5821b55a-fd93-45ae-a32a-8d886b41b4b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:39.798809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:39.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:39.801677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:39.801677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:39.801677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:39.801677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 541/1080] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:39.806490 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957c73b-1cc7-4485-b399-821f477ef10e None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:39.829780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:39.923276 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957c73b-1cc7-4485-b399-821f477ef10e None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:39.961894 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a501b-1c77-4435-bf3b-8fcf8a7b189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:39.962508 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a501b-1c77-4435-bf3b-8fcf8a7b189f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:39.962784 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a501b-1c77-4435-bf3b-8fcf8a7b189f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:39.963053 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a501b-1c77-4435-bf3b-8fcf8a7b189f None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:39.963699 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a501b-1c77-4435-bf3b-8fcf8a7b189f None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:39.963997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a501b-1c77-4435-bf3b-8fcf8a7b189f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:39.965409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a501b-1c77-4435-bf3b-8fcf8a7b189f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:39.977659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 540/1081] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:39.983566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b55a-fd93-45ae-a32a-8d886b41b4b7 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:40.010243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:40.093313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b55a-fd93-45ae-a32a-8d886b41b4b7 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:40.128768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa74391-e8e7-46b6-a4dd-5996edacc177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:40.129418 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa74391-e8e7-46b6-a4dd-5996edacc177 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:40.129697 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa74391-e8e7-46b6-a4dd-5996edacc177 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:40.129967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa74391-e8e7-46b6-a4dd-5996edacc177 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:40.137210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa74391-e8e7-46b6-a4dd-5996edacc177 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:40.138666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa74391-e8e7-46b6-a4dd-5996edacc177 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:40.150103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-9aa74391-e8e7-46b6-a4dd-5996edacc177 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:40.150103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:40.150103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:40.150103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:40.150103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:40.150103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:40.150103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:40.150103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:40.150103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:40.150103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:40.150103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:40.150103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:40.150103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:55:40.150103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:55:40.150103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:40.151861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:40.153670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:55:40.153670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:55:40.153670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:55:40.153670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:55:40.153670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:55:40.153670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:55:40.153670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:40.153670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:40.153670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 542/1082] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:55:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:40.158371 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a501b-1c77-4435-bf3b-8fcf8a7b189f None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:40.243696 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:40.266930 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a501b-1c77-4435-bf3b-8fcf8a7b189f None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:40.301979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fa6e9-460b-4591-8374-728ec21ae1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:40.302589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fa6e9-460b-4591-8374-728ec21ae1a3 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:40.302870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fa6e9-460b-4591-8374-728ec21ae1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:40.303140 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fa6e9-460b-4591-8374-728ec21ae1a3 None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:40.303843 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fa6e9-460b-4591-8374-728ec21ae1a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:40.304148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fa6e9-460b-4591-8374-728ec21ae1a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:40.305639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fa6e9-460b-4591-8374-728ec21ae1a3 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:40.318117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 541/1083] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:55:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:40.324167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa74391-e8e7-46b6-a4dd-5996edacc177 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:40.410102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:40.436052 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa74391-e8e7-46b6-a4dd-5996edacc177 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:40.474370 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f16bcc-a986-429a-b070-9ade7ae6b855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:40.475053 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16bcc-a986-429a-b070-9ade7ae6b855 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:40.475318 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16bcc-a986-429a-b070-9ade7ae6b855 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:40.475590 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16bcc-a986-429a-b070-9ade7ae6b855 None admin] PATH_INFO: `/v3/projects/3381c0688581489b903e641f91914839/users/fbe8fa8ab8094aa69933398280810692/roles/5ffeac2dbda44d9eac33c133a025f37e` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:40.477908 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f16bcc-a986-429a-b070-9ade7ae6b855 None admin] RBAC: Authorizing `identity:create_grant(project_id=3381c0688581489b903e641f91914839, user_id=fbe8fa8ab8094aa69933398280810692, role_id=5ffeac2dbda44d9eac33c133a025f37e)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:40.479382 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f16bcc-a986-429a-b070-9ade7ae6b855 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:40.501359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 543/1084] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:55:40 2022] PUT /identity/v3/projects/3381c0688581489b903e641f91914839/users/fbe8fa8ab8094aa69933398280810692/roles/5ffeac2dbda44d9eac33c133a025f37e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:55:42.112792 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf19fa4-5d0e-4242-bca0-30a7e8f16885 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:42.112792 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf19fa4-5d0e-4242-bca0-30a7e8f16885 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:42.113470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf19fa4-5d0e-4242-bca0-30a7e8f16885 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:42.115353 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 542/1085] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:42.121488 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705d785-b5db-4e69-bb9c-e38f5d0f6e38 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:42.122032 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705d785-b5db-4e69-bb9c-e38f5d0f6e38 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:42.122160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705d785-b5db-4e69-bb9c-e38f5d0f6e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:42.145975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-d705d785-b5db-4e69-bb9c-e38f5d0f6e38 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:42.147221 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d705d785-b5db-4e69-bb9c-e38f5d0f6e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:42.227683 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 544/1086] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:42.507912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf19fa4-5d0e-4242-bca0-30a7e8f16885 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:42.651308 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf19fa4-5d0e-4242-bca0-30a7e8f16885 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:42.695798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbb06f-9132-457d-a5fe-0423c5e86fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:42.695798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbb06f-9132-457d-a5fe-0423c5e86fa7 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:42.695798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbb06f-9132-457d-a5fe-0423c5e86fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:42.695798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbb06f-9132-457d-a5fe-0423c5e86fa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:42.706408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:42.713976 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adbb06f-9132-457d-a5fe-0423c5e86fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-8adbb06f-9132-457d-a5fe-0423c5e86fa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:55:42.720193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:42.722407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:42.724689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:42.724689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:42.724689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:42.724689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:42.724689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:55:42.724689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:55:42.724689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:55:42.724689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:55:42.724689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:55:42.724689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:55:42.724689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:55:42.724689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:42.724689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 543/1087] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:55:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:42.730770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705d785-b5db-4e69-bb9c-e38f5d0f6e38 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:42.815654 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:42.853454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705d785-b5db-4e69-bb9c-e38f5d0f6e38 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:42.895880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74ed4d-eb1d-4803-88f1-207b6c629a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:42.896607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74ed4d-eb1d-4803-88f1-207b6c629a22 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:42.896928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74ed4d-eb1d-4803-88f1-207b6c629a22 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:42.897242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74ed4d-eb1d-4803-88f1-207b6c629a22 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:42.897995 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74ed4d-eb1d-4803-88f1-207b6c629a22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:42.898347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74ed4d-eb1d-4803-88f1-207b6c629a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:42.900046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74ed4d-eb1d-4803-88f1-207b6c629a22 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:42.919189 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 545/1088] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:55:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:42.926442 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbb06f-9132-457d-a5fe-0423c5e86fa7 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:43.062095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbb06f-9132-457d-a5fe-0423c5e86fa7 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:43.113962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2112c23-f515-4225-9e38-21e51fecb951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:43.114932 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2112c23-f515-4225-9e38-21e51fecb951 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:43.114932 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2112c23-f515-4225-9e38-21e51fecb951 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:43.115211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2112c23-f515-4225-9e38-21e51fecb951 None admin] PATH_INFO: `/v3/users/7ee631b066fa4087936ed61cb643cfc5` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:43.116641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2112c23-f515-4225-9e38-21e51fecb951 None admin] RBAC: Authorizing `identity:get_user(user_id=7ee631b066fa4087936ed61cb643cfc5)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:43.118289 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2112c23-f515-4225-9e38-21e51fecb951 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:43.120051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 544/1089] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:55:42 2022] GET /identity/v3/users/7ee631b066fa4087936ed61cb643cfc5 => generated 285 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:43.126750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74ed4d-eb1d-4803-88f1-207b6c629a22 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:43.159508 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84de5b-2431-4509-89e0-5718fa42f568 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:43.159954 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84de5b-2431-4509-89e0-5718fa42f568 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:43.160366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84de5b-2431-4509-89e0-5718fa42f568 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:43.162733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 545/1090] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:43.170300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c24fe7-6905-4781-9f0c-040ccf3e2bf5 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:43.170704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c24fe7-6905-4781-9f0c-040ccf3e2bf5 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:43.171097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c24fe7-6905-4781-9f0c-040ccf3e2bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:43.199843 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-96c24fe7-6905-4781-9f0c-040ccf3e2bf5 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:43.201956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-96c24fe7-6905-4781-9f0c-040ccf3e2bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:43.262358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74ed4d-eb1d-4803-88f1-207b6c629a22 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:43.306045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:43.316653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae389a-514f-4be5-b671-312bd1b0ece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:43.317280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae389a-514f-4be5-b671-312bd1b0ece4 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:43.317412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 546/1091] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:55:43.317736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae389a-514f-4be5-b671-312bd1b0ece4 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:43.318080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae389a-514f-4be5-b671-312bd1b0ece4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:43.321435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:43.402560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae389a-514f-4be5-b671-312bd1b0ece4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:43.404034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae389a-514f-4be5-b671-312bd1b0ece4 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:43.562733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 546/1092] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:55:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 12:55:43.571552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c24fe7-6905-4781-9f0c-040ccf3e2bf5 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:43.653333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae389a-514f-4be5-b671-312bd1b0ece4 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:43.705495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:43.731202 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c24fe7-6905-4781-9f0c-040ccf3e2bf5 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:43.789748 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abf2d7-d27d-4085-a789-e04517149772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:43.790646 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abf2d7-d27d-4085-a789-e04517149772 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:43.791090 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abf2d7-d27d-4085-a789-e04517149772 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:43.791553 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abf2d7-d27d-4085-a789-e04517149772 None admin] PATH_INFO: `/v3/projects/0f099db852624d36b747e0868f04f72f` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:43.791840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae389a-514f-4be5-b671-312bd1b0ece4 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:43.793856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abf2d7-d27d-4085-a789-e04517149772 None admin] RBAC: Authorizing `identity:get_project(project_id=0f099db852624d36b747e0868f04f72f)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:43.796709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abf2d7-d27d-4085-a789-e04517149772 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:43.800008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 547/1093] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:55:43 2022] GET /identity/v3/projects/0f099db852624d36b747e0868f04f72f => generated 311 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:43.810728 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abf2d7-d27d-4085-a789-e04517149772 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:43.838089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eda6a-c53b-47f7-8ec5-4b3a506edb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:43.838957 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eda6a-c53b-47f7-8ec5-4b3a506edb6b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:43.839307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eda6a-c53b-47f7-8ec5-4b3a506edb6b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:43.839645 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eda6a-c53b-47f7-8ec5-4b3a506edb6b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:43.857597 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1eda6a-c53b-47f7-8ec5-4b3a506edb6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-cf1eda6a-c53b-47f7-8ec5-4b3a506edb6b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:55:43.863313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:43.865317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:43.866913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:43.866913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:43.866913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:43.866913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:43.866913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:55:43.866913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:55:43.866913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:55:43.866913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:55:43.866913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:55:43.866913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:55:43.866913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:55:43.866913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:43.866913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 547/1094] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Sep 7 12:55:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:43.874698 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eda6a-c53b-47f7-8ec5-4b3a506edb6b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:43.925733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:43.996669 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abf2d7-d27d-4085-a789-e04517149772 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:44.051575 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:44.062165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eda6a-c53b-47f7-8ec5-4b3a506edb6b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:44.067270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cb2f6-0a05-41d6-86df-88f744049f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:44.068300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cb2f6-0a05-41d6-86df-88f744049f5a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:44.068793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cb2f6-0a05-41d6-86df-88f744049f5a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:44.069276 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cb2f6-0a05-41d6-86df-88f744049f5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:44.070670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cb2f6-0a05-41d6-86df-88f744049f5a None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=0f099db852624d36b747e0868f04f72f, user.id=7ee631b066fa4087936ed61cb643cfc5) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:44.071214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cb2f6-0a05-41d6-86df-88f744049f5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:44.074021 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cb2f6-0a05-41d6-86df-88f744049f5a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:44.097233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 548/1095] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:55:43 2022] GET /identity/v3/role_assignments?user.id=7ee631b066fa4087936ed61cb643cfc5&scope.project.id=0f099db852624d36b747e0868f04f72f&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:44.123106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be7bf2-fff5-4a96-a83f-f2f60814bd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:44.124167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be7bf2-fff5-4a96-a83f-f2f60814bd0a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:44.124721 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be7bf2-fff5-4a96-a83f-f2f60814bd0a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:44.125220 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be7bf2-fff5-4a96-a83f-f2f60814bd0a None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:44.126727 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be7bf2-fff5-4a96-a83f-f2f60814bd0a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:44.127251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be7bf2-fff5-4a96-a83f-f2f60814bd0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:44.130464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be7bf2-fff5-4a96-a83f-f2f60814bd0a None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:44.146669 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 548/1096] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Sep 7 12:55:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:44.153050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cb2f6-0a05-41d6-86df-88f744049f5a None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:44.305352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cb2f6-0a05-41d6-86df-88f744049f5a None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:44.347174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:44.361483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a030556-751f-41a4-8740-587cd99255f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:44.362244 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a030556-751f-41a4-8740-587cd99255f6 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:44.362571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a030556-751f-41a4-8740-587cd99255f6 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:44.362899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a030556-751f-41a4-8740-587cd99255f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:44.378690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a030556-751f-41a4-8740-587cd99255f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:44.380969 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a030556-751f-41a4-8740-587cd99255f6 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-4a030556-751f-41a4-8740-587cd99255f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:44.405820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:44.409181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:44.410472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:44.410472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:44.410472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:44.410472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 549/1097] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:44.417434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be7bf2-fff5-4a96-a83f-f2f60814bd0a None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:44.567153 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be7bf2-fff5-4a96-a83f-f2f60814bd0a None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:44.613548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58603dc-e882-4d60-a08e-d4340a07a680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:44.614355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58603dc-e882-4d60-a08e-d4340a07a680 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:44.617376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58603dc-e882-4d60-a08e-d4340a07a680 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:44.617376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58603dc-e882-4d60-a08e-d4340a07a680 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:44.617376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58603dc-e882-4d60-a08e-d4340a07a680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:44.617376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58603dc-e882-4d60-a08e-d4340a07a680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:44.619148 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58603dc-e882-4d60-a08e-d4340a07a680 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:44.644212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 549/1098] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:44.653809 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a030556-751f-41a4-8740-587cd99255f6 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:44.847862 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a030556-751f-41a4-8740-587cd99255f6 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:44.911310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be393ffa-15e8-43d3-9cc2-ac981bd711b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:44.911963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be393ffa-15e8-43d3-9cc2-ac981bd711b1 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:44.912245 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be393ffa-15e8-43d3-9cc2-ac981bd711b1 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:44.912688 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be393ffa-15e8-43d3-9cc2-ac981bd711b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:44.922053 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be393ffa-15e8-43d3-9cc2-ac981bd711b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:44.923530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be393ffa-15e8-43d3-9cc2-ac981bd711b1 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-be393ffa-15e8-43d3-9cc2-ac981bd711b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:55:44.937823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:44.939816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:44.942615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:44.942615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:44.942615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:55:44.942615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:55:44.942615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:55:44.942615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:55:44.942615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:55:44.942615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:55:44.942615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:55:44.942615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:55:44.942615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 550/1099] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Sep 7 12:55:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:44.947573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58603dc-e882-4d60-a08e-d4340a07a680 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:44.984339 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:45.111386 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58603dc-e882-4d60-a08e-d4340a07a680 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:45.170285 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240eeb4a-a825-4f83-a450-45b905e6db7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:45.171183 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240eeb4a-a825-4f83-a450-45b905e6db7b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:45.171697 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240eeb4a-a825-4f83-a450-45b905e6db7b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:45.172263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240eeb4a-a825-4f83-a450-45b905e6db7b None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:45.173656 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240eeb4a-a825-4f83-a450-45b905e6db7b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:45.174138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240eeb4a-a825-4f83-a450-45b905e6db7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:45.175963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240eeb4a-a825-4f83-a450-45b905e6db7b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:45.207207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 550/1100] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Sep 7 12:55:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:45.218490 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be393ffa-15e8-43d3-9cc2-ac981bd711b1 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:45.287567 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:45.407437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be393ffa-15e8-43d3-9cc2-ac981bd711b1 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:45.470918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485e3d8-bfe1-480a-983d-633d8ca204ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:45.472014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485e3d8-bfe1-480a-983d-633d8ca204ee None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:45.472714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485e3d8-bfe1-480a-983d-633d8ca204ee None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:45.473148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485e3d8-bfe1-480a-983d-633d8ca204ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:45.587469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485e3d8-bfe1-480a-983d-633d8ca204ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:45.589365 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485e3d8-bfe1-480a-983d-633d8ca204ee None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:45.643081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:45.726188 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 551/1101] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:55:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:55:45.733989 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240eeb4a-a825-4f83-a450-45b905e6db7b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:45.864735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:45.901209 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240eeb4a-a825-4f83-a450-45b905e6db7b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:45.969516 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3bc50-211d-4c8e-a2b1-0ce600cb25b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:45.970831 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3bc50-211d-4c8e-a2b1-0ce600cb25b4 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:45.971247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3bc50-211d-4c8e-a2b1-0ce600cb25b4 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:45.971874 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3bc50-211d-4c8e-a2b1-0ce600cb25b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:45.997580 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3bc50-211d-4c8e-a2b1-0ce600cb25b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:45.997580 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3bc50-211d-4c8e-a2b1-0ce600cb25b4 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-14b3bc50-211d-4c8e-a2b1-0ce600cb25b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:46.026890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:46.027967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:46.029001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:46.029001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:46.029001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:46.029218 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 551/1102] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:46.035925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485e3d8-bfe1-480a-983d-633d8ca204ee None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:46.159692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485e3d8-bfe1-480a-983d-633d8ca204ee None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:46.201710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4a368-2f80-423d-9cf1-8af4a8abc6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:46.202326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4a368-2f80-423d-9cf1-8af4a8abc6e2 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:46.202607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4a368-2f80-423d-9cf1-8af4a8abc6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:46.202879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4a368-2f80-423d-9cf1-8af4a8abc6e2 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:46.203533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4a368-2f80-423d-9cf1-8af4a8abc6e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:46.203834 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4a368-2f80-423d-9cf1-8af4a8abc6e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:46.205329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4a368-2f80-423d-9cf1-8af4a8abc6e2 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:46.215484 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:46.220458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 552/1103] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:46.226674 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3bc50-211d-4c8e-a2b1-0ce600cb25b4 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:46.358562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3bc50-211d-4c8e-a2b1-0ce600cb25b4 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:46.407938 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:46.418974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a3dab-6b59-419e-a7fa-013ce7f4382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:46.419668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3dab-6b59-419e-a7fa-013ce7f4382c None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:46.419949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3dab-6b59-419e-a7fa-013ce7f4382c None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:46.420215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3dab-6b59-419e-a7fa-013ce7f4382c None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:46.429249 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a3dab-6b59-419e-a7fa-013ce7f4382c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:46.430796 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a3dab-6b59-419e-a7fa-013ce7f4382c None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:46.444797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-233a3dab-6b59-419e-a7fa-013ce7f4382c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:46.444797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:46.444797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:46.444797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:46.444797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:46.444797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:46.444797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:46.444797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:46.444797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:46.444797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:46.444797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:46.444797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:46.444797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:55:46.444797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:55:46.444797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:46.446061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:46.447326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:55:46.447326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:55:46.447326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:55:46.447326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:55:46.447326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:55:46.447326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:55:46.447326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:46.447326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:55:46.448766 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 552/1104] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:55:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:46.452416 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4a368-2f80-423d-9cf1-8af4a8abc6e2 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:46.582233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4a368-2f80-423d-9cf1-8af4a8abc6e2 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:46.628798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef62753-e6aa-4cc5-93b3-27123e39286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:46.629744 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef62753-e6aa-4cc5-93b3-27123e39286e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:46.630220 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef62753-e6aa-4cc5-93b3-27123e39286e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:46.630725 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef62753-e6aa-4cc5-93b3-27123e39286e None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:46.632077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef62753-e6aa-4cc5-93b3-27123e39286e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:46.632631 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef62753-e6aa-4cc5-93b3-27123e39286e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:46.635293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef62753-e6aa-4cc5-93b3-27123e39286e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:46.666705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 553/1105] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:55:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:46.668268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a3dab-6b59-419e-a7fa-013ce7f4382c None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:46.840535 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a3dab-6b59-419e-a7fa-013ce7f4382c None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:46.884449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6589202-550d-4567-83ed-a848d4fc4b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:46.885032 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6589202-550d-4567-83ed-a848d4fc4b80 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:46.885367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6589202-550d-4567-83ed-a848d4fc4b80 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:46.885675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6589202-550d-4567-83ed-a848d4fc4b80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:46.886564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6589202-550d-4567-83ed-a848d4fc4b80 None admin] RBAC: Adding query filter params (role.id=5ffeac2dbda44d9eac33c133a025f37e, scope.project.id=3381c0688581489b903e641f91914839, user.id=fbe8fa8ab8094aa69933398280810692) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:46.887217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6589202-550d-4567-83ed-a848d4fc4b80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:46.888409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6589202-550d-4567-83ed-a848d4fc4b80 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:46.896085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 553/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:55:46 2022] GET /identity/v3/role_assignments?user.id=fbe8fa8ab8094aa69933398280810692&scope.project.id=3381c0688581489b903e641f91914839&role.id=5ffeac2dbda44d9eac33c133a025f37e => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:46.908555 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966cc73-3fc9-4488-82fa-d5c2f7100ca3 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:46.908841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966cc73-3fc9-4488-82fa-d5c2f7100ca3 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:46.909126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966cc73-3fc9-4488-82fa-d5c2f7100ca3 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:46.910745 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 554/1107] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:46.917967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8666-d89d-4787-a98e-cbf97b09f0f3 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:46.918419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8666-d89d-4787-a98e-cbf97b09f0f3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:46.918896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8666-d89d-4787-a98e-cbf97b09f0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:46.948973 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-e4ba8666-d89d-4787-a98e-cbf97b09f0f3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:46.951129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-e4ba8666-d89d-4787-a98e-cbf97b09f0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:47.036436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:47.068332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 554/1108] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:47.453147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966cc73-3fc9-4488-82fa-d5c2f7100ca3 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:47.546268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:47.610711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966cc73-3fc9-4488-82fa-d5c2f7100ca3 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:47.670042 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52906691-4f19-4817-af30-8a1a5f87511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:47.671001 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52906691-4f19-4817-af30-8a1a5f87511a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:47.671149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52906691-4f19-4817-af30-8a1a5f87511a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:47.671402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52906691-4f19-4817-af30-8a1a5f87511a None admin] PATH_INFO: `/v3/domains/default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:47.672826 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52906691-4f19-4817-af30-8a1a5f87511a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:47.674446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52906691-4f19-4817-af30-8a1a5f87511a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:47.676337 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 555/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:47.682824 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba8666-d89d-4787-a98e-cbf97b09f0f3 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:47.803206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba8666-d89d-4787-a98e-cbf97b09f0f3 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:47.851695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecbb2c-f656-4b57-b864-d3369ac2c45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:47.852727 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecbb2c-f656-4b57-b864-d3369ac2c45c None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:47.852727 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecbb2c-f656-4b57-b864-d3369ac2c45c None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:47.852912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecbb2c-f656-4b57-b864-d3369ac2c45c None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:47.854095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecbb2c-f656-4b57-b864-d3369ac2c45c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:47.855111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecbb2c-f656-4b57-b864-d3369ac2c45c None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:47.883941 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 555/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:55:47 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:55:50.398181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a5a85-dec7-4ab6-888a-d451d0c3b043 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:50.398743 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a5a85-dec7-4ab6-888a-d451d0c3b043 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:50.399109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a5a85-dec7-4ab6-888a-d451d0c3b043 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:50.401686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 556/1111] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:50.408061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8eec4c-6f11-4a42-b719-8fce8b467cca None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:50.408747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8eec4c-6f11-4a42-b719-8fce8b467cca None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:50.408747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8eec4c-6f11-4a42-b719-8fce8b467cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:50.430136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ec8eec4c-6f11-4a42-b719-8fce8b467cca None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:50.431518 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ec8eec4c-6f11-4a42-b719-8fce8b467cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:50.469549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:50.530326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 556/1112] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:50.816684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a5a85-dec7-4ab6-888a-d451d0c3b043 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:50.972178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a5a85-dec7-4ab6-888a-d451d0c3b043 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:51.009039 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:51.019768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20d922-2515-4c2a-8bb3-bb3e7722d215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:51.020555 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d922-2515-4c2a-8bb3-bb3e7722d215 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:51.020927 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d922-2515-4c2a-8bb3-bb3e7722d215 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:51.021387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d922-2515-4c2a-8bb3-bb3e7722d215 None admin] PATH_INFO: `/v3/roles/0560a82175224c8e86d1b430212748d4` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:51.023169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20d922-2515-4c2a-8bb3-bb3e7722d215 None admin] RBAC: Authorizing `identity:get_role(role_id=0560a82175224c8e86d1b430212748d4)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:51.024733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20d922-2515-4c2a-8bb3-bb3e7722d215 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:51.026225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 557/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:55:50 2022] GET /identity/v3/roles/0560a82175224c8e86d1b430212748d4 => generated 223 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:51.032728 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8eec4c-6f11-4a42-b719-8fce8b467cca None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:51.155322 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8eec4c-6f11-4a42-b719-8fce8b467cca None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:51.196597 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27078182-6af0-4f34-be1c-9a564a08a866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:51.197265 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27078182-6af0-4f34-be1c-9a564a08a866 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:51.197537 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27078182-6af0-4f34-be1c-9a564a08a866 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:51.197806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27078182-6af0-4f34-be1c-9a564a08a866 None admin] PATH_INFO: `/v3/users/70de1109b913476ab680905869ddb04f` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:51.215829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27078182-6af0-4f34-be1c-9a564a08a866 None admin] RBAC: Authorizing `identity:get_user(user_id=70de1109b913476ab680905869ddb04f)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:51.217335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27078182-6af0-4f34-be1c-9a564a08a866 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:51.219064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 557/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:55:51 2022] GET /identity/v3/users/70de1109b913476ab680905869ddb04f => generated 286 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:51.225607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20d922-2515-4c2a-8bb3-bb3e7722d215 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:51.370563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20d922-2515-4c2a-8bb3-bb3e7722d215 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:51.430762 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d169e9d-bc3e-497d-82f5-a342fa77d855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:51.431635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169e9d-bc3e-497d-82f5-a342fa77d855 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:51.431635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169e9d-bc3e-497d-82f5-a342fa77d855 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:51.431954 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169e9d-bc3e-497d-82f5-a342fa77d855 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:51.504756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:51.515712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d169e9d-bc3e-497d-82f5-a342fa77d855 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:51.517688 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d169e9d-bc3e-497d-82f5-a342fa77d855 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:51.649112 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 558/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:55:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:55:51.655858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27078182-6af0-4f34-be1c-9a564a08a866 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:51.683849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:51.796022 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27078182-6af0-4f34-be1c-9a564a08a866 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:51.849492 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e561aaa-b56e-4939-b700-c50a74838adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:51.850333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e561aaa-b56e-4939-b700-c50a74838adc None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:51.850663 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e561aaa-b56e-4939-b700-c50a74838adc None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:51.850990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e561aaa-b56e-4939-b700-c50a74838adc None admin] PATH_INFO: `/v3/projects/0f099db852624d36b747e0868f04f72f` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:51.852344 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e561aaa-b56e-4939-b700-c50a74838adc None admin] RBAC: Authorizing `identity:get_project(project_id=0f099db852624d36b747e0868f04f72f)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:51.854045 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e561aaa-b56e-4939-b700-c50a74838adc None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:51.855899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 558/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:55:51 2022] GET /identity/v3/projects/0f099db852624d36b747e0868f04f72f => generated 311 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:51.863176 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d169e9d-bc3e-497d-82f5-a342fa77d855 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:51.998433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:52.008095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d169e9d-bc3e-497d-82f5-a342fa77d855 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:52.060753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265828c1-03ee-4273-96f8-774d347f2394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:52.061638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265828c1-03ee-4273-96f8-774d347f2394 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:52.062944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265828c1-03ee-4273-96f8-774d347f2394 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:52.062944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265828c1-03ee-4273-96f8-774d347f2394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:52.063275 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265828c1-03ee-4273-96f8-774d347f2394 None admin] RBAC: Adding query filter params (role.id=0560a82175224c8e86d1b430212748d4, scope.project.id=0f099db852624d36b747e0868f04f72f, user.id=70de1109b913476ab680905869ddb04f) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:52.063624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265828c1-03ee-4273-96f8-774d347f2394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:52.066309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265828c1-03ee-4273-96f8-774d347f2394 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:52.074703 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 559/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:55:51 2022] GET /identity/v3/role_assignments?user.id=70de1109b913476ab680905869ddb04f&scope.project.id=0f099db852624d36b747e0868f04f72f&role.id=0560a82175224c8e86d1b430212748d4 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:54.396502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff137181-84a3-4b6f-b21f-e16669742009 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:54.397222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff137181-84a3-4b6f-b21f-e16669742009 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:54.397222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff137181-84a3-4b6f-b21f-e16669742009 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:54.398730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 559/1118] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:54.405366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730dfa4-8f67-4bf3-9f45-308bf89c7e81 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:54.406108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730dfa4-8f67-4bf3-9f45-308bf89c7e81 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:54.406108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730dfa4-8f67-4bf3-9f45-308bf89c7e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:54.430467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-d730dfa4-8f67-4bf3-9f45-308bf89c7e81 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:54.431922 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d730dfa4-8f67-4bf3-9f45-308bf89c7e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:54.530962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 560/1119] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:55:54.825439 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff137181-84a3-4b6f-b21f-e16669742009 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:54.960118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:54.972454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff137181-84a3-4b6f-b21f-e16669742009 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:55.016517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d19c0-4ec1-40df-808e-c70b7dfcb159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:55.017217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d19c0-4ec1-40df-808e-c70b7dfcb159 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:55.017546 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d19c0-4ec1-40df-808e-c70b7dfcb159 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:55.017847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d19c0-4ec1-40df-808e-c70b7dfcb159 None admin] PATH_INFO: `/v3/roles/0560a82175224c8e86d1b430212748d4` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:55.020068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d19c0-4ec1-40df-808e-c70b7dfcb159 None admin] RBAC: Authorizing `identity:get_role(role_id=0560a82175224c8e86d1b430212748d4)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:55.021571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d19c0-4ec1-40df-808e-c70b7dfcb159 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:55.023037 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 560/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:55:54 2022] GET /identity/v3/roles/0560a82175224c8e86d1b430212748d4 => generated 223 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:55.029738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730dfa4-8f67-4bf3-9f45-308bf89c7e81 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:55.153285 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:55.166824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730dfa4-8f67-4bf3-9f45-308bf89c7e81 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:55.213844 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7c37c-8b52-4023-8c70-7e78716ea051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:55.214496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7c37c-8b52-4023-8c70-7e78716ea051 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:55.214775 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7c37c-8b52-4023-8c70-7e78716ea051 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:55.215045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7c37c-8b52-4023-8c70-7e78716ea051 None admin] PATH_INFO: `/v3/users/70de1109b913476ab680905869ddb04f` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:55.216225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7c37c-8b52-4023-8c70-7e78716ea051 None admin] RBAC: Authorizing `identity:get_user(user_id=70de1109b913476ab680905869ddb04f)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:55.217745 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7c37c-8b52-4023-8c70-7e78716ea051 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:55.219397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 561/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:55:55 2022] GET /identity/v3/users/70de1109b913476ab680905869ddb04f => generated 286 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:55.226442 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d19c0-4ec1-40df-808e-c70b7dfcb159 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:55.352766 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d19c0-4ec1-40df-808e-c70b7dfcb159 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:55.406836 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca44e4-3e1d-45af-802d-35ee1393ff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:55.407799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca44e4-3e1d-45af-802d-35ee1393ff6e None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:55.408261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca44e4-3e1d-45af-802d-35ee1393ff6e None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:55.408796 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca44e4-3e1d-45af-802d-35ee1393ff6e None admin] PATH_INFO: `/v3/projects/0f099db852624d36b747e0868f04f72f` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:55.411260 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca44e4-3e1d-45af-802d-35ee1393ff6e None admin] RBAC: Authorizing `identity:get_project(project_id=0f099db852624d36b747e0868f04f72f)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:55.414019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca44e4-3e1d-45af-802d-35ee1393ff6e None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:55.417898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 561/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:55:55 2022] GET /identity/v3/projects/0f099db852624d36b747e0868f04f72f => generated 311 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:55.424499 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7c37c-8b52-4023-8c70-7e78716ea051 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:55.563102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7c37c-8b52-4023-8c70-7e78716ea051 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:55.628636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486391f-cf4a-4407-a2ec-87fdcad2b80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:55.629741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486391f-cf4a-4407-a2ec-87fdcad2b80d None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:55.630182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486391f-cf4a-4407-a2ec-87fdcad2b80d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:55.630620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486391f-cf4a-4407-a2ec-87fdcad2b80d None admin] PATH_INFO: `/v3/projects/0f099db852624d36b747e0868f04f72f/users/70de1109b913476ab680905869ddb04f/roles/0560a82175224c8e86d1b430212748d4` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:55.634316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486391f-cf4a-4407-a2ec-87fdcad2b80d None admin] RBAC: Authorizing `identity:create_grant(project_id=0f099db852624d36b747e0868f04f72f, user_id=70de1109b913476ab680905869ddb04f, role_id=0560a82175224c8e86d1b430212748d4)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:55.637018 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486391f-cf4a-4407-a2ec-87fdcad2b80d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:55.659372 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 562/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:55:55 2022] PUT /identity/v3/projects/0f099db852624d36b747e0868f04f72f/users/70de1109b913476ab680905869ddb04f/roles/0560a82175224c8e86d1b430212748d4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:55:57.995703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258c95d-5dee-4bc9-a4ba-d6107d1efcec None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:57.996363 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258c95d-5dee-4bc9-a4ba-d6107d1efcec None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:57.996363 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258c95d-5dee-4bc9-a4ba-d6107d1efcec None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:57.997650 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 562/1124] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:58.004685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e926eec-bbcf-426b-bc58-736c8589dbb8 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:58.005392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e926eec-bbcf-426b-bc58-736c8589dbb8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:58.005392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e926eec-bbcf-426b-bc58-736c8589dbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:58.038102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-9e926eec-bbcf-426b-bc58-736c8589dbb8 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:58.039481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9e926eec-bbcf-426b-bc58-736c8589dbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:58.055907 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:58.130484 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 563/1125] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:58.395994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258c95d-5dee-4bc9-a4ba-d6107d1efcec None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:58.430582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:58.517582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258c95d-5dee-4bc9-a4ba-d6107d1efcec None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:58.555820 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb0c49-bc31-4398-86a5-3789baa506b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:58.556514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb0c49-bc31-4398-86a5-3789baa506b0 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:58.556791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb0c49-bc31-4398-86a5-3789baa506b0 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:58.557057 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb0c49-bc31-4398-86a5-3789baa506b0 None admin] PATH_INFO: `/v3/roles/0560a82175224c8e86d1b430212748d4` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:58.558443 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb0c49-bc31-4398-86a5-3789baa506b0 None admin] RBAC: Authorizing `identity:get_role(role_id=0560a82175224c8e86d1b430212748d4)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:58.559913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb0c49-bc31-4398-86a5-3789baa506b0 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:58.561268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 563/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:55:58 2022] GET /identity/v3/roles/0560a82175224c8e86d1b430212748d4 => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:58.570580 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e926eec-bbcf-426b-bc58-736c8589dbb8 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:58.683118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e926eec-bbcf-426b-bc58-736c8589dbb8 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:58.721640 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9a565-8d4e-4ab7-a1b7-9b50ca7c92c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:58.722294 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9a565-8d4e-4ab7-a1b7-9b50ca7c92c5 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:58.722569 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9a565-8d4e-4ab7-a1b7-9b50ca7c92c5 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:58.722836 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9a565-8d4e-4ab7-a1b7-9b50ca7c92c5 None admin] PATH_INFO: `/v3/users/70de1109b913476ab680905869ddb04f` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:58.724215 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9a565-8d4e-4ab7-a1b7-9b50ca7c92c5 None admin] RBAC: Authorizing `identity:get_user(user_id=70de1109b913476ab680905869ddb04f)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:58.726481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9a565-8d4e-4ab7-a1b7-9b50ca7c92c5 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:58.728572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 564/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:55:58 2022] GET /identity/v3/users/70de1109b913476ab680905869ddb04f => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:58.734664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb0c49-bc31-4398-86a5-3789baa506b0 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:58.860604 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:58.871230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb0c49-bc31-4398-86a5-3789baa506b0 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:58.924479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728626-829c-4969-9e45-38b73e503998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:58.925118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728626-829c-4969-9e45-38b73e503998 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:58.925402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728626-829c-4969-9e45-38b73e503998 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:58.925676 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728626-829c-4969-9e45-38b73e503998 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:59.005473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728626-829c-4969-9e45-38b73e503998 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:59.007245 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728626-829c-4969-9e45-38b73e503998 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:59.130040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:59.139047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 564/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:55:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 12:55:59.145588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9a565-8d4e-4ab7-a1b7-9b50ca7c92c5 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:59.169402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:59.313824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9a565-8d4e-4ab7-a1b7-9b50ca7c92c5 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:59.396334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03a768-b282-4445-be6e-f88827c78f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:59.397099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03a768-b282-4445-be6e-f88827c78f4a None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:59.397431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03a768-b282-4445-be6e-f88827c78f4a None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:59.397722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03a768-b282-4445-be6e-f88827c78f4a None admin] PATH_INFO: `/v3/projects/0f099db852624d36b747e0868f04f72f` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:59.399102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03a768-b282-4445-be6e-f88827c78f4a None admin] RBAC: Authorizing `identity:get_project(project_id=0f099db852624d36b747e0868f04f72f)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:59.400943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03a768-b282-4445-be6e-f88827c78f4a None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:59.402590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 565/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:55:59 2022] GET /identity/v3/projects/0f099db852624d36b747e0868f04f72f => generated 311 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:59.409644 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728626-829c-4969-9e45-38b73e503998 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:59.530811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728626-829c-4969-9e45-38b73e503998 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:59.576167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00b663-d50f-4010-8cbf-2bb5867db572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:59.576722 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00b663-d50f-4010-8cbf-2bb5867db572 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:59.576977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00b663-d50f-4010-8cbf-2bb5867db572 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:59.577276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00b663-d50f-4010-8cbf-2bb5867db572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:59.578122 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00b663-d50f-4010-8cbf-2bb5867db572 None admin] RBAC: Adding query filter params (role.id=0560a82175224c8e86d1b430212748d4, scope.project.id=0f099db852624d36b747e0868f04f72f, user.id=70de1109b913476ab680905869ddb04f) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:59.578509 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00b663-d50f-4010-8cbf-2bb5867db572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:59.580090 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00b663-d50f-4010-8cbf-2bb5867db572 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:59.588934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 565/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:55:59 2022] GET /identity/v3/role_assignments?user.id=70de1109b913476ab680905869ddb04f&scope.project.id=0f099db852624d36b747e0868f04f72f&role.id=0560a82175224c8e86d1b430212748d4 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:02.055108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccb1c6-a007-422e-8e28-cf02db310346 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:02.055704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccb1c6-a007-422e-8e28-cf02db310346 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:02.055704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccb1c6-a007-422e-8e28-cf02db310346 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:02.057381 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 566/1131] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:02.065766 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb3d37-7417-4114-9f91-0d6da817324a None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:02.067034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb3d37-7417-4114-9f91-0d6da817324a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:02.067034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb3d37-7417-4114-9f91-0d6da817324a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:02.090080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-12cb3d37-7417-4114-9f91-0d6da817324a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:02.091303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-12cb3d37-7417-4114-9f91-0d6da817324a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:02.178501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:02.198106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 566/1132] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:02.485548 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccb1c6-a007-422e-8e28-cf02db310346 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:02.599724 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:02.620618 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccb1c6-a007-422e-8e28-cf02db310346 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:02.664841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dac96-6243-4930-831e-96f2a7048348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:02.665647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dac96-6243-4930-831e-96f2a7048348 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:02.666096 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dac96-6243-4930-831e-96f2a7048348 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:02.666554 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dac96-6243-4930-831e-96f2a7048348 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:02.668099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49dac96-6243-4930-831e-96f2a7048348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:02.670052 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49dac96-6243-4930-831e-96f2a7048348 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:02.671880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 567/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:56:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:02.678849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb3d37-7417-4114-9f91-0d6da817324a None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:02.807822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb3d37-7417-4114-9f91-0d6da817324a None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:02.860165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da562a-a4a4-4335-b2e4-061e440c36ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:02.861225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da562a-a4a4-4335-b2e4-061e440c36ec None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:02.861706 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da562a-a4a4-4335-b2e4-061e440c36ec None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:02.862401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da562a-a4a4-4335-b2e4-061e440c36ec None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:02.864050 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da562a-a4a4-4335-b2e4-061e440c36ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:02.867883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da562a-a4a4-4335-b2e4-061e440c36ec None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:02.911281 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 567/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Sep 7 12:56:02 2022] POST /identity/v3/projects => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:56:05.253543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda877d7-09f7-4081-bf9f-75b5139c9fec None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:05.254346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda877d7-09f7-4081-bf9f-75b5139c9fec None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:05.254346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda877d7-09f7-4081-bf9f-75b5139c9fec None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:05.255686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 568/1135] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:05.261879 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83d9ec-1f89-4d07-ab70-6a901d5fab18 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:05.262427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83d9ec-1f89-4d07-ab70-6a901d5fab18 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:05.262427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83d9ec-1f89-4d07-ab70-6a901d5fab18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:05.283360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ef83d9ec-1f89-4d07-ab70-6a901d5fab18 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:05.284803 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ef83d9ec-1f89-4d07-ab70-6a901d5fab18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:05.333815 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:05.371407 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 568/1136] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:05.654629 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda877d7-09f7-4081-bf9f-75b5139c9fec None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:05.782742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda877d7-09f7-4081-bf9f-75b5139c9fec None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:05.828522 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f776b9f-5f5b-4dd0-816a-3b273f718e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:05.829353 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f776b9f-5f5b-4dd0-816a-3b273f718e73 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:05.829718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f776b9f-5f5b-4dd0-816a-3b273f718e73 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:05.830092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f776b9f-5f5b-4dd0-816a-3b273f718e73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:05.831501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f776b9f-5f5b-4dd0-816a-3b273f718e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:05.833945 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f776b9f-5f5b-4dd0-816a-3b273f718e73 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:05.836046 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 569/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:56:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:05.842648 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83d9ec-1f89-4d07-ab70-6a901d5fab18 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:05.996594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83d9ec-1f89-4d07-ab70-6a901d5fab18 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:06.043297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e24d8-1595-4684-8312-10144c2fa7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:06.043931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e24d8-1595-4684-8312-10144c2fa7c0 None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:06.044239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e24d8-1595-4684-8312-10144c2fa7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:06.044553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e24d8-1595-4684-8312-10144c2fa7c0 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:06.045279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e24d8-1595-4684-8312-10144c2fa7c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:06.046734 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e24d8-1595-4684-8312-10144c2fa7c0 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:06.071797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 569/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:56:05 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:56:08.504188 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94953d0a-365f-4d6d-82dd-d8eebf66a938 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:08.504806 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94953d0a-365f-4d6d-82dd-d8eebf66a938 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:08.505105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94953d0a-365f-4d6d-82dd-d8eebf66a938 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:08.507244 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 570/1139] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:56:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:08.514380 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947e120-de2c-4a84-81ac-8a43507ec675 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:08.514862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947e120-de2c-4a84-81ac-8a43507ec675 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:08.515103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947e120-de2c-4a84-81ac-8a43507ec675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:08.542982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-1947e120-de2c-4a84-81ac-8a43507ec675 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:08.544229 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-1947e120-de2c-4a84-81ac-8a43507ec675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:08.571984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:08.627623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 570/1140] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:08.917695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94953d0a-365f-4d6d-82dd-d8eebf66a938 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:08.949027 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:09.059622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94953d0a-365f-4d6d-82dd-d8eebf66a938 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:09.107868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f3e9d-528b-4998-8177-0b4cf8107645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:09.108561 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f3e9d-528b-4998-8177-0b4cf8107645 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:09.108840 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f3e9d-528b-4998-8177-0b4cf8107645 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:09.109120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f3e9d-528b-4998-8177-0b4cf8107645 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:09.121821 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f3e9d-528b-4998-8177-0b4cf8107645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-947f3e9d-528b-4998-8177-0b4cf8107645 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:56:09.127097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:09.129000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:09.130377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:09.130377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:09.130377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:09.130377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:09.130377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:56:09.130377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:56:09.130377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:56:09.130377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:56:09.130377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:56:09.130377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:56:09.130377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:09.130377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:56:09.130377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 571/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:56:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:09.135303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947e120-de2c-4a84-81ac-8a43507ec675 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:09.274822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947e120-de2c-4a84-81ac-8a43507ec675 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:09.323623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2634a97-5841-4304-b0f7-ea56959844c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:09.324264 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2634a97-5841-4304-b0f7-ea56959844c7 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:09.324575 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2634a97-5841-4304-b0f7-ea56959844c7 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:09.324859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2634a97-5841-4304-b0f7-ea56959844c7 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:09.325567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2634a97-5841-4304-b0f7-ea56959844c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:09.325868 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2634a97-5841-4304-b0f7-ea56959844c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:09.327321 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2634a97-5841-4304-b0f7-ea56959844c7 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:09.337922 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 571/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:56:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:56:09.344699 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f3e9d-528b-4998-8177-0b4cf8107645 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:09.450982 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:09.475382 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f3e9d-528b-4998-8177-0b4cf8107645 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:09.513799 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a95fd-3597-4a24-b6ee-cdfd053af67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:09.514529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a95fd-3597-4a24-b6ee-cdfd053af67b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:09.514719 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a95fd-3597-4a24-b6ee-cdfd053af67b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:09.515013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a95fd-3597-4a24-b6ee-cdfd053af67b None admin] PATH_INFO: `/v3/users/a9a54798f4764c4484a9b277de1df5d2` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:09.530878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a95fd-3597-4a24-b6ee-cdfd053af67b None admin] RBAC: Authorizing `identity:get_user(user_id=a9a54798f4764c4484a9b277de1df5d2)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:09.532446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a95fd-3597-4a24-b6ee-cdfd053af67b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:09.534287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 572/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:56:09 2022] GET /identity/v3/users/a9a54798f4764c4484a9b277de1df5d2 => generated 286 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:09.541297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2634a97-5841-4304-b0f7-ea56959844c7 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:09.567649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:09.669523 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2634a97-5841-4304-b0f7-ea56959844c7 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:09.711565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed47b7-9b8f-45fc-a61f-0d40e94d6f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:09.712170 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed47b7-9b8f-45fc-a61f-0d40e94d6f39 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:09.712479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed47b7-9b8f-45fc-a61f-0d40e94d6f39 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:09.712754 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed47b7-9b8f-45fc-a61f-0d40e94d6f39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:09.799734 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed47b7-9b8f-45fc-a61f-0d40e94d6f39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:09.801732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed47b7-9b8f-45fc-a61f-0d40e94d6f39 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:09.826893 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:09.960322 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 572/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:56:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:56:09.970490 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a95fd-3597-4a24-b6ee-cdfd053af67b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:10.122927 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a95fd-3597-4a24-b6ee-cdfd053af67b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:10.176815 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689f063-9d32-451a-b3e6-285b31d972e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:10.177611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689f063-9d32-451a-b3e6-285b31d972e1 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:10.177966 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689f063-9d32-451a-b3e6-285b31d972e1 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:10.178171 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689f063-9d32-451a-b3e6-285b31d972e1 None admin] PATH_INFO: `/v3/projects/3494200244a8406fb0c692a22f271ba6` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:10.179517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689f063-9d32-451a-b3e6-285b31d972e1 None admin] RBAC: Authorizing `identity:get_project(project_id=3494200244a8406fb0c692a22f271ba6)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:10.181271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689f063-9d32-451a-b3e6-285b31d972e1 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:10.183185 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 573/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:56:09 2022] GET /identity/v3/projects/3494200244a8406fb0c692a22f271ba6 => generated 311 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:10.190304 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed47b7-9b8f-45fc-a61f-0d40e94d6f39 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:10.323313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed47b7-9b8f-45fc-a61f-0d40e94d6f39 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:10.346087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:10.363377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0770238-de84-4fd4-9547-d40757802b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:10.364133 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0770238-de84-4fd4-9547-d40757802b23 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:10.364464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0770238-de84-4fd4-9547-d40757802b23 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:10.364758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0770238-de84-4fd4-9547-d40757802b23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:10.365622 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0770238-de84-4fd4-9547-d40757802b23 None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=3494200244a8406fb0c692a22f271ba6, user.id=a9a54798f4764c4484a9b277de1df5d2) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:10.365952 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0770238-de84-4fd4-9547-d40757802b23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:10.367604 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0770238-de84-4fd4-9547-d40757802b23 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:10.375419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 573/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:56:10 2022] GET /identity/v3/role_assignments?user.id=a9a54798f4764c4484a9b277de1df5d2&scope.project.id=3494200244a8406fb0c692a22f271ba6&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:12.764434 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c3a10-69dd-4f1a-b4ea-5be1ce8bc486 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:12.765029 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c3a10-69dd-4f1a-b4ea-5be1ce8bc486 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:12.765142 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c3a10-69dd-4f1a-b4ea-5be1ce8bc486 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:12.766727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 574/1147] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:12.773255 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0347b98-3886-46c3-aa2a-23a53a8f0876 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:12.773939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0347b98-3886-46c3-aa2a-23a53a8f0876 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:12.773939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0347b98-3886-46c3-aa2a-23a53a8f0876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:12.802441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-a0347b98-3886-46c3-aa2a-23a53a8f0876 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:12.803908 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a0347b98-3886-46c3-aa2a-23a53a8f0876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:12.903198 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 574/1148] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:56:13.202325 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c3a10-69dd-4f1a-b4ea-5be1ce8bc486 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:13.213178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:13.324501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c3a10-69dd-4f1a-b4ea-5be1ce8bc486 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:13.366134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71715e95-7d80-4dff-ba92-4a3fe4f1b820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:13.366804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71715e95-7d80-4dff-ba92-4a3fe4f1b820 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:13.367173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71715e95-7d80-4dff-ba92-4a3fe4f1b820 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:13.367429 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71715e95-7d80-4dff-ba92-4a3fe4f1b820 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:13.380817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71715e95-7d80-4dff-ba92-4a3fe4f1b820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-71715e95-7d80-4dff-ba92-4a3fe4f1b820 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:56:13.387040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:13.388476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:13.389430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:13.389430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:13.389430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:13.389430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:13.389430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:56:13.389430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:56:13.389430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:56:13.389430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:56:13.389430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:56:13.389430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:56:13.389430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:13.389430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:56:13.389430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 575/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:56:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:13.398569 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0347b98-3886-46c3-aa2a-23a53a8f0876 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:13.533211 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0347b98-3886-46c3-aa2a-23a53a8f0876 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:13.550367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:13.574533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492b307-d390-4a58-83cf-78094c2b8afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:13.575175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492b307-d390-4a58-83cf-78094c2b8afb None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:13.575454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492b307-d390-4a58-83cf-78094c2b8afb None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:13.575726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492b307-d390-4a58-83cf-78094c2b8afb None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:13.576452 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492b307-d390-4a58-83cf-78094c2b8afb None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:13.576758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492b307-d390-4a58-83cf-78094c2b8afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:13.578195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492b307-d390-4a58-83cf-78094c2b8afb None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:13.588129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 575/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:56:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:13.594591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71715e95-7d80-4dff-ba92-4a3fe4f1b820 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:13.666508 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:13.707895 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71715e95-7d80-4dff-ba92-4a3fe4f1b820 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:13.744610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36b090-88f8-4af4-8a2f-af7f0804da3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:13.745524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36b090-88f8-4af4-8a2f-af7f0804da3e None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:13.745956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36b090-88f8-4af4-8a2f-af7f0804da3e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:13.746430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36b090-88f8-4af4-8a2f-af7f0804da3e None admin] PATH_INFO: `/v3/users/a9a54798f4764c4484a9b277de1df5d2` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:13.748405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36b090-88f8-4af4-8a2f-af7f0804da3e None admin] RBAC: Authorizing `identity:get_user(user_id=a9a54798f4764c4484a9b277de1df5d2)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:13.750997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36b090-88f8-4af4-8a2f-af7f0804da3e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:13.752977 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 576/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:56:13 2022] GET /identity/v3/users/a9a54798f4764c4484a9b277de1df5d2 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:13.759175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492b307-d390-4a58-83cf-78094c2b8afb None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:13.869499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492b307-d390-4a58-83cf-78094c2b8afb None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:13.906477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822afd7-92d3-4f1e-be17-4324dc68864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:13.907112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822afd7-92d3-4f1e-be17-4324dc68864f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:13.907390 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822afd7-92d3-4f1e-be17-4324dc68864f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:13.907661 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822afd7-92d3-4f1e-be17-4324dc68864f None admin] PATH_INFO: `/v3/projects/3494200244a8406fb0c692a22f271ba6` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:13.908873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822afd7-92d3-4f1e-be17-4324dc68864f None admin] RBAC: Authorizing `identity:get_project(project_id=3494200244a8406fb0c692a22f271ba6)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:13.910996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822afd7-92d3-4f1e-be17-4324dc68864f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:13.912687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 576/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:56:13 2022] GET /identity/v3/projects/3494200244a8406fb0c692a22f271ba6 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:13.918977 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36b090-88f8-4af4-8a2f-af7f0804da3e None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:14.030666 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36b090-88f8-4af4-8a2f-af7f0804da3e None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:14.067953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58193b96-bdf2-443e-a119-47a83661da75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:14.068642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193b96-bdf2-443e-a119-47a83661da75 None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:14.068938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193b96-bdf2-443e-a119-47a83661da75 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:14.069209 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193b96-bdf2-443e-a119-47a83661da75 None admin] PATH_INFO: `/v3/projects/3494200244a8406fb0c692a22f271ba6/users/a9a54798f4764c4484a9b277de1df5d2/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:14.071172 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58193b96-bdf2-443e-a119-47a83661da75 None admin] RBAC: Authorizing `identity:create_grant(project_id=3494200244a8406fb0c692a22f271ba6, user_id=a9a54798f4764c4484a9b277de1df5d2, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:14.072682 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58193b96-bdf2-443e-a119-47a83661da75 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:14.074939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:14.088715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 577/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:56:13 2022] PUT /identity/v3/projects/3494200244a8406fb0c692a22f271ba6/users/a9a54798f4764c4484a9b277de1df5d2/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:56:16.286469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b2a27-542b-4b53-aa01-8537ebe009b0 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:16.287049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b2a27-542b-4b53-aa01-8537ebe009b0 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:16.287049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b2a27-542b-4b53-aa01-8537ebe009b0 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:16.288404 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 577/1154] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:16.294158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc83fb-8ca1-4236-bed6-c1a00035823a None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:16.294698 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc83fb-8ca1-4236-bed6-c1a00035823a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:16.294698 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc83fb-8ca1-4236-bed6-c1a00035823a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:16.314166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-c6dc83fb-8ca1-4236-bed6-c1a00035823a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:16.315389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c6dc83fb-8ca1-4236-bed6-c1a00035823a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:16.408828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 578/1155] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:16.680937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b2a27-542b-4b53-aa01-8537ebe009b0 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:16.732257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:16.826593 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b2a27-542b-4b53-aa01-8537ebe009b0 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:16.864206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454883c-440d-4ff6-9f43-a58243403116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:16.864882 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454883c-440d-4ff6-9f43-a58243403116 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:16.865155 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454883c-440d-4ff6-9f43-a58243403116 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:16.865417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454883c-440d-4ff6-9f43-a58243403116 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:16.879007 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454883c-440d-4ff6-9f43-a58243403116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-7454883c-440d-4ff6-9f43-a58243403116 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:56:16.884149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:16.885377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:16.886448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:16.886448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:16.886448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:16.886448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:16.886448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:56:16.886448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:56:16.886448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:56:16.886448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:56:16.886448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:56:16.886448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:56:16.886448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:16.886448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:56:16.886448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 578/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:56:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:16.891817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc83fb-8ca1-4236-bed6-c1a00035823a None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:17.011835 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc83fb-8ca1-4236-bed6-c1a00035823a None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:17.039057 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:17.054140 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85cd15-1521-4a86-bd08-74f00aeb301f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:17.054758 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85cd15-1521-4a86-bd08-74f00aeb301f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:17.055045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85cd15-1521-4a86-bd08-74f00aeb301f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:17.055315 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85cd15-1521-4a86-bd08-74f00aeb301f None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:17.055998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85cd15-1521-4a86-bd08-74f00aeb301f None admin] RBAC: Adding query filter params (name=admin) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:17.056304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85cd15-1521-4a86-bd08-74f00aeb301f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:17.057725 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85cd15-1521-4a86-bd08-74f00aeb301f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:17.066874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 579/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:56:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:17.073181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454883c-440d-4ff6-9f43-a58243403116 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:17.196938 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454883c-440d-4ff6-9f43-a58243403116 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:17.206814 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:17.251069 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01fc16-3541-41c3-b5c4-47c0c816edc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:17.251730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01fc16-3541-41c3-b5c4-47c0c816edc4 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:17.252293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01fc16-3541-41c3-b5c4-47c0c816edc4 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:17.252595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01fc16-3541-41c3-b5c4-47c0c816edc4 None admin] PATH_INFO: `/v3/users/a9a54798f4764c4484a9b277de1df5d2` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:17.253816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01fc16-3541-41c3-b5c4-47c0c816edc4 None admin] RBAC: Authorizing `identity:get_user(user_id=a9a54798f4764c4484a9b277de1df5d2)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:17.255286 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01fc16-3541-41c3-b5c4-47c0c816edc4 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:17.256963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 579/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:56:17 2022] GET /identity/v3/users/a9a54798f4764c4484a9b277de1df5d2 => generated 286 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:17.266513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85cd15-1521-4a86-bd08-74f00aeb301f None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:17.399537 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85cd15-1521-4a86-bd08-74f00aeb301f None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:17.445362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b07303-1f56-490e-a037-d8ba0db2de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:17.445984 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b07303-1f56-490e-a037-d8ba0db2de69 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:17.446294 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b07303-1f56-490e-a037-d8ba0db2de69 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:17.446545 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b07303-1f56-490e-a037-d8ba0db2de69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:17.512236 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:17.528219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b07303-1f56-490e-a037-d8ba0db2de69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:17.529882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b07303-1f56-490e-a037-d8ba0db2de69 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:17.667350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 580/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:56:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:56:17.673513 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01fc16-3541-41c3-b5c4-47c0c816edc4 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:17.787861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01fc16-3541-41c3-b5c4-47c0c816edc4 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:17.825703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54297619-1e27-42dd-83e0-6cb72b972e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:17.826337 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54297619-1e27-42dd-83e0-6cb72b972e11 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:17.826611 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54297619-1e27-42dd-83e0-6cb72b972e11 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:17.826876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54297619-1e27-42dd-83e0-6cb72b972e11 None admin] PATH_INFO: `/v3/projects/3494200244a8406fb0c692a22f271ba6` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:17.828045 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54297619-1e27-42dd-83e0-6cb72b972e11 None admin] RBAC: Authorizing `identity:get_project(project_id=3494200244a8406fb0c692a22f271ba6)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:17.829510 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54297619-1e27-42dd-83e0-6cb72b972e11 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:17.831134 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 580/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:56:17 2022] GET /identity/v3/projects/3494200244a8406fb0c692a22f271ba6 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:17.837767 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b07303-1f56-490e-a037-d8ba0db2de69 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:17.932985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:17.951206 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b07303-1f56-490e-a037-d8ba0db2de69 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:17.993248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f5f89-64b2-4aec-b103-4e25fc51546b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:17.993874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f5f89-64b2-4aec-b103-4e25fc51546b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:17.994153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f5f89-64b2-4aec-b103-4e25fc51546b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:17.994421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f5f89-64b2-4aec-b103-4e25fc51546b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:17.995161 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f5f89-64b2-4aec-b103-4e25fc51546b None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=3494200244a8406fb0c692a22f271ba6, user.id=a9a54798f4764c4484a9b277de1df5d2) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:17.995524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f5f89-64b2-4aec-b103-4e25fc51546b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:17.997029 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f5f89-64b2-4aec-b103-4e25fc51546b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:18.004915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 581/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:56:17 2022] GET /identity/v3/role_assignments?user.id=a9a54798f4764c4484a9b277de1df5d2&scope.project.id=3494200244a8406fb0c692a22f271ba6&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:20.228080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6b750-d5c2-47b8-9491-58b8563f8d75 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:20.228869 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6b750-d5c2-47b8-9491-58b8563f8d75 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:20.228869 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6b750-d5c2-47b8-9491-58b8563f8d75 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:20.230259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 581/1162] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:20.235929 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feddd9-b830-47ac-b7a2-f74247bbdd47 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:20.236568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feddd9-b830-47ac-b7a2-f74247bbdd47 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:20.236568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feddd9-b830-47ac-b7a2-f74247bbdd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:20.256300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-94feddd9-b830-47ac-b7a2-f74247bbdd47 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:20.257552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-94feddd9-b830-47ac-b7a2-f74247bbdd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:20.330338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 582/1163] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:20.619139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6b750-d5c2-47b8-9491-58b8563f8d75 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:20.672916 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:20.737374 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6b750-d5c2-47b8-9491-58b8563f8d75 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:20.776056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a040b3-24a4-41ff-ae93-38002df20632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:20.776717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a040b3-24a4-41ff-ae93-38002df20632 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:20.776997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a040b3-24a4-41ff-ae93-38002df20632 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:20.777269 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a040b3-24a4-41ff-ae93-38002df20632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:20.856290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a040b3-24a4-41ff-ae93-38002df20632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:20.857915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a040b3-24a4-41ff-ae93-38002df20632 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:20.902223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:20.972089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 582/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:56:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:56:20.978763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94feddd9-b830-47ac-b7a2-f74247bbdd47 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:21.067496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:21.089049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94feddd9-b830-47ac-b7a2-f74247bbdd47 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:21.128099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35b0cc-be4b-44ee-ab49-8669d253b512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:21.128927 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35b0cc-be4b-44ee-ab49-8669d253b512 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:21.128927 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35b0cc-be4b-44ee-ab49-8669d253b512 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:21.129529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35b0cc-be4b-44ee-ab49-8669d253b512 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:21.136645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35b0cc-be4b-44ee-ab49-8669d253b512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:21.138222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35b0cc-be4b-44ee-ab49-8669d253b512 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-eb35b0cc-be4b-44ee-ab49-8669d253b512 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:21.159579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:21.161198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:21.162354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:21.162354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:21.162354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:21.162354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:21.162354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:21.162354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:21.162354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:21.162354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:21.162354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:21.162354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:21.162354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 07 12:56:21.162354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:56:21.162354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 07 12:56:21.162354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:56:21.162354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 583/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Sep 7 12:56:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:21.167321 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a040b3-24a4-41ff-ae93-38002df20632 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:21.280346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a040b3-24a4-41ff-ae93-38002df20632 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:21.317040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b5c28-4161-4ee1-a800-124dbdb1781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:21.317655 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5c28-4161-4ee1-a800-124dbdb1781d None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:21.317932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5c28-4161-4ee1-a800-124dbdb1781d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:21.318205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5c28-4161-4ee1-a800-124dbdb1781d None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:21.318855 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b5c28-4161-4ee1-a800-124dbdb1781d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:21.319157 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b5c28-4161-4ee1-a800-124dbdb1781d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:21.320574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b5c28-4161-4ee1-a800-124dbdb1781d None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:21.328582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 583/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Sep 7 12:56:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:23.577115 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f088258-a817-431c-8075-250e2cd62a91 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:23.577703 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f088258-a817-431c-8075-250e2cd62a91 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:23.577703 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f088258-a817-431c-8075-250e2cd62a91 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:23.579145 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 584/1167] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:23.585794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219518a-7aa6-4648-9048-a34c3c55f92f None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:23.586396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219518a-7aa6-4648-9048-a34c3c55f92f None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:23.586396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219518a-7aa6-4648-9048-a34c3c55f92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:23.594459 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:23.607602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-9219518a-7aa6-4648-9048-a34c3c55f92f None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:23.608888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-9219518a-7aa6-4648-9048-a34c3c55f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:23.686789 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 584/1168] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:23.957325 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f088258-a817-431c-8075-250e2cd62a91 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:24.068463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f088258-a817-431c-8075-250e2cd62a91 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:24.108744 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d0d13-0164-43a3-a9e7-71bcc6ee0f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:24.109298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d0d13-0164-43a3-a9e7-71bcc6ee0f5c None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:24.109581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d0d13-0164-43a3-a9e7-71bcc6ee0f5c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:24.109859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d0d13-0164-43a3-a9e7-71bcc6ee0f5c None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:24.110556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d0d13-0164-43a3-a9e7-71bcc6ee0f5c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:24.111983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d0d13-0164-43a3-a9e7-71bcc6ee0f5c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:24.125153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:24.135927 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 585/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Wed Sep 7 12:56:23 2022] POST /identity/v3/domains => generated 267 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:56:26.440782 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab6616-b941-4683-8bdd-a75cc368d011 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:26.441364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab6616-b941-4683-8bdd-a75cc368d011 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:26.441513 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab6616-b941-4683-8bdd-a75cc368d011 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:26.443225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 585/1170] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:56:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:26.448801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03218096-3581-469c-b28b-fff5e74e453f None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:26.449246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03218096-3581-469c-b28b-fff5e74e453f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:26.449357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03218096-3581-469c-b28b-fff5e74e453f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:26.470044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-03218096-3581-469c-b28b-fff5e74e453f None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:26.471284 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-03218096-3581-469c-b28b-fff5e74e453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:26.540841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 586/1171] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:26.806323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab6616-b941-4683-8bdd-a75cc368d011 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:26.915695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab6616-b941-4683-8bdd-a75cc368d011 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:26.951582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc416d-6c16-4505-9940-568e7f7a4606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:26.952244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc416d-6c16-4505-9940-568e7f7a4606 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:26.952544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc416d-6c16-4505-9940-568e7f7a4606 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:26.952817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc416d-6c16-4505-9940-568e7f7a4606 None admin] PATH_INFO: `/v3/domains/7e167b9a37bb430f943b42b72083cbc6` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:26.954834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:26.965170 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc416d-6c16-4505-9940-568e7f7a4606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7e167b9a37bb430f943b42b72083cbc6)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:26.966638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc416d-6c16-4505-9940-568e7f7a4606 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:26.968307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 586/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Wed Sep 7 12:56:26 2022] GET /identity/v3/domains/7e167b9a37bb430f943b42b72083cbc6 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:26.975006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03218096-3581-469c-b28b-fff5e74e453f None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:27.082906 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03218096-3581-469c-b28b-fff5e74e453f None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:27.115371 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:27.122685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31183c9-cc03-4efe-9be5-bd4b4db0c1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:27.123313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31183c9-cc03-4efe-9be5-bd4b4db0c1d4 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:27.123593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31183c9-cc03-4efe-9be5-bd4b4db0c1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:27.123870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31183c9-cc03-4efe-9be5-bd4b4db0c1d4 None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:27.124562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31183c9-cc03-4efe-9be5-bd4b4db0c1d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:27.126031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31183c9-cc03-4efe-9be5-bd4b4db0c1d4 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:27.155659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 587/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Sep 7 12:56:26 2022] POST /identity/v3/projects => generated 361 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:56:29.389721 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6c440-bf7b-4f98-8b2f-9be58e4d6925 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:29.390339 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6c440-bf7b-4f98-8b2f-9be58e4d6925 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:29.390339 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6c440-bf7b-4f98-8b2f-9be58e4d6925 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:29.391621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 587/1174] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:29.399660 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f196bfc-1d96-4fcb-9b9c-eb7bf9bc907a None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:29.400164 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f196bfc-1d96-4fcb-9b9c-eb7bf9bc907a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:29.400164 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f196bfc-1d96-4fcb-9b9c-eb7bf9bc907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:29.419542 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-9f196bfc-1d96-4fcb-9b9c-eb7bf9bc907a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:29.420797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9f196bfc-1d96-4fcb-9b9c-eb7bf9bc907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:29.491465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 588/1175] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:29.760335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6c440-bf7b-4f98-8b2f-9be58e4d6925 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:29.869329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6c440-bf7b-4f98-8b2f-9be58e4d6925 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:29.905514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed56406-3ca8-4cb6-89ef-d679fb7a63bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:29.906145 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed56406-3ca8-4cb6-89ef-d679fb7a63bb None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:29.906417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed56406-3ca8-4cb6-89ef-d679fb7a63bb None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:29.906659 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed56406-3ca8-4cb6-89ef-d679fb7a63bb None admin] PATH_INFO: `/v3/domains/7e167b9a37bb430f943b42b72083cbc6` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:29.907821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed56406-3ca8-4cb6-89ef-d679fb7a63bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=7e167b9a37bb430f943b42b72083cbc6)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:29.909296 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed56406-3ca8-4cb6-89ef-d679fb7a63bb None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:29.911147 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 588/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Wed Sep 7 12:56:29 2022] GET /identity/v3/domains/7e167b9a37bb430f943b42b72083cbc6 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:29.917194 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f196bfc-1d96-4fcb-9b9c-eb7bf9bc907a None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:30.022313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f196bfc-1d96-4fcb-9b9c-eb7bf9bc907a None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:30.035673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:30.057928 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e60275-465e-4cba-99d0-03af59eb1e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:30.058573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e60275-465e-4cba-99d0-03af59eb1e8c None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:30.058852 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e60275-465e-4cba-99d0-03af59eb1e8c None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:30.059118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e60275-465e-4cba-99d0-03af59eb1e8c None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:30.059773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e60275-465e-4cba-99d0-03af59eb1e8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:30.061249 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e60275-465e-4cba-99d0-03af59eb1e8c None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:30.085384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 589/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:56:29 2022] POST /identity/v3/users => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:56:32.356708 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7dab7-3138-4514-bfec-9ddda63522f8 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:32.357320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7dab7-3138-4514-bfec-9ddda63522f8 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:32.357320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7dab7-3138-4514-bfec-9ddda63522f8 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:32.358553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 589/1178] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:32.364290 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2be88-87a3-4702-81f7-0789229898ac None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:32.364764 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2be88-87a3-4702-81f7-0789229898ac None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:32.364856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2be88-87a3-4702-81f7-0789229898ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:32.385216 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-d3c2be88-87a3-4702-81f7-0789229898ac None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:32.386447 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d3c2be88-87a3-4702-81f7-0789229898ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:32.461662 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 590/1179] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:32.727343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7dab7-3138-4514-bfec-9ddda63522f8 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:32.792733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:32.833633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7dab7-3138-4514-bfec-9ddda63522f8 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:32.871097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2966a-bc74-49a3-82e4-185fbddf12bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:32.871720 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2966a-bc74-49a3-82e4-185fbddf12bf None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:32.871994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2966a-bc74-49a3-82e4-185fbddf12bf None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:32.872262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2966a-bc74-49a3-82e4-185fbddf12bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:32.883220 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2966a-bc74-49a3-82e4-185fbddf12bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-c2c2966a-bc74-49a3-82e4-185fbddf12bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:56:32.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:32.889166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:32.890227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:32.890227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:32.890227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:32.890227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:32.890227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:56:32.890227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:56:32.890227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:56:32.890227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:56:32.890227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:56:32.890227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:56:32.890227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:32.890227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:56:32.890227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 590/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:56:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:32.895722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2be88-87a3-4702-81f7-0789229898ac None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:33.003269 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:33.008032 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2be88-87a3-4702-81f7-0789229898ac None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:33.045413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1daf31-7365-49a4-b5a1-d9401df6abb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:33.046026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1daf31-7365-49a4-b5a1-d9401df6abb8 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:33.046298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1daf31-7365-49a4-b5a1-d9401df6abb8 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:33.046582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1daf31-7365-49a4-b5a1-d9401df6abb8 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:33.047253 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1daf31-7365-49a4-b5a1-d9401df6abb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:33.047555 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1daf31-7365-49a4-b5a1-d9401df6abb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:33.048992 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1daf31-7365-49a4-b5a1-d9401df6abb8 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:33.058059 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 591/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:56:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:56:33.064387 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2966a-bc74-49a3-82e4-185fbddf12bf None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:33.172243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2966a-bc74-49a3-82e4-185fbddf12bf None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:33.196153 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:33.209927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db92d7-9f12-4566-9133-fbdccd54e5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:33.210568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db92d7-9f12-4566-9133-fbdccd54e5cc None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:33.210850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db92d7-9f12-4566-9133-fbdccd54e5cc None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:33.211122 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db92d7-9f12-4566-9133-fbdccd54e5cc None admin] PATH_INFO: `/v3/users/6c346391122446f48287d152231e4e2c` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:33.225475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db92d7-9f12-4566-9133-fbdccd54e5cc None admin] RBAC: Authorizing `identity:get_user(user_id=6c346391122446f48287d152231e4e2c)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:33.226939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db92d7-9f12-4566-9133-fbdccd54e5cc None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:33.228860 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 591/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:56:33 2022] GET /identity/v3/users/6c346391122446f48287d152231e4e2c => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:33.234752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1daf31-7365-49a4-b5a1-d9401df6abb8 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:33.345199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1daf31-7365-49a4-b5a1-d9401df6abb8 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:33.384266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d53fb-70ae-4cb2-9af0-2fb0d355790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:33.385026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d53fb-70ae-4cb2-9af0-2fb0d355790d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:33.385129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d53fb-70ae-4cb2-9af0-2fb0d355790d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:33.385426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d53fb-70ae-4cb2-9af0-2fb0d355790d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:33.415416 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:33.460161 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d53fb-70ae-4cb2-9af0-2fb0d355790d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:33.461819 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d53fb-70ae-4cb2-9af0-2fb0d355790d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:33.568208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 592/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:56:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:56:33.574818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db92d7-9f12-4566-9133-fbdccd54e5cc None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:33.684799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db92d7-9f12-4566-9133-fbdccd54e5cc None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:33.720464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656a5cb-f15f-4610-8434-4d0dbac9e23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:33.721094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656a5cb-f15f-4610-8434-4d0dbac9e23a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:33.721373 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656a5cb-f15f-4610-8434-4d0dbac9e23a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:33.721645 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656a5cb-f15f-4610-8434-4d0dbac9e23a None admin] PATH_INFO: `/v3/projects/1513d7c8f30e4d4aa5813ab13bce88eb` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:33.722914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656a5cb-f15f-4610-8434-4d0dbac9e23a None admin] RBAC: Authorizing `identity:get_project(project_id=1513d7c8f30e4d4aa5813ab13bce88eb)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:33.724601 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656a5cb-f15f-4610-8434-4d0dbac9e23a None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:33.726268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 592/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:56:33 2022] GET /identity/v3/projects/1513d7c8f30e4d4aa5813ab13bce88eb => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:33.733072 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d53fb-70ae-4cb2-9af0-2fb0d355790d None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:33.796041 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:33.838851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d53fb-70ae-4cb2-9af0-2fb0d355790d None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:33.875801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efff94-b2f3-4b6d-b542-03bccfe4316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:33.876653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efff94-b2f3-4b6d-b542-03bccfe4316d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:33.876937 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efff94-b2f3-4b6d-b542-03bccfe4316d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:33.877211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efff94-b2f3-4b6d-b542-03bccfe4316d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:33.878241 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efff94-b2f3-4b6d-b542-03bccfe4316d None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=1513d7c8f30e4d4aa5813ab13bce88eb, user.id=6c346391122446f48287d152231e4e2c) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:33.878550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efff94-b2f3-4b6d-b542-03bccfe4316d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:33.880020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efff94-b2f3-4b6d-b542-03bccfe4316d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:33.885828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 593/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:56:33 2022] GET /identity/v3/role_assignments?user.id=6c346391122446f48287d152231e4e2c&scope.project.id=1513d7c8f30e4d4aa5813ab13bce88eb&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:36.060986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcb87d-b1ef-4c6c-8b71-1e8fbf433dc3 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:36.061561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcb87d-b1ef-4c6c-8b71-1e8fbf433dc3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:36.061561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcb87d-b1ef-4c6c-8b71-1e8fbf433dc3 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:36.062902 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 593/1186] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:36.069119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea472125-f5bf-449e-97a3-7c6b0d6c155f None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:36.069632 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea472125-f5bf-449e-97a3-7c6b0d6c155f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:36.069632 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea472125-f5bf-449e-97a3-7c6b0d6c155f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:36.089338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-ea472125-f5bf-449e-97a3-7c6b0d6c155f None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:36.090614 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ea472125-f5bf-449e-97a3-7c6b0d6c155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:36.164528 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 594/1187] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:36.434326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcb87d-b1ef-4c6c-8b71-1e8fbf433dc3 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:36.487898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:36.547140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcb87d-b1ef-4c6c-8b71-1e8fbf433dc3 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:36.587053 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab98b10-7751-457b-a68d-47b990abed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:36.587689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab98b10-7751-457b-a68d-47b990abed84 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:36.587957 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab98b10-7751-457b-a68d-47b990abed84 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:36.588217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab98b10-7751-457b-a68d-47b990abed84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:36.599496 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab98b10-7751-457b-a68d-47b990abed84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-dab98b10-7751-457b-a68d-47b990abed84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:56:36.604421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:36.606156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:36.607343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:36.607343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:36.607343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:36.607343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:36.607343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:56:36.607343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:56:36.607343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:56:36.607343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:56:36.607343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:56:36.607343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:56:36.607343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:36.607343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:56:36.607343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 594/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:56:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:36.612257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea472125-f5bf-449e-97a3-7c6b0d6c155f None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:36.675471 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:36.731711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea472125-f5bf-449e-97a3-7c6b0d6c155f None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:36.769168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5918eeb-69d9-4b2a-98e7-99c8d7bbf700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:36.770042 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5918eeb-69d9-4b2a-98e7-99c8d7bbf700 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:36.770748 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5918eeb-69d9-4b2a-98e7-99c8d7bbf700 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:36.771024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5918eeb-69d9-4b2a-98e7-99c8d7bbf700 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:36.771709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5918eeb-69d9-4b2a-98e7-99c8d7bbf700 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:36.772013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5918eeb-69d9-4b2a-98e7-99c8d7bbf700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:36.773456 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5918eeb-69d9-4b2a-98e7-99c8d7bbf700 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:36.782760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 595/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:56:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:36.789586 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab98b10-7751-457b-a68d-47b990abed84 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:36.897273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab98b10-7751-457b-a68d-47b990abed84 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:36.907215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:36.934402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83317d02-7422-4c9e-8a83-1a32efe8f428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:36.935048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83317d02-7422-4c9e-8a83-1a32efe8f428 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:36.935432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83317d02-7422-4c9e-8a83-1a32efe8f428 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:36.935702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83317d02-7422-4c9e-8a83-1a32efe8f428 None admin] PATH_INFO: `/v3/users/6c346391122446f48287d152231e4e2c` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:36.936900 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83317d02-7422-4c9e-8a83-1a32efe8f428 None admin] RBAC: Authorizing `identity:get_user(user_id=6c346391122446f48287d152231e4e2c)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:36.938356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83317d02-7422-4c9e-8a83-1a32efe8f428 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:36.939962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 595/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:56:36 2022] GET /identity/v3/users/6c346391122446f48287d152231e4e2c => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:36.946768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5918eeb-69d9-4b2a-98e7-99c8d7bbf700 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:37.057264 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5918eeb-69d9-4b2a-98e7-99c8d7bbf700 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:37.075510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:37.095034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3576b-30d8-4a18-85f2-d208e52679ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:37.095668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3576b-30d8-4a18-85f2-d208e52679ac None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:37.095956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3576b-30d8-4a18-85f2-d208e52679ac None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:37.096211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3576b-30d8-4a18-85f2-d208e52679ac None admin] PATH_INFO: `/v3/projects/1513d7c8f30e4d4aa5813ab13bce88eb` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:37.097373 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3576b-30d8-4a18-85f2-d208e52679ac None admin] RBAC: Authorizing `identity:get_project(project_id=1513d7c8f30e4d4aa5813ab13bce88eb)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:37.098956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3576b-30d8-4a18-85f2-d208e52679ac None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:37.100643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 596/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:56:36 2022] GET /identity/v3/projects/1513d7c8f30e4d4aa5813ab13bce88eb => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:37.106750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83317d02-7422-4c9e-8a83-1a32efe8f428 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:37.209215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83317d02-7422-4c9e-8a83-1a32efe8f428 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:37.246632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4126251-3da8-4f4f-8514-3b53b59cf140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:37.247316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4126251-3da8-4f4f-8514-3b53b59cf140 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:37.247593 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4126251-3da8-4f4f-8514-3b53b59cf140 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:37.247866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4126251-3da8-4f4f-8514-3b53b59cf140 None admin] PATH_INFO: `/v3/projects/1513d7c8f30e4d4aa5813ab13bce88eb/users/6c346391122446f48287d152231e4e2c/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:37.250043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4126251-3da8-4f4f-8514-3b53b59cf140 None admin] RBAC: Authorizing `identity:create_grant(project_id=1513d7c8f30e4d4aa5813ab13bce88eb, user_id=6c346391122446f48287d152231e4e2c, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:37.251532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4126251-3da8-4f4f-8514-3b53b59cf140 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:37.267984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 596/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:56:37 2022] PUT /identity/v3/projects/1513d7c8f30e4d4aa5813ab13bce88eb/users/6c346391122446f48287d152231e4e2c/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:56:39.562468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db818eed-4126-491f-a03b-66fdbe4439bb None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:39.563025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db818eed-4126-491f-a03b-66fdbe4439bb None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:39.563163 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db818eed-4126-491f-a03b-66fdbe4439bb None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:39.564494 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 597/1193] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:39.570742 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4230d-1553-407a-8a3a-98e01b3cc939 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:39.571276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4230d-1553-407a-8a3a-98e01b3cc939 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:39.571276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4230d-1553-407a-8a3a-98e01b3cc939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:39.592789 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-27d4230d-1553-407a-8a3a-98e01b3cc939 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:39.594027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-27d4230d-1553-407a-8a3a-98e01b3cc939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:39.629283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:39.685322 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 597/1194] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:39.986053 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db818eed-4126-491f-a03b-66fdbe4439bb None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:40.107078 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db818eed-4126-491f-a03b-66fdbe4439bb None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:40.150439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a7522-71af-4172-901c-31652bb08fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:40.151227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a7522-71af-4172-901c-31652bb08fa2 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:40.151509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a7522-71af-4172-901c-31652bb08fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:40.151787 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a7522-71af-4172-901c-31652bb08fa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:40.163918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a7522-71af-4172-901c-31652bb08fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-378a7522-71af-4172-901c-31652bb08fa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:56:40.168727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:40.170047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:40.171405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:40.171405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:40.171405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:40.171405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:40.171405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:56:40.171405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:56:40.171405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:56:40.171405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:56:40.171405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:56:40.171405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:56:40.171405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:40.171405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:56:40.171405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 598/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:56:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:40.176626 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4230d-1553-407a-8a3a-98e01b3cc939 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:40.291547 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4230d-1553-407a-8a3a-98e01b3cc939 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:40.331265 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59eeda-d780-42ae-9516-daa952eb314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:40.331948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59eeda-d780-42ae-9516-daa952eb314d None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:40.332401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59eeda-d780-42ae-9516-daa952eb314d None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:40.332947 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59eeda-d780-42ae-9516-daa952eb314d None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:40.333632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59eeda-d780-42ae-9516-daa952eb314d None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:40.333962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59eeda-d780-42ae-9516-daa952eb314d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:40.335450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59eeda-d780-42ae-9516-daa952eb314d None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:40.345967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 598/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:56:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:56:40.353147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a7522-71af-4172-901c-31652bb08fa2 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:40.407519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:40.474972 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a7522-71af-4172-901c-31652bb08fa2 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:40.513248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977de18-e9df-4c7a-8688-871b8c34c854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:40.514109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977de18-e9df-4c7a-8688-871b8c34c854 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:40.514390 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977de18-e9df-4c7a-8688-871b8c34c854 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:40.514732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977de18-e9df-4c7a-8688-871b8c34c854 None admin] PATH_INFO: `/v3/users/6c346391122446f48287d152231e4e2c` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:40.516119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977de18-e9df-4c7a-8688-871b8c34c854 None admin] RBAC: Authorizing `identity:get_user(user_id=6c346391122446f48287d152231e4e2c)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:40.517731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977de18-e9df-4c7a-8688-871b8c34c854 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:40.519332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 599/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Sep 7 12:56:40 2022] GET /identity/v3/users/6c346391122446f48287d152231e4e2c => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:40.525862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59eeda-d780-42ae-9516-daa952eb314d None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:40.566499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:40.652073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59eeda-d780-42ae-9516-daa952eb314d None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:40.690295 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d7410-2ce0-4482-bb3b-0927f8ac7321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:40.690869 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d7410-2ce0-4482-bb3b-0927f8ac7321 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:40.691145 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d7410-2ce0-4482-bb3b-0927f8ac7321 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:40.691417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d7410-2ce0-4482-bb3b-0927f8ac7321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:40.772524 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d7410-2ce0-4482-bb3b-0927f8ac7321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:40.774039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d7410-2ce0-4482-bb3b-0927f8ac7321 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:40.806690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:40.897910 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 599/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:56:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:56:40.906290 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977de18-e9df-4c7a-8688-871b8c34c854 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:41.032084 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977de18-e9df-4c7a-8688-871b8c34c854 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:41.047671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:41.072116 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbaffa-87c8-4776-9474-ce5e06e8455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:41.073120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbaffa-87c8-4776-9474-ce5e06e8455d None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:41.073405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbaffa-87c8-4776-9474-ce5e06e8455d None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:41.073685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbaffa-87c8-4776-9474-ce5e06e8455d None admin] PATH_INFO: `/v3/projects/1513d7c8f30e4d4aa5813ab13bce88eb` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:41.075027 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbaffa-87c8-4776-9474-ce5e06e8455d None admin] RBAC: Authorizing `identity:get_project(project_id=1513d7c8f30e4d4aa5813ab13bce88eb)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:41.076762 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbaffa-87c8-4776-9474-ce5e06e8455d None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:41.078774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 600/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Sep 7 12:56:40 2022] GET /identity/v3/projects/1513d7c8f30e4d4aa5813ab13bce88eb => generated 361 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:41.087852 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d7410-2ce0-4482-bb3b-0927f8ac7321 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:41.222449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d7410-2ce0-4482-bb3b-0927f8ac7321 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:41.266982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:41.278487 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de84ed6-683f-47ec-bdb0-8773b852b3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:41.279317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de84ed6-683f-47ec-bdb0-8773b852b3d2 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:41.279600 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de84ed6-683f-47ec-bdb0-8773b852b3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:41.279930 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de84ed6-683f-47ec-bdb0-8773b852b3d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:41.281294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de84ed6-683f-47ec-bdb0-8773b852b3d2 None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=1513d7c8f30e4d4aa5813ab13bce88eb, user.id=6c346391122446f48287d152231e4e2c) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:41.281844 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de84ed6-683f-47ec-bdb0-8773b852b3d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:41.284536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de84ed6-683f-47ec-bdb0-8773b852b3d2 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:41.295169 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 600/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:56:41 2022] GET /identity/v3/role_assignments?user.id=6c346391122446f48287d152231e4e2c&scope.project.id=1513d7c8f30e4d4aa5813ab13bce88eb&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:51.067081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=10 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:51.291106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=4 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:40.317881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddfe6f-1358-4e68-aff5-9580a9b1ffc8 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:40.318865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddfe6f-1358-4e68-aff5-9580a9b1ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:40.319406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddfe6f-1358-4e68-aff5-9580a9b1ffc8 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:40.321181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 601/1201] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:57:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:57:40.327868 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bced1-ef67-420f-b0c5-b08a3d83b665 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:40.328456 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bced1-ef67-420f-b0c5-b08a3d83b665 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:40.328456 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bced1-ef67-420f-b0c5-b08a3d83b665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:40.351348 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-438bced1-ef67-420f-b0c5-b08a3d83b665 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:57:40.352676 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-438bced1-ef67-420f-b0c5-b08a3d83b665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:40.474687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 601/1202] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:57:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:57:40.854827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddfe6f-1358-4e68-aff5-9580a9b1ffc8 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:41.083652 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddfe6f-1358-4e68-aff5-9580a9b1ffc8 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:41.154518 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3735519-ff36-441c-b915-91f630a4bb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:41.155629 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3735519-ff36-441c-b915-91f630a4bb47 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:41.156140 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3735519-ff36-441c-b915-91f630a4bb47 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:41.156667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3735519-ff36-441c-b915-91f630a4bb47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:41.178208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3735519-ff36-441c-b915-91f630a4bb47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:41.182837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3735519-ff36-441c-b915-91f630a4bb47 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-f3735519-ff36-441c-b915-91f630a4bb47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:57:41.221205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:41.223384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:57:41.225674 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:57:41.225674 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:57:41.225674 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:57:41.228334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 602/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:57:41.236557 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bced1-ef67-420f-b0c5-b08a3d83b665 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:41.446960 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bced1-ef67-420f-b0c5-b08a3d83b665 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:41.513904 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:41.531769 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f7042-7e73-4c2b-b26a-afddf7f948fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:41.532868 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f7042-7e73-4c2b-b26a-afddf7f948fd None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:41.533334 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f7042-7e73-4c2b-b26a-afddf7f948fd None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:41.533780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f7042-7e73-4c2b-b26a-afddf7f948fd None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:41.535045 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f7042-7e73-4c2b-b26a-afddf7f948fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:41.535530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f7042-7e73-4c2b-b26a-afddf7f948fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:41.539574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f7042-7e73-4c2b-b26a-afddf7f948fd None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:41.572525 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 602/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:41.574524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3735519-ff36-441c-b915-91f630a4bb47 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:41.670375 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:41.781929 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3735519-ff36-441c-b915-91f630a4bb47 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:41.843994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b527470-1f56-4035-b3ab-50187b399440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:41.845085 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b527470-1f56-4035-b3ab-50187b399440 None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:41.845564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b527470-1f56-4035-b3ab-50187b399440 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:41.846013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b527470-1f56-4035-b3ab-50187b399440 None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:41.847283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b527470-1f56-4035-b3ab-50187b399440 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:41.850109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b527470-1f56-4035-b3ab-50187b399440 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:41.910164 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 603/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Sep 7 12:57:41 2022] POST /identity/v3/users => generated 251 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:57:44.594046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a39dcf-06c3-495e-b370-e1128aa8bd74 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:44.594638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a39dcf-06c3-495e-b370-e1128aa8bd74 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:44.594638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a39dcf-06c3-495e-b370-e1128aa8bd74 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:44.595943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 603/1206] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:57:44.602544 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c676d-36f0-4e2c-a4b9-a2d7c7b9a2c5 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:44.603108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c676d-36f0-4e2c-a4b9-a2d7c7b9a2c5 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:44.603108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c676d-36f0-4e2c-a4b9-a2d7c7b9a2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:44.626369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-834c676d-36f0-4e2c-a4b9-a2d7c7b9a2c5 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:57:44.628315 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-834c676d-36f0-4e2c-a4b9-a2d7c7b9a2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:44.749687 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 604/1207] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:57:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:57:45.083158 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a39dcf-06c3-495e-b370-e1128aa8bd74 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:45.232925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a39dcf-06c3-495e-b370-e1128aa8bd74 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:45.282156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d068-168a-40dd-a6cd-9729b029c64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:45.283206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d068-168a-40dd-a6cd-9729b029c64a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:45.283650 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d068-168a-40dd-a6cd-9729b029c64a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:45.284135 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d068-168a-40dd-a6cd-9729b029c64a None admin] PATH_INFO: `/v3/roles/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:45.315833 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5d068-168a-40dd-a6cd-9729b029c64a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-4ee5d068-168a-40dd-a6cd-9729b029c64a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:57:45.326092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:45.327839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:45.329216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:45.329216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:45.329216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:45.329216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:45.329216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:57:45.329216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:57:45.329216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:57:45.329216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:57:45.329216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:57:45.329216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:57:45.329216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:57:45.329216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:57:45.329216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 604/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:57:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:57:45.338377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c676d-36f0-4e2c-a4b9-a2d7c7b9a2c5 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:45.399128 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:45.528502 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c676d-36f0-4e2c-a4b9-a2d7c7b9a2c5 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:45.593477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061c67e-b3de-493a-bc22-3e043b912e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:45.594495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061c67e-b3de-493a-bc22-3e043b912e45 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:45.594972 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061c67e-b3de-493a-bc22-3e043b912e45 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:45.595424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061c67e-b3de-493a-bc22-3e043b912e45 None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:45.596786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061c67e-b3de-493a-bc22-3e043b912e45 None admin] RBAC: Adding query filter params (name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:45.597327 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061c67e-b3de-493a-bc22-3e043b912e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:45.600533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061c67e-b3de-493a-bc22-3e043b912e45 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:45.620413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 605/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:57:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:45.628110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d068-168a-40dd-a6cd-9729b029c64a None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:45.723559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:45.810964 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d068-168a-40dd-a6cd-9729b029c64a None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:45.872813 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a214a1-443d-4f71-9570-dc8ff44972f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:45.873746 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a214a1-443d-4f71-9570-dc8ff44972f1 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:45.874012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a214a1-443d-4f71-9570-dc8ff44972f1 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:45.874331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a214a1-443d-4f71-9570-dc8ff44972f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:45.888085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a214a1-443d-4f71-9570-dc8ff44972f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:45.890347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a214a1-443d-4f71-9570-dc8ff44972f1 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-31a214a1-443d-4f71-9570-dc8ff44972f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:57:45.912364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:45.914261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:57:45.918514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:57:45.918514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:57:45.918514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:57:45.918514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 605/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:57:45.925922 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061c67e-b3de-493a-bc22-3e043b912e45 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:46.106226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:46.109580 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061c67e-b3de-493a-bc22-3e043b912e45 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:46.181738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5388a27-843a-438f-8630-3251cf896bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:46.182792 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5388a27-843a-438f-8630-3251cf896bf8 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:46.183235 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5388a27-843a-438f-8630-3251cf896bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:46.183735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5388a27-843a-438f-8630-3251cf896bf8 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:46.184907 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5388a27-843a-438f-8630-3251cf896bf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:46.185428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5388a27-843a-438f-8630-3251cf896bf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:46.187969 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5388a27-843a-438f-8630-3251cf896bf8 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:46.216446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 606/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:46.221647 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a214a1-443d-4f71-9570-dc8ff44972f1 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:46.396132 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a214a1-443d-4f71-9570-dc8ff44972f1 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:46.400013 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:46.466517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71853043-02a9-4e6d-9cf6-20a899f1cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:46.467295 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71853043-02a9-4e6d-9cf6-20a899f1cbda None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:46.467684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71853043-02a9-4e6d-9cf6-20a899f1cbda None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:46.468065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71853043-02a9-4e6d-9cf6-20a899f1cbda None admin] PATH_INFO: `/v3/users/placement` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:46.482673 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71853043-02a9-4e6d-9cf6-20a899f1cbda None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:46.486420 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71853043-02a9-4e6d-9cf6-20a899f1cbda None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-71853043-02a9-4e6d-9cf6-20a899f1cbda None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:57:46.504289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:46.505465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:46.507267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:46.507267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:46.507267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:57:46.507267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:57:46.507267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:57:46.507267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:57:46.507267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:57:46.507267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:57:46.507267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:57:46.507267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:57:46.507267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 606/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:57:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:57:46.518257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5388a27-843a-438f-8630-3251cf896bf8 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:46.658755 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5388a27-843a-438f-8630-3251cf896bf8 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:46.714794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5edbad-37fb-4b81-96fa-ea5bcbc27119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:46.715782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5edbad-37fb-4b81-96fa-ea5bcbc27119 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:46.716217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5edbad-37fb-4b81-96fa-ea5bcbc27119 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:46.716679 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5edbad-37fb-4b81-96fa-ea5bcbc27119 None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:46.717683 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5edbad-37fb-4b81-96fa-ea5bcbc27119 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:46.718130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5edbad-37fb-4b81-96fa-ea5bcbc27119 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:46.720146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5edbad-37fb-4b81-96fa-ea5bcbc27119 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:46.754229 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 607/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Sep 7 12:57:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:46.761060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71853043-02a9-4e6d-9cf6-20a899f1cbda None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:46.911733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71853043-02a9-4e6d-9cf6-20a899f1cbda None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:46.953189 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49674ede-9992-4178-a579-8c9cc4a097a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:46.953822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49674ede-9992-4178-a579-8c9cc4a097a1 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:46.954099 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49674ede-9992-4178-a579-8c9cc4a097a1 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:46.954369 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49674ede-9992-4178-a579-8c9cc4a097a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:46.988684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:47.052597 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49674ede-9992-4178-a579-8c9cc4a097a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:47.055672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49674ede-9992-4178-a579-8c9cc4a097a1 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:47.207373 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 607/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:57:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:57:47.214225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5edbad-37fb-4b81-96fa-ea5bcbc27119 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:47.238435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:47.350226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5edbad-37fb-4b81-96fa-ea5bcbc27119 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:47.389886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6b841-1d55-4d2c-b3f2-5f6ce69afc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:47.390526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6b841-1d55-4d2c-b3f2-5f6ce69afc77 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:47.390808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6b841-1d55-4d2c-b3f2-5f6ce69afc77 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:47.391063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6b841-1d55-4d2c-b3f2-5f6ce69afc77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:47.403725 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6b841-1d55-4d2c-b3f2-5f6ce69afc77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:47.405362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6b841-1d55-4d2c-b3f2-5f6ce69afc77 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-3cf6b841-1d55-4d2c-b3f2-5f6ce69afc77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:57:47.421729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:47.423010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:57:47.423919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:57:47.423919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:57:47.423919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:57:47.423919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 608/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:57:47.428967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49674ede-9992-4178-a579-8c9cc4a097a1 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:47.501412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:47.547277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49674ede-9992-4178-a579-8c9cc4a097a1 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:47.590431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af8d67-8b5c-4917-a53e-624d48883903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:47.591087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af8d67-8b5c-4917-a53e-624d48883903 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:47.591367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af8d67-8b5c-4917-a53e-624d48883903 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:47.591629 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af8d67-8b5c-4917-a53e-624d48883903 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:47.592287 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af8d67-8b5c-4917-a53e-624d48883903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:47.592627 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af8d67-8b5c-4917-a53e-624d48883903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:47.594101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af8d67-8b5c-4917-a53e-624d48883903 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:47.610676 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 608/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:47.617088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6b841-1d55-4d2c-b3f2-5f6ce69afc77 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:47.704047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:47.744058 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6b841-1d55-4d2c-b3f2-5f6ce69afc77 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:47.783435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5ad09-45db-47c9-b575-ccde9a3e0f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:47.783994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5ad09-45db-47c9-b575-ccde9a3e0f28 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:47.784272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5ad09-45db-47c9-b575-ccde9a3e0f28 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:47.784575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5ad09-45db-47c9-b575-ccde9a3e0f28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:47.794330 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5ad09-45db-47c9-b575-ccde9a3e0f28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:47.795795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5ad09-45db-47c9-b575-ccde9a3e0f28 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:47.809814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-7cc5ad09-45db-47c9-b575-ccde9a3e0f28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:57:47.809814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:47.809814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:47.809814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:47.809814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:47.809814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:47.809814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:47.809814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:47.809814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:47.809814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:47.809814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:47.809814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:47.809814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:57:47.809814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:57:47.809814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:47.817470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:47.818637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:57:47.818637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:57:47.818637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:57:47.818637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:57:47.818637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:57:47.818637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:57:47.818637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:57:47.818637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:57:47.818637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 609/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:57:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:57:47.821196 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af8d67-8b5c-4917-a53e-624d48883903 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:47.948719 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af8d67-8b5c-4917-a53e-624d48883903 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:47.977368 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:47.990903 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21f3a7-194f-4228-bd38-18fd0fe359a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:47.991758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21f3a7-194f-4228-bd38-18fd0fe359a0 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:47.992037 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21f3a7-194f-4228-bd38-18fd0fe359a0 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:47.992308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21f3a7-194f-4228-bd38-18fd0fe359a0 None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:47.993057 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21f3a7-194f-4228-bd38-18fd0fe359a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:47.993361 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21f3a7-194f-4228-bd38-18fd0fe359a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:47.994807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21f3a7-194f-4228-bd38-18fd0fe359a0 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:48.008117 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 609/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:57:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:48.014721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5ad09-45db-47c9-b575-ccde9a3e0f28 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:48.141710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5ad09-45db-47c9-b575-ccde9a3e0f28 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:48.176808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:48.184516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7c335-0a64-4ee8-a342-cd9329e72d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:48.185126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7c335-0a64-4ee8-a342-cd9329e72d51 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:48.185370 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7c335-0a64-4ee8-a342-cd9329e72d51 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:48.185641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7c335-0a64-4ee8-a342-cd9329e72d51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:48.186432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7c335-0a64-4ee8-a342-cd9329e72d51 None admin] RBAC: Adding query filter params (role.id=6c9336a73ed74d66a83c59fb3269efd5, scope.project.id=3381c0688581489b903e641f91914839, user.id=f2420def47ee4a5b8cf4373252583d75) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:48.186739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7c335-0a64-4ee8-a342-cd9329e72d51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:48.188213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7c335-0a64-4ee8-a342-cd9329e72d51 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:48.195211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 610/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:57:48 2022] GET /identity/v3/role_assignments?user.id=f2420def47ee4a5b8cf4373252583d75&scope.project.id=3381c0688581489b903e641f91914839&role.id=6c9336a73ed74d66a83c59fb3269efd5 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:57:50.489519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6721e-97c9-445d-bd99-49e824e9e8e3 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:50.490227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6721e-97c9-445d-bd99-49e824e9e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:50.490227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6721e-97c9-445d-bd99-49e824e9e8e3 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:50.491912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 610/1220] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:57:50.498514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60c7b6-42ff-4923-87e9-c7b81a5b57d4 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:50.499009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60c7b6-42ff-4923-87e9-c7b81a5b57d4 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:50.499099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60c7b6-42ff-4923-87e9-c7b81a5b57d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:50.518618 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-4a60c7b6-42ff-4923-87e9-c7b81a5b57d4 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:57:50.519965 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-4a60c7b6-42ff-4923-87e9-c7b81a5b57d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:50.599716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 611/1221] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:57:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:57:50.876981 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6721e-97c9-445d-bd99-49e824e9e8e3 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:50.988201 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6721e-97c9-445d-bd99-49e824e9e8e3 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:51.030302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd4d1f-e911-446f-85ac-a98332bef650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:51.031046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd4d1f-e911-446f-85ac-a98332bef650 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:51.031325 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd4d1f-e911-446f-85ac-a98332bef650 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:51.031628 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd4d1f-e911-446f-85ac-a98332bef650 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:51.047064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd4d1f-e911-446f-85ac-a98332bef650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-1ecd4d1f-e911-446f-85ac-a98332bef650 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:57:51.052490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:51.056595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:51.057531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:51.057531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:51.057531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:51.057531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:51.057531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:57:51.057531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:57:51.057531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:57:51.057531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:57:51.057531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:57:51.057531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:57:51.057531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:57:51.057531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:57:51.057531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 611/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:57:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:57:51.060108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60c7b6-42ff-4923-87e9-c7b81a5b57d4 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:51.172168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60c7b6-42ff-4923-87e9-c7b81a5b57d4 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:51.199627 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:51.212211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180a133-6d11-4c63-955c-0de9e943af2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:51.212946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180a133-6d11-4c63-955c-0de9e943af2f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:51.213200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180a133-6d11-4c63-955c-0de9e943af2f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:51.213625 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180a133-6d11-4c63-955c-0de9e943af2f None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:51.214237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180a133-6d11-4c63-955c-0de9e943af2f None admin] RBAC: Adding query filter params (name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:51.214621 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180a133-6d11-4c63-955c-0de9e943af2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:51.216794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180a133-6d11-4c63-955c-0de9e943af2f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:51.227280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 612/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:57:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:51.233711 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd4d1f-e911-446f-85ac-a98332bef650 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:51.284244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:51.352744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd4d1f-e911-446f-85ac-a98332bef650 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:51.394761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb4c67-6060-46e3-939b-4714ea85f975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:51.395434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb4c67-6060-46e3-939b-4714ea85f975 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:51.395707 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb4c67-6060-46e3-939b-4714ea85f975 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:51.395975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb4c67-6060-46e3-939b-4714ea85f975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:51.407106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb4c67-6060-46e3-939b-4714ea85f975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:51.408747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb4c67-6060-46e3-939b-4714ea85f975 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-e9fb4c67-6060-46e3-939b-4714ea85f975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:57:51.428280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:51.429471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:57:51.430394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:57:51.430394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:57:51.430394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:57:51.430394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 612/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:57:51.435847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180a133-6d11-4c63-955c-0de9e943af2f None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:51.555463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180a133-6d11-4c63-955c-0de9e943af2f None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:51.594622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc5c90-311d-4f53-af5f-81ddd8648e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:51.596090 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc5c90-311d-4f53-af5f-81ddd8648e26 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:51.596438 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc5c90-311d-4f53-af5f-81ddd8648e26 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:51.596708 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc5c90-311d-4f53-af5f-81ddd8648e26 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:51.597473 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc5c90-311d-4f53-af5f-81ddd8648e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:51.597777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc5c90-311d-4f53-af5f-81ddd8648e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:51.599299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc5c90-311d-4f53-af5f-81ddd8648e26 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:51.615403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 613/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:51.621833 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb4c67-6060-46e3-939b-4714ea85f975 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:51.741167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:51.749081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb4c67-6060-46e3-939b-4714ea85f975 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:51.790030 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4ad29-d608-4f4f-b1a0-eb2e82bd2e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:51.790681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4ad29-d608-4f4f-b1a0-eb2e82bd2e1e None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:51.790926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4ad29-d608-4f4f-b1a0-eb2e82bd2e1e None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:51.791192 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4ad29-d608-4f4f-b1a0-eb2e82bd2e1e None admin] PATH_INFO: `/v3/users/placement` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:51.799765 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4ad29-d608-4f4f-b1a0-eb2e82bd2e1e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:51.801514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4ad29-d608-4f4f-b1a0-eb2e82bd2e1e None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-ffa4ad29-d608-4f4f-b1a0-eb2e82bd2e1e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:57:51.813753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:51.815267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:51.816700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:51.816700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:51.816700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:57:51.816700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:57:51.816700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:57:51.816700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:57:51.816700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:57:51.816700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:57:51.816700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:57:51.816700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:57:51.816700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 613/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:57:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:57:51.821967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc5c90-311d-4f53-af5f-81ddd8648e26 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:51.884560 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:51.953797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc5c90-311d-4f53-af5f-81ddd8648e26 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:51.996175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98409276-a19a-4be3-89c3-3edf41955466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:51.996798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409276-a19a-4be3-89c3-3edf41955466 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:51.997063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409276-a19a-4be3-89c3-3edf41955466 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:51.997383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409276-a19a-4be3-89c3-3edf41955466 None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:51.998099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98409276-a19a-4be3-89c3-3edf41955466 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:51.998402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98409276-a19a-4be3-89c3-3edf41955466 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:51.999958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98409276-a19a-4be3-89c3-3edf41955466 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:52.021724 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 614/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Sep 7 12:57:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:52.032492 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4ad29-d608-4f4f-b1a0-eb2e82bd2e1e None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:52.152318 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4ad29-d608-4f4f-b1a0-eb2e82bd2e1e None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:52.193942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fd0be-5651-44bb-b204-f4f6d8689b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:52.194713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fd0be-5651-44bb-b204-f4f6d8689b4e None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:52.195003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fd0be-5651-44bb-b204-f4f6d8689b4e None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:52.195329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fd0be-5651-44bb-b204-f4f6d8689b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:52.209042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fd0be-5651-44bb-b204-f4f6d8689b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:52.211406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fd0be-5651-44bb-b204-f4f6d8689b4e None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-309fd0be-5651-44bb-b204-f4f6d8689b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:57:52.228785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:52.231177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:57:52.232553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:57:52.232553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:57:52.232553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:57:52.232553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 614/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:57:52.236579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98409276-a19a-4be3-89c3-3edf41955466 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:52.365346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98409276-a19a-4be3-89c3-3edf41955466 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:52.373836 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:52.415563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d10cb9-9fa3-45e7-96c5-13c279a432dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:52.416248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10cb9-9fa3-45e7-96c5-13c279a432dc None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:52.416567 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10cb9-9fa3-45e7-96c5-13c279a432dc None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:52.416868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10cb9-9fa3-45e7-96c5-13c279a432dc None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:52.417574 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d10cb9-9fa3-45e7-96c5-13c279a432dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:52.417968 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d10cb9-9fa3-45e7-96c5-13c279a432dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:52.419431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d10cb9-9fa3-45e7-96c5-13c279a432dc None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:52.433797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 615/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:52.439929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fd0be-5651-44bb-b204-f4f6d8689b4e None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:52.451022 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:52.590843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fd0be-5651-44bb-b204-f4f6d8689b4e None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:52.655278 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd908-7777-4802-ae1a-d0a3855b2f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:52.656059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd908-7777-4802-ae1a-d0a3855b2f08 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:52.656350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd908-7777-4802-ae1a-d0a3855b2f08 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:52.656788 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd908-7777-4802-ae1a-d0a3855b2f08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:52.666765 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bd908-7777-4802-ae1a-d0a3855b2f08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:52.668839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bd908-7777-4802-ae1a-d0a3855b2f08 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:52.683998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-321bd908-7777-4802-ae1a-d0a3855b2f08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:57:52.683998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:52.683998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:52.683998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:52.683998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:52.683998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:52.683998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:52.683998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:52.683998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:52.683998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:52.683998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:52.683998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:52.683998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:57:52.683998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:57:52.683998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:52.685954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:52.687111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:57:52.687111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:57:52.687111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:57:52.687111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:57:52.687111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:57:52.687111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:57:52.687111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:57:52.687111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:57:52.687111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 615/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:57:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:57:52.691820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d10cb9-9fa3-45e7-96c5-13c279a432dc None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:52.812920 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d10cb9-9fa3-45e7-96c5-13c279a432dc None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:52.856307 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c5153-e6c6-4d9e-aec0-d9140f1b457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:52.857157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c5153-e6c6-4d9e-aec0-d9140f1b457f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:52.857536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c5153-e6c6-4d9e-aec0-d9140f1b457f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:52.857950 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c5153-e6c6-4d9e-aec0-d9140f1b457f None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:52.859112 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c5153-e6c6-4d9e-aec0-d9140f1b457f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:52.859625 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c5153-e6c6-4d9e-aec0-d9140f1b457f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:52.861647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c5153-e6c6-4d9e-aec0-d9140f1b457f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:52.881188 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 616/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:57:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:52.889365 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd908-7777-4802-ae1a-d0a3855b2f08 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:52.975416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:53.018073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd908-7777-4802-ae1a-d0a3855b2f08 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:53.057684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94b09e-9fd3-44f7-a426-784a55023668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:53.058370 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94b09e-9fd3-44f7-a426-784a55023668 None admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:53.058647 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94b09e-9fd3-44f7-a426-784a55023668 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:53.058912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94b09e-9fd3-44f7-a426-784a55023668 None admin] PATH_INFO: `/v3/projects/3381c0688581489b903e641f91914839/users/f2420def47ee4a5b8cf4373252583d75/roles/6c9336a73ed74d66a83c59fb3269efd5` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:53.080573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94b09e-9fd3-44f7-a426-784a55023668 None admin] RBAC: Authorizing `identity:create_grant(project_id=3381c0688581489b903e641f91914839, user_id=f2420def47ee4a5b8cf4373252583d75, role_id=6c9336a73ed74d66a83c59fb3269efd5)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:53.083410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94b09e-9fd3-44f7-a426-784a55023668 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:53.101615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 616/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:57:52 2022] PUT /identity/v3/projects/3381c0688581489b903e641f91914839/users/f2420def47ee4a5b8cf4373252583d75/roles/6c9336a73ed74d66a83c59fb3269efd5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:57:55.436064 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e596c2-841a-4c45-b622-2152657e5626 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:55.436702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e596c2-841a-4c45-b622-2152657e5626 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:55.436702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e596c2-841a-4c45-b622-2152657e5626 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:55.438158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 617/1233] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:57:55.444024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b1bbc-5068-4f09-8a08-d1b107dbb2b2 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:55.444626 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b1bbc-5068-4f09-8a08-d1b107dbb2b2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:55.446083 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b1bbc-5068-4f09-8a08-d1b107dbb2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:55.465706 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-885b1bbc-5068-4f09-8a08-d1b107dbb2b2 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:57:55.467107 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-885b1bbc-5068-4f09-8a08-d1b107dbb2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:55.543263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 617/1234] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:57:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:57:55.812459 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e596c2-841a-4c45-b622-2152657e5626 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:55.840137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:55.927788 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e596c2-841a-4c45-b622-2152657e5626 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:55.967535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843f3e0-1a62-43b9-96d6-74d6c7b41712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:55.968297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843f3e0-1a62-43b9-96d6-74d6c7b41712 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:55.968652 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843f3e0-1a62-43b9-96d6-74d6c7b41712 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:55.968919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843f3e0-1a62-43b9-96d6-74d6c7b41712 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:55.984165 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843f3e0-1a62-43b9-96d6-74d6c7b41712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-5843f3e0-1a62-43b9-96d6-74d6c7b41712 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:57:55.986841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:55.988067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:55.993732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:55.993732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:55.993732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:55.993732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:55.993732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:57:55.993732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:57:55.993732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:57:55.993732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:57:55.993732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:57:55.993732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:57:55.993732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:57:55.993732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:57:55.993732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 618/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Sep 7 12:57:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:57:55.996052 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b1bbc-5068-4f09-8a08-d1b107dbb2b2 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:56.052191 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:56.118810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b1bbc-5068-4f09-8a08-d1b107dbb2b2 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:56.160069 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb3414-a71e-4efa-aaa1-676a1aac23f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:56.160757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb3414-a71e-4efa-aaa1-676a1aac23f3 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:56.161036 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb3414-a71e-4efa-aaa1-676a1aac23f3 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:56.161306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb3414-a71e-4efa-aaa1-676a1aac23f3 None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:56.161991 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb3414-a71e-4efa-aaa1-676a1aac23f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:56.162290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb3414-a71e-4efa-aaa1-676a1aac23f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:56.163732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb3414-a71e-4efa-aaa1-676a1aac23f3 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:56.174176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 618/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Sep 7 12:57:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:56.181299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843f3e0-1a62-43b9-96d6-74d6c7b41712 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:56.279196 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:56.296941 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843f3e0-1a62-43b9-96d6-74d6c7b41712 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:56.350551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c016e7-d331-45ce-b076-ae0287ff446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:56.351200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c016e7-d331-45ce-b076-ae0287ff446b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:56.351467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c016e7-d331-45ce-b076-ae0287ff446b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:56.351744 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c016e7-d331-45ce-b076-ae0287ff446b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:56.363784 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c016e7-d331-45ce-b076-ae0287ff446b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:56.365358 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c016e7-d331-45ce-b076-ae0287ff446b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-26c016e7-d331-45ce-b076-ae0287ff446b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:57:56.388824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:56.390435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:57:56.392231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:57:56.392231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:57:56.392231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:57:56.392231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 619/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:57:56.396067 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb3414-a71e-4efa-aaa1-676a1aac23f3 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:56.534481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb3414-a71e-4efa-aaa1-676a1aac23f3 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:56.545410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:56.589581 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad4f0a-b8a6-4a00-90ad-6bd3b79a1c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:56.590390 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad4f0a-b8a6-4a00-90ad-6bd3b79a1c04 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:56.590604 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad4f0a-b8a6-4a00-90ad-6bd3b79a1c04 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:56.590875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad4f0a-b8a6-4a00-90ad-6bd3b79a1c04 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:56.591541 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad4f0a-b8a6-4a00-90ad-6bd3b79a1c04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:56.591846 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad4f0a-b8a6-4a00-90ad-6bd3b79a1c04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:56.593290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad4f0a-b8a6-4a00-90ad-6bd3b79a1c04 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:56.607300 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 619/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:56.615485 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c016e7-d331-45ce-b076-ae0287ff446b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:56.734700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c016e7-d331-45ce-b076-ae0287ff446b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:56.772829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1ad18-45ed-4274-85e5-6e50b75991d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:56.773737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1ad18-45ed-4274-85e5-6e50b75991d3 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:56.774035 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1ad18-45ed-4274-85e5-6e50b75991d3 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:56.774329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1ad18-45ed-4274-85e5-6e50b75991d3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:56.777607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:56.784016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1ad18-45ed-4274-85e5-6e50b75991d3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:56.785914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1ad18-45ed-4274-85e5-6e50b75991d3 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-08b1ad18-45ed-4274-85e5-6e50b75991d3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:57:56.799808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:56.801069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:56.802104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:56.802104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:56.802104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:57:56.802104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:57:56.802104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:57:56.802104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:57:56.802104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:57:56.802104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:57:56.802104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:57:56.802104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:57:56.802104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 620/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:57:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:57:56.807381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad4f0a-b8a6-4a00-90ad-6bd3b79a1c04 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:56.936688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad4f0a-b8a6-4a00-90ad-6bd3b79a1c04 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:56.982033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d96b1-169a-4aa3-bb33-e89f49ef0ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:56.982999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d96b1-169a-4aa3-bb33-e89f49ef0ffe None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:56.983343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d96b1-169a-4aa3-bb33-e89f49ef0ffe None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:56.983780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d96b1-169a-4aa3-bb33-e89f49ef0ffe None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:56.985075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d96b1-169a-4aa3-bb33-e89f49ef0ffe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:56.985316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d96b1-169a-4aa3-bb33-e89f49ef0ffe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:56.987059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d96b1-169a-4aa3-bb33-e89f49ef0ffe None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:57.008758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 620/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Sep 7 12:57:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:57.014530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1ad18-45ed-4274-85e5-6e50b75991d3 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:57.144856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1ad18-45ed-4274-85e5-6e50b75991d3 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:57.186825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3a20f-b892-4810-9325-b4d23668a976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:57.187581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3a20f-b892-4810-9325-b4d23668a976 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:57.187887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3a20f-b892-4810-9325-b4d23668a976 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:57.188149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3a20f-b892-4810-9325-b4d23668a976 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:57.270154 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:57.279504 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3a20f-b892-4810-9325-b4d23668a976 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:57.281156 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3a20f-b892-4810-9325-b4d23668a976 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:57.418755 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 621/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:57:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:57:57.426354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d96b1-169a-4aa3-bb33-e89f49ef0ffe None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:57.472158 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:57.570693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d96b1-169a-4aa3-bb33-e89f49ef0ffe None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:57.612321 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e09bd0-e721-432c-97fb-5f23197578a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:57.613023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e09bd0-e721-432c-97fb-5f23197578a2 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:57.613303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e09bd0-e721-432c-97fb-5f23197578a2 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:57.613580 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e09bd0-e721-432c-97fb-5f23197578a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:57.626388 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e09bd0-e721-432c-97fb-5f23197578a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:57.628003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e09bd0-e721-432c-97fb-5f23197578a2 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-c3e09bd0-e721-432c-97fb-5f23197578a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:57:57.645313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:57.646559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:57:57.647480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:57:57.647480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:57:57.647480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:57:57.647480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 621/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:57:57.653854 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3a20f-b892-4810-9325-b4d23668a976 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:57.776404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:57.783679 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3a20f-b892-4810-9325-b4d23668a976 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:57.826576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635d0d5-8db0-4431-aba6-8fdbb2c02294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:57.827121 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635d0d5-8db0-4431-aba6-8fdbb2c02294 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:57.827407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635d0d5-8db0-4431-aba6-8fdbb2c02294 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:57.827677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635d0d5-8db0-4431-aba6-8fdbb2c02294 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:57.828348 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635d0d5-8db0-4431-aba6-8fdbb2c02294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:57.828685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635d0d5-8db0-4431-aba6-8fdbb2c02294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:57.830113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635d0d5-8db0-4431-aba6-8fdbb2c02294 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:57.847054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 622/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:57.853975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e09bd0-e721-432c-97fb-5f23197578a2 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:57.946392 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:57.972561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e09bd0-e721-432c-97fb-5f23197578a2 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:58.023956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffbd68-8929-48fc-8bd2-5a7615b2ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:58.024937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffbd68-8929-48fc-8bd2-5a7615b2ec32 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:58.025222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffbd68-8929-48fc-8bd2-5a7615b2ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:58.025988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffbd68-8929-48fc-8bd2-5a7615b2ec32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:58.040798 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffbd68-8929-48fc-8bd2-5a7615b2ec32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:58.043540 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffbd68-8929-48fc-8bd2-5a7615b2ec32 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:58.069642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-76ffbd68-8929-48fc-8bd2-5a7615b2ec32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:57:58.069642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:57:58.069642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:57:58.069642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:57:58.069642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:57:58.069642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:57:58.069642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:57:58.069642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:57:58.069642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:57:58.069642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:57:58.069642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:57:58.069642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:57:58.069642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:57:58.069642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:57:58.069642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:57:58.071004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:57:58.072137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:57:58.072137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:57:58.072137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:57:58.072137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:57:58.072137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:57:58.072137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:57:58.072137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:57:58.072137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:57:58.072137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 622/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:57:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:57:58.077324 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635d0d5-8db0-4431-aba6-8fdbb2c02294 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:58.216742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635d0d5-8db0-4431-aba6-8fdbb2c02294 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:58.273885 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73384fc0-6367-4661-bb30-0a475d1989b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:58.274585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73384fc0-6367-4661-bb30-0a475d1989b5 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:58.274883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73384fc0-6367-4661-bb30-0a475d1989b5 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:58.275214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73384fc0-6367-4661-bb30-0a475d1989b5 None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:58.276033 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73384fc0-6367-4661-bb30-0a475d1989b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:58.276578 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73384fc0-6367-4661-bb30-0a475d1989b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:58.279172 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73384fc0-6367-4661-bb30-0a475d1989b5 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:58.296641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 623/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:57:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:58.303124 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffbd68-8929-48fc-8bd2-5a7615b2ec32 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:58.441437 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffbd68-8929-48fc-8bd2-5a7615b2ec32 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:58.488599 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e4140-c9c5-4ade-a244-00af736b9eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:58.489883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e4140-c9c5-4ade-a244-00af736b9eaa None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:58.490265 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e4140-c9c5-4ade-a244-00af736b9eaa None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:58.490470 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e4140-c9c5-4ade-a244-00af736b9eaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:58.491775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e4140-c9c5-4ade-a244-00af736b9eaa None admin] RBAC: Adding query filter params (role.id=6c9336a73ed74d66a83c59fb3269efd5, scope.project.id=3381c0688581489b903e641f91914839, user.id=f2420def47ee4a5b8cf4373252583d75) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:57:58.492067 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e4140-c9c5-4ade-a244-00af736b9eaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:58.493974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e4140-c9c5-4ade-a244-00af736b9eaa None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:58.502871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 623/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:57:58 2022] GET /identity/v3/role_assignments?user.id=f2420def47ee4a5b8cf4373252583d75&scope.project.id=3381c0688581489b903e641f91914839&role.id=6c9336a73ed74d66a83c59fb3269efd5 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:00.875953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa606f74-85b7-41ab-a6bb-02a9b3e0dbf3 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:00.876579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa606f74-85b7-41ab-a6bb-02a9b3e0dbf3 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:00.876579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa606f74-85b7-41ab-a6bb-02a9b3e0dbf3 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:00.877981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 624/1247] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:00.884164 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78fe25-82eb-46e2-a623-a37ebcff60fe None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:00.884814 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78fe25-82eb-46e2-a623-a37ebcff60fe None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:00.884917 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78fe25-82eb-46e2-a623-a37ebcff60fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:00.892016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:00.907208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ae78fe25-82eb-46e2-a623-a37ebcff60fe None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:00.908551 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ae78fe25-82eb-46e2-a623-a37ebcff60fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:00.988654 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 624/1248] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:58:01.339143 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa606f74-85b7-41ab-a6bb-02a9b3e0dbf3 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:01.361364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:01.467871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa606f74-85b7-41ab-a6bb-02a9b3e0dbf3 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:01.524722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6e62d-7ac3-4697-af95-92e1da6149aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:01.525429 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e62d-7ac3-4697-af95-92e1da6149aa None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:01.525713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e62d-7ac3-4697-af95-92e1da6149aa None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:01.526048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e62d-7ac3-4697-af95-92e1da6149aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:01.540566 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6e62d-7ac3-4697-af95-92e1da6149aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-e9a6e62d-7ac3-4697-af95-92e1da6149aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:01.545602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:01.548718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:01.549794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:01.549794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:01.549794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:01.549794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:01.549794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:01.549794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:01.549794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:01.549794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:01.549794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:01.549794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:01.549794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:01.549794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:58:01.549794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 625/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:58:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:01.553140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78fe25-82eb-46e2-a623-a37ebcff60fe None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:01.678070 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78fe25-82eb-46e2-a623-a37ebcff60fe None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:01.712998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:01.718790 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaedc7-6232-470d-a9ed-356b22e061fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:01.719599 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaedc7-6232-470d-a9ed-356b22e061fe None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:01.719961 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaedc7-6232-470d-a9ed-356b22e061fe None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:01.720230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaedc7-6232-470d-a9ed-356b22e061fe None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:01.720984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaedc7-6232-470d-a9ed-356b22e061fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:01.721273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaedc7-6232-470d-a9ed-356b22e061fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:01.722695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaedc7-6232-470d-a9ed-356b22e061fe None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:01.732321 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 625/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:01.739187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6e62d-7ac3-4697-af95-92e1da6149aa None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:01.832933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:01.865662 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6e62d-7ac3-4697-af95-92e1da6149aa None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:01.911206 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b267096-670e-4420-8915-09df0f8486ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:01.912079 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b267096-670e-4420-8915-09df0f8486ab None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:01.912468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b267096-670e-4420-8915-09df0f8486ab None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:01.912879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b267096-670e-4420-8915-09df0f8486ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:01.927060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b267096-670e-4420-8915-09df0f8486ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:01.928738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b267096-670e-4420-8915-09df0f8486ab None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-4b267096-670e-4420-8915-09df0f8486ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:58:01.950557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:01.952526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:58:01.953514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:58:01.953514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:01.953514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:58:01.953514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 626/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:01.959439 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaedc7-6232-470d-a9ed-356b22e061fe None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:02.083907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaedc7-6232-470d-a9ed-356b22e061fe None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:02.125034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780cae1-2326-4660-ad62-4e87d3f17842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:02.125893 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780cae1-2326-4660-ad62-4e87d3f17842 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:02.126259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780cae1-2326-4660-ad62-4e87d3f17842 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:02.126620 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780cae1-2326-4660-ad62-4e87d3f17842 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:02.127435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780cae1-2326-4660-ad62-4e87d3f17842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:02.127826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780cae1-2326-4660-ad62-4e87d3f17842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:02.129426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780cae1-2326-4660-ad62-4e87d3f17842 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:02.144216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 626/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:02.151176 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b267096-670e-4420-8915-09df0f8486ab None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:02.319510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b267096-670e-4420-8915-09df0f8486ab None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:02.352359 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:02.364778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0018a55-5a91-403f-bbab-465b194d76cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:02.365480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0018a55-5a91-403f-bbab-465b194d76cb None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:02.365722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0018a55-5a91-403f-bbab-465b194d76cb None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:02.367063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0018a55-5a91-403f-bbab-465b194d76cb None admin] PATH_INFO: `/v3/users/placement` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:02.379243 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0018a55-5a91-403f-bbab-465b194d76cb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:02.381619 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0018a55-5a91-403f-bbab-465b194d76cb None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-f0018a55-5a91-403f-bbab-465b194d76cb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:58:02.399905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:02.402591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:02.405466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:02.405466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:02.405466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:58:02.405466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:58:02.405466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:58:02.405466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:58:02.405466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:58:02.405466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:58:02.405466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:58:02.405466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:58:02.405466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 627/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:02.411879 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780cae1-2326-4660-ad62-4e87d3f17842 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:02.487308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:02.542738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780cae1-2326-4660-ad62-4e87d3f17842 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:02.588094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c41ec-0e2e-47d6-ac2b-b56d342e79d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:02.588702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c41ec-0e2e-47d6-ac2b-b56d342e79d7 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:02.588982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c41ec-0e2e-47d6-ac2b-b56d342e79d7 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:02.589264 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c41ec-0e2e-47d6-ac2b-b56d342e79d7 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:02.590007 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c41ec-0e2e-47d6-ac2b-b56d342e79d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:02.590312 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c41ec-0e2e-47d6-ac2b-b56d342e79d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:02.591762 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c41ec-0e2e-47d6-ac2b-b56d342e79d7 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:02.611163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 627/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Sep 7 12:58:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:02.617284 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0018a55-5a91-403f-bbab-465b194d76cb None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:02.741680 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0018a55-5a91-403f-bbab-465b194d76cb None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:02.789588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937b608-617c-4a1a-a856-0c0e6c1993f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:02.790274 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937b608-617c-4a1a-a856-0c0e6c1993f4 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:02.790558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937b608-617c-4a1a-a856-0c0e6c1993f4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:02.790829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937b608-617c-4a1a-a856-0c0e6c1993f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:02.856757 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:02.873629 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937b608-617c-4a1a-a856-0c0e6c1993f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:02.875130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937b608-617c-4a1a-a856-0c0e6c1993f4 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:03.013170 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 628/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 12:58:03.019005 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c41ec-0e2e-47d6-ac2b-b56d342e79d7 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:03.155326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c41ec-0e2e-47d6-ac2b-b56d342e79d7 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:03.170758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:03.197270 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1da15-4ed3-4653-9d7e-57954432543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:03.197921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1da15-4ed3-4653-9d7e-57954432543b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:03.198194 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1da15-4ed3-4653-9d7e-57954432543b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:03.198461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1da15-4ed3-4653-9d7e-57954432543b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:03.210418 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1da15-4ed3-4653-9d7e-57954432543b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:03.211904 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1da15-4ed3-4653-9d7e-57954432543b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-56f1da15-4ed3-4653-9d7e-57954432543b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:58:03.228051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:03.229602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:58:03.230877 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:58:03.230877 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:03.230877 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:58:03.230877 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 628/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:03.235442 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937b608-617c-4a1a-a856-0c0e6c1993f4 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:03.340968 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:03.355292 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937b608-617c-4a1a-a856-0c0e6c1993f4 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:03.397079 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56717b63-5501-4787-b2ed-8f0119d11a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:03.397937 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56717b63-5501-4787-b2ed-8f0119d11a69 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:03.398228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56717b63-5501-4787-b2ed-8f0119d11a69 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:03.398502 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56717b63-5501-4787-b2ed-8f0119d11a69 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:03.399159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56717b63-5501-4787-b2ed-8f0119d11a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:03.399465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56717b63-5501-4787-b2ed-8f0119d11a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:03.400913 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56717b63-5501-4787-b2ed-8f0119d11a69 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:03.414503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 629/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:03.420676 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1da15-4ed3-4653-9d7e-57954432543b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:03.546977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1da15-4ed3-4653-9d7e-57954432543b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:03.587980 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6a3be-849b-4b13-93bc-0e7233abe366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:03.588707 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a3be-849b-4b13-93bc-0e7233abe366 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:03.589001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a3be-849b-4b13-93bc-0e7233abe366 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:03.589331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a3be-849b-4b13-93bc-0e7233abe366 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:03.596959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6a3be-849b-4b13-93bc-0e7233abe366 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:03.598488 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6a3be-849b-4b13-93bc-0e7233abe366 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:03.611354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-80f6a3be-849b-4b13-93bc-0e7233abe366 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:58:03.611354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:03.611354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:03.611354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:03.611354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:03.611354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:03.611354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:03.611354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:03.611354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:03.611354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:03.611354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:03.611354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:03.611354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:58:03.611354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:58:03.611354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:03.613217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:03.615694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:58:03.615694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:58:03.615694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:58:03.615694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:58:03.615694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:58:03.615694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:58:03.615694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:58:03.615694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:58:03.615694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 629/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:58:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:03.621820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56717b63-5501-4787-b2ed-8f0119d11a69 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:03.759613 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56717b63-5501-4787-b2ed-8f0119d11a69 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:03.810889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d58b4-d326-42ed-9ea1-87538de26942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:03.811628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d58b4-d326-42ed-9ea1-87538de26942 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:03.811908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d58b4-d326-42ed-9ea1-87538de26942 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:03.812191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d58b4-d326-42ed-9ea1-87538de26942 None admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:03.812945 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d58b4-d326-42ed-9ea1-87538de26942 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:03.813259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d58b4-d326-42ed-9ea1-87538de26942 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:03.814759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d58b4-d326-42ed-9ea1-87538de26942 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:03.829276 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 630/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:58:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:03.836081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6a3be-849b-4b13-93bc-0e7233abe366 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:03.867186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:03.954865 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6a3be-849b-4b13-93bc-0e7233abe366 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:03.992818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20b69e-6b43-4518-ae49-dfb3e3521b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:03.993447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20b69e-6b43-4518-ae49-dfb3e3521b80 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:03.993724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20b69e-6b43-4518-ae49-dfb3e3521b80 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:03.994000 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20b69e-6b43-4518-ae49-dfb3e3521b80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:03.994740 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20b69e-6b43-4518-ae49-dfb3e3521b80 None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=3381c0688581489b903e641f91914839, user.id=f2420def47ee4a5b8cf4373252583d75) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:03.995047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20b69e-6b43-4518-ae49-dfb3e3521b80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:03.996550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20b69e-6b43-4518-ae49-dfb3e3521b80 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:04.003185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 630/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:03 2022] GET /identity/v3/role_assignments?user.id=f2420def47ee4a5b8cf4373252583d75&scope.project.id=3381c0688581489b903e641f91914839&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:06.227939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764f4b9-b1b1-4a09-8c3a-9aa98d3429e8 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:06.228551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764f4b9-b1b1-4a09-8c3a-9aa98d3429e8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:06.228551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764f4b9-b1b1-4a09-8c3a-9aa98d3429e8 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:06.230896 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 631/1261] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:06.240029 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5b934-13c6-4ee3-bb48-d6ec154c0c81 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:06.240029 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5b934-13c6-4ee3-bb48-d6ec154c0c81 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:06.240029 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5b934-13c6-4ee3-bb48-d6ec154c0c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:06.257083 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-0fa5b934-13c6-4ee3-bb48-d6ec154c0c81 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:06.258624 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0fa5b934-13c6-4ee3-bb48-d6ec154c0c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:06.331381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 631/1262] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:58:06.616203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764f4b9-b1b1-4a09-8c3a-9aa98d3429e8 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:06.628534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:06.740135 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764f4b9-b1b1-4a09-8c3a-9aa98d3429e8 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:06.778544 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c97d50-e2c6-4dd7-9dd2-e26f4bf4dc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:06.779198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c97d50-e2c6-4dd7-9dd2-e26f4bf4dc8b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:06.779473 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c97d50-e2c6-4dd7-9dd2-e26f4bf4dc8b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:06.779744 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c97d50-e2c6-4dd7-9dd2-e26f4bf4dc8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:06.795334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c97d50-e2c6-4dd7-9dd2-e26f4bf4dc8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-e5c97d50-e2c6-4dd7-9dd2-e26f4bf4dc8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:06.800179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:06.801427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:06.802535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:06.802535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:06.802535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:06.802535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:06.802535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:06.802535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:06.802535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:06.802535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:06.802535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:06.802535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:06.802535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:06.802535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:58:06.802535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 632/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:58:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:06.809878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5b934-13c6-4ee3-bb48-d6ec154c0c81 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:06.842583 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:06.940956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5b934-13c6-4ee3-bb48-d6ec154c0c81 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:06.979177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975bc7e-ff5e-44be-abc5-4fbdd25d8dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:06.979807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975bc7e-ff5e-44be-abc5-4fbdd25d8dce None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:06.980082 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975bc7e-ff5e-44be-abc5-4fbdd25d8dce None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:06.980345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975bc7e-ff5e-44be-abc5-4fbdd25d8dce None admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:06.981057 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975bc7e-ff5e-44be-abc5-4fbdd25d8dce None admin] RBAC: Adding query filter params (name=admin) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:06.981357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975bc7e-ff5e-44be-abc5-4fbdd25d8dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:06.982753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975bc7e-ff5e-44be-abc5-4fbdd25d8dce None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:06.992563 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 632/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:06.998986 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c97d50-e2c6-4dd7-9dd2-e26f4bf4dc8b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:07.072725 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:07.110536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c97d50-e2c6-4dd7-9dd2-e26f4bf4dc8b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:07.148604 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d1340-6005-478a-8352-7e01d72b9378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:07.149247 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d1340-6005-478a-8352-7e01d72b9378 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:07.149524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d1340-6005-478a-8352-7e01d72b9378 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:07.149797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d1340-6005-478a-8352-7e01d72b9378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:07.162565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d1340-6005-478a-8352-7e01d72b9378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:07.164487 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d1340-6005-478a-8352-7e01d72b9378 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-130d1340-6005-478a-8352-7e01d72b9378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:58:07.181060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:07.182766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:58:07.183992 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:58:07.183992 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:07.183992 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:58:07.183992 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 633/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:58:07.188954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975bc7e-ff5e-44be-abc5-4fbdd25d8dce None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:07.280679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:07.300580 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975bc7e-ff5e-44be-abc5-4fbdd25d8dce None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:07.336798 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992b73c-ac7f-4efd-b509-cfc036813920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:07.337418 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992b73c-ac7f-4efd-b509-cfc036813920 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:07.337688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992b73c-ac7f-4efd-b509-cfc036813920 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:07.337957 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992b73c-ac7f-4efd-b509-cfc036813920 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:07.338603 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992b73c-ac7f-4efd-b509-cfc036813920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:07.338900 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992b73c-ac7f-4efd-b509-cfc036813920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:07.340277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992b73c-ac7f-4efd-b509-cfc036813920 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:07.352990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 633/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:07.361231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d1340-6005-478a-8352-7e01d72b9378 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:07.480389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d1340-6005-478a-8352-7e01d72b9378 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:07.505501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:07.522824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e4be2-fdb7-4995-9a04-01f1e3d32145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:07.523612 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e4be2-fdb7-4995-9a04-01f1e3d32145 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:07.523895 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e4be2-fdb7-4995-9a04-01f1e3d32145 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:07.524171 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e4be2-fdb7-4995-9a04-01f1e3d32145 None admin] PATH_INFO: `/v3/users/placement` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:07.533253 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e4be2-fdb7-4995-9a04-01f1e3d32145 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:07.534655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e4be2-fdb7-4995-9a04-01f1e3d32145 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-ab9e4be2-fdb7-4995-9a04-01f1e3d32145 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:58:07.547469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:07.548741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:07.550399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:07.550399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:07.550399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:58:07.550399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:58:07.550399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:58:07.550399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:58:07.550399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:58:07.550399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:58:07.550399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:58:07.550399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:58:07.550399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 634/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:07.555329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992b73c-ac7f-4efd-b509-cfc036813920 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:07.680302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992b73c-ac7f-4efd-b509-cfc036813920 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:07.734594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f1239-2c42-45ff-bd45-5f705bcf7f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:07.735233 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f1239-2c42-45ff-bd45-5f705bcf7f25 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:07.735494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f1239-2c42-45ff-bd45-5f705bcf7f25 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:07.735776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f1239-2c42-45ff-bd45-5f705bcf7f25 None admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:07.736579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f1239-2c42-45ff-bd45-5f705bcf7f25 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:07.736882 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f1239-2c42-45ff-bd45-5f705bcf7f25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:07.738353 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f1239-2c42-45ff-bd45-5f705bcf7f25 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:07.749096 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:07.759206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 634/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Sep 7 12:58:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:07.765406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e4be2-fdb7-4995-9a04-01f1e3d32145 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:07.886519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e4be2-fdb7-4995-9a04-01f1e3d32145 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:07.945379 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53296a-851a-44c2-acd6-521cd01d44d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:07.946192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53296a-851a-44c2-acd6-521cd01d44d0 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:07.946472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53296a-851a-44c2-acd6-521cd01d44d0 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:07.946743 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53296a-851a-44c2-acd6-521cd01d44d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:07.958630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53296a-851a-44c2-acd6-521cd01d44d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:07.960151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53296a-851a-44c2-acd6-521cd01d44d0 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-fc53296a-851a-44c2-acd6-521cd01d44d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:58:07.974995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:07.976677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:58:07.977876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:58:07.977876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:07.977876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:58:07.977876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 635/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:07.983815 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f1239-2c42-45ff-bd45-5f705bcf7f25 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:08.090690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f1239-2c42-45ff-bd45-5f705bcf7f25 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:08.128084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a516b0-df1d-4aac-b256-503ae04a0634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:08.128631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a516b0-df1d-4aac-b256-503ae04a0634 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:08.128910 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a516b0-df1d-4aac-b256-503ae04a0634 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:08.129181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a516b0-df1d-4aac-b256-503ae04a0634 None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:08.129824 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a516b0-df1d-4aac-b256-503ae04a0634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:08.130125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a516b0-df1d-4aac-b256-503ae04a0634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:08.131505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a516b0-df1d-4aac-b256-503ae04a0634 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:08.143725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 635/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:08.150235 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53296a-851a-44c2-acd6-521cd01d44d0 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:08.185405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:08.258216 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53296a-851a-44c2-acd6-521cd01d44d0 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:08.294160 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b38d10-00d2-4397-9844-dba162189158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:08.294796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b38d10-00d2-4397-9844-dba162189158 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:08.295075 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b38d10-00d2-4397-9844-dba162189158 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:08.295349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b38d10-00d2-4397-9844-dba162189158 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:08.302344 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b38d10-00d2-4397-9844-dba162189158 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:08.304002 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b38d10-00d2-4397-9844-dba162189158 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:08.326825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-09b38d10-00d2-4397-9844-dba162189158 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:58:08.326825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:08.326825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:08.326825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:08.326825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:08.326825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:08.326825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:08.326825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:08.326825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:08.326825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:08.326825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:08.326825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:08.326825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:58:08.326825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:58:08.326825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:08.327974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:08.329049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:58:08.329049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:58:08.329049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:58:08.329049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:58:08.329049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:58:08.329049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:58:08.329049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:58:08.329049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:58:08.329049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 636/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:58:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:08.334149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a516b0-df1d-4aac-b256-503ae04a0634 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:08.401398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:08.444497 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a516b0-df1d-4aac-b256-503ae04a0634 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:08.486213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c721e7e-ce63-486b-97d6-29adf1f2008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:08.486824 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c721e7e-ce63-486b-97d6-29adf1f2008f None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:08.487098 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c721e7e-ce63-486b-97d6-29adf1f2008f None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:08.487360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c721e7e-ce63-486b-97d6-29adf1f2008f None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:08.488058 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c721e7e-ce63-486b-97d6-29adf1f2008f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:08.488347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c721e7e-ce63-486b-97d6-29adf1f2008f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:08.489860 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c721e7e-ce63-486b-97d6-29adf1f2008f None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:08.502396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 636/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:58:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:08.509052 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b38d10-00d2-4397-9844-dba162189158 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:08.607004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:08.616323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b38d10-00d2-4397-9844-dba162189158 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:08.653080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2eb49-c19b-453b-b2e2-ce2f14bc7374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:08.653648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2eb49-c19b-453b-b2e2-ce2f14bc7374 None admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:08.653922 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2eb49-c19b-453b-b2e2-ce2f14bc7374 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:08.654199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2eb49-c19b-453b-b2e2-ce2f14bc7374 None admin] PATH_INFO: `/v3/projects/3381c0688581489b903e641f91914839/users/f2420def47ee4a5b8cf4373252583d75/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:08.656054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2eb49-c19b-453b-b2e2-ce2f14bc7374 None admin] RBAC: Authorizing `identity:create_grant(project_id=3381c0688581489b903e641f91914839, user_id=f2420def47ee4a5b8cf4373252583d75, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:08.657561 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2eb49-c19b-453b-b2e2-ce2f14bc7374 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:08.672144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 637/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Sep 7 12:58:08 2022] PUT /identity/v3/projects/3381c0688581489b903e641f91914839/users/f2420def47ee4a5b8cf4373252583d75/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:58:10.844479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4c96a-8326-4cea-81e7-64257901c16b None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:10.845073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4c96a-8326-4cea-81e7-64257901c16b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:10.845073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4c96a-8326-4cea-81e7-64257901c16b None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:10.846913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 637/1274] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:10.855003 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576fcc4-d4e0-4155-b286-f5c8341738a1 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:10.855440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576fcc4-d4e0-4155-b286-f5c8341738a1 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:10.855542 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576fcc4-d4e0-4155-b286-f5c8341738a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:10.874829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-b576fcc4-d4e0-4155-b286-f5c8341738a1 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:10.876058 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b576fcc4-d4e0-4155-b286-f5c8341738a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:10.953218 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 638/1275] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:58:11.217756 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4c96a-8326-4cea-81e7-64257901c16b None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:11.325452 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4c96a-8326-4cea-81e7-64257901c16b None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:11.343257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:11.362188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801b9e2-48dd-4f30-ae28-309fd17645a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:11.362859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801b9e2-48dd-4f30-ae28-309fd17645a2 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:11.363128 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801b9e2-48dd-4f30-ae28-309fd17645a2 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:11.363391 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801b9e2-48dd-4f30-ae28-309fd17645a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:11.377052 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801b9e2-48dd-4f30-ae28-309fd17645a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-4801b9e2-48dd-4f30-ae28-309fd17645a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:11.382168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:11.383464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:11.384324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:11.384324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:11.384324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:11.384324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:11.384324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:11.384324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:11.384324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:11.384324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:11.384324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:11.384324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:11.384324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:11.384324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:58:11.384324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 638/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Sep 7 12:58:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:11.390879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576fcc4-d4e0-4155-b286-f5c8341738a1 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:11.479852 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:11.506564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576fcc4-d4e0-4155-b286-f5c8341738a1 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:11.548832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6e8c5-f8d3-4a50-acb6-fc98de60763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:11.549453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6e8c5-f8d3-4a50-acb6-fc98de60763b None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:11.549735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6e8c5-f8d3-4a50-acb6-fc98de60763b None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:11.550009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6e8c5-f8d3-4a50-acb6-fc98de60763b None admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:11.550690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6e8c5-f8d3-4a50-acb6-fc98de60763b None admin] RBAC: Adding query filter params (name=admin) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:11.550996 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6e8c5-f8d3-4a50-acb6-fc98de60763b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:11.552419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6e8c5-f8d3-4a50-acb6-fc98de60763b None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:11.561102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 639/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:11.567335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801b9e2-48dd-4f30-ae28-309fd17645a2 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:11.675908 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801b9e2-48dd-4f30-ae28-309fd17645a2 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:11.711710 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09380988-dfd7-455b-b93e-d18381482963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:11.712337 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09380988-dfd7-455b-b93e-d18381482963 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:11.712652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09380988-dfd7-455b-b93e-d18381482963 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:11.712925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09380988-dfd7-455b-b93e-d18381482963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:11.723737 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09380988-dfd7-455b-b93e-d18381482963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:11.725232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09380988-dfd7-455b-b93e-d18381482963 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-09380988-dfd7-455b-b93e-d18381482963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:58:11.740413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:11.742223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:58:11.743345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:58:11.743345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:11.743345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:58:11.743345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 639/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:11.748048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6e8c5-f8d3-4a50-acb6-fc98de60763b None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:11.854753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6e8c5-f8d3-4a50-acb6-fc98de60763b None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:11.890825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1882ca1-fe9c-4e52-8549-72a495337476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:11.891476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1882ca1-fe9c-4e52-8549-72a495337476 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:11.891695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1882ca1-fe9c-4e52-8549-72a495337476 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:11.891960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1882ca1-fe9c-4e52-8549-72a495337476 None admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:11.892645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1882ca1-fe9c-4e52-8549-72a495337476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:11.892945 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1882ca1-fe9c-4e52-8549-72a495337476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:11.894422 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1882ca1-fe9c-4e52-8549-72a495337476 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:11.907468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 640/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:11.913450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09380988-dfd7-455b-b93e-d18381482963 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:11.945743 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:12.021025 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09380988-dfd7-455b-b93e-d18381482963 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:12.056404 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c229e43-5734-4374-b20a-11502355a30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:12.057057 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c229e43-5734-4374-b20a-11502355a30b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:12.057330 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c229e43-5734-4374-b20a-11502355a30b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:12.057593 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c229e43-5734-4374-b20a-11502355a30b None admin] PATH_INFO: `/v3/users/placement` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:12.066558 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c229e43-5734-4374-b20a-11502355a30b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:12.068084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c229e43-5734-4374-b20a-11502355a30b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-8c229e43-5734-4374-b20a-11502355a30b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:58:12.079724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:12.080857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:12.082174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:12.082174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:12.082174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:58:12.082174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:58:12.082174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:58:12.082174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:58:12.082174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:58:12.082174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:58:12.082174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:58:12.082174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:58:12.082174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 640/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:12.087035 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1882ca1-fe9c-4e52-8549-72a495337476 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:12.091478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:12.197215 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1882ca1-fe9c-4e52-8549-72a495337476 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:12.241713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbca0ca-cf69-41d4-a165-a18c5d78acd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:12.242331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbca0ca-cf69-41d4-a165-a18c5d78acd4 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:12.242604 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbca0ca-cf69-41d4-a165-a18c5d78acd4 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:12.242869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbca0ca-cf69-41d4-a165-a18c5d78acd4 None admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:12.243605 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbca0ca-cf69-41d4-a165-a18c5d78acd4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:12.243908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbca0ca-cf69-41d4-a165-a18c5d78acd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:12.245384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbca0ca-cf69-41d4-a165-a18c5d78acd4 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:12.264706 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 641/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Sep 7 12:58:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:12.270696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c229e43-5734-4374-b20a-11502355a30b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:12.363331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:12.373852 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c229e43-5734-4374-b20a-11502355a30b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:12.410277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64db668-86b4-42d4-9753-fe2c04208099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:12.410885 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64db668-86b4-42d4-9753-fe2c04208099 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:12.411159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64db668-86b4-42d4-9753-fe2c04208099 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:12.411430 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64db668-86b4-42d4-9753-fe2c04208099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:12.488330 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64db668-86b4-42d4-9753-fe2c04208099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:12.489818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64db668-86b4-42d4-9753-fe2c04208099 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:12.585817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:12.597672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 641/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:58:12.604408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbca0ca-cf69-41d4-a165-a18c5d78acd4 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:12.672840 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:12.714106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbca0ca-cf69-41d4-a165-a18c5d78acd4 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:12.750649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbc4b3-b6db-4f52-ac0f-d638b6fe179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:12.751279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbc4b3-b6db-4f52-ac0f-d638b6fe179f None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:12.751549 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbc4b3-b6db-4f52-ac0f-d638b6fe179f None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:12.751819 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbc4b3-b6db-4f52-ac0f-d638b6fe179f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:12.762943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbc4b3-b6db-4f52-ac0f-d638b6fe179f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:12.764498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbc4b3-b6db-4f52-ac0f-d638b6fe179f None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-ebcbc4b3-b6db-4f52-ac0f-d638b6fe179f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:58:12.779226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:12.780406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:58:12.781606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:58:12.781606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:12.781606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:58:12.781606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 642/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:12.786476 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64db668-86b4-42d4-9753-fe2c04208099 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:12.896635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64db668-86b4-42d4-9753-fe2c04208099 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:12.932427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574877c-b483-4190-b6ee-7f86cdfb341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:12.933079 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574877c-b483-4190-b6ee-7f86cdfb341b None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:12.933236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574877c-b483-4190-b6ee-7f86cdfb341b None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:12.933504 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574877c-b483-4190-b6ee-7f86cdfb341b None admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:12.934162 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574877c-b483-4190-b6ee-7f86cdfb341b None admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:12.934464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574877c-b483-4190-b6ee-7f86cdfb341b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:12.936063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574877c-b483-4190-b6ee-7f86cdfb341b None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:12.948234 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 642/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Sep 7 12:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:12.954299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbc4b3-b6db-4f52-ac0f-d638b6fe179f None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:13.067935 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbc4b3-b6db-4f52-ac0f-d638b6fe179f None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:13.085711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:13.108697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed06bec-d177-4f40-9dfa-3babc57831a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:13.109324 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed06bec-d177-4f40-9dfa-3babc57831a0 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:13.109602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed06bec-d177-4f40-9dfa-3babc57831a0 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:13.109872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed06bec-d177-4f40-9dfa-3babc57831a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:13.117109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed06bec-d177-4f40-9dfa-3babc57831a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:13.118649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed06bec-d177-4f40-9dfa-3babc57831a0 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:13.130587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application [None req-fed06bec-d177-4f40-9dfa-3babc57831a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:58:13.130587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:13.130587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:13.130587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:13.130587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:13.130587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:13.130587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:13.130587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:13.130587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:13.130587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:13.130587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:13.130587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:13.130587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:58:13.130587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:58:13.130587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:13.131714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:13.134279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:58:13.134279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:58:13.134279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:58:13.134279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:58:13.134279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:58:13.134279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:58:13.134279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:58:13.134279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: ERROR keystone.server.flask.application Sep 07 12:58:13.134279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 643/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Sep 7 12:58:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:13.139130 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574877c-b483-4190-b6ee-7f86cdfb341b None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:13.195030 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:13.268218 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574877c-b483-4190-b6ee-7f86cdfb341b None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:13.320314 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba086e8b-7ae4-4719-96f0-96e923bb038a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:13.320956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba086e8b-7ae4-4719-96f0-96e923bb038a None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:13.321235 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba086e8b-7ae4-4719-96f0-96e923bb038a None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:13.321505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba086e8b-7ae4-4719-96f0-96e923bb038a None admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:13.322207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba086e8b-7ae4-4719-96f0-96e923bb038a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:13.322511 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba086e8b-7ae4-4719-96f0-96e923bb038a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:13.323970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba086e8b-7ae4-4719-96f0-96e923bb038a None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:13.336421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 643/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Sep 7 12:58:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:13.342927 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed06bec-d177-4f40-9dfa-3babc57831a0 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:13.450526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed06bec-d177-4f40-9dfa-3babc57831a0 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:13.487170 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0bf3a-96b8-4b19-9ada-1aca7c3d18e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:13.487807 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0bf3a-96b8-4b19-9ada-1aca7c3d18e1 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:13.488091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0bf3a-96b8-4b19-9ada-1aca7c3d18e1 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:13.488363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0bf3a-96b8-4b19-9ada-1aca7c3d18e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:13.489127 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0bf3a-96b8-4b19-9ada-1aca7c3d18e1 None admin] RBAC: Adding query filter params (role.id=ec4ce60afb404b16a36bbb4974e0bca1, scope.project.id=3381c0688581489b903e641f91914839, user.id=f2420def47ee4a5b8cf4373252583d75) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:13.489437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0bf3a-96b8-4b19-9ada-1aca7c3d18e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:13.490892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0bf3a-96b8-4b19-9ada-1aca7c3d18e1 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:13.497010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 644/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:13 2022] GET /identity/v3/role_assignments?user.id=f2420def47ee4a5b8cf4373252583d75&scope.project.id=3381c0688581489b903e641f91914839&role.id=ec4ce60afb404b16a36bbb4974e0bca1 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:15.691081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1695255-74ca-4a17-91e7-eeb69cd31336 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:15.691699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1695255-74ca-4a17-91e7-eeb69cd31336 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:15.691699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1695255-74ca-4a17-91e7-eeb69cd31336 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:15.692982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 644/1288] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:15.698756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e164293-d5f8-45a3-9a30-40a7e5e99045 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:15.699190 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e164293-d5f8-45a3-9a30-40a7e5e99045 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:15.699282 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e164293-d5f8-45a3-9a30-40a7e5e99045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:15.718553 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-0e164293-d5f8-45a3-9a30-40a7e5e99045 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:15.719756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0e164293-d5f8-45a3-9a30-40a7e5e99045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:15.752089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:15.793315 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 645/1289] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:58:16.055624 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1695255-74ca-4a17-91e7-eeb69cd31336 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:16.167284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1695255-74ca-4a17-91e7-eeb69cd31336 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:16.178875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:16.203925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702679d-7200-4f58-afb7-ff27d3c3e0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:16.204577 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702679d-7200-4f58-afb7-ff27d3c3e0a4 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:16.205029 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702679d-7200-4f58-afb7-ff27d3c3e0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:16.205125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702679d-7200-4f58-afb7-ff27d3c3e0a4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:16.205696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702679d-7200-4f58-afb7-ff27d3c3e0a4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:16.207099 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702679d-7200-4f58-afb7-ff27d3c3e0a4 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-c702679d-7200-4f58-afb7-ff27d3c3e0a4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:16.216858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:16.218165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:16.219266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:16.219266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:16.219266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:16.219266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:16.219266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:16.219266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:16.219266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:16.219266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:16.219266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:16.219266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:16.219266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:58:16.219266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:58:16.219266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:58:16.219266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:58:16.219266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 645/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Sep 7 12:58:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:16.224294 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e164293-d5f8-45a3-9a30-40a7e5e99045 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:16.332331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e164293-d5f8-45a3-9a30-40a7e5e99045 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:16.372115 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573b3b4-e55f-4224-aa67-9a6d95abffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:16.372779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573b3b4-e55f-4224-aa67-9a6d95abffd1 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:16.373060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573b3b4-e55f-4224-aa67-9a6d95abffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:16.373333 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573b3b4-e55f-4224-aa67-9a6d95abffd1 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:16.373981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573b3b4-e55f-4224-aa67-9a6d95abffd1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:16.374286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573b3b4-e55f-4224-aa67-9a6d95abffd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:16.375696 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573b3b4-e55f-4224-aa67-9a6d95abffd1 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:16.381205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 646/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Sep 7 12:58:16 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:16.387780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702679d-7200-4f58-afb7-ff27d3c3e0a4 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:16.505009 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702679d-7200-4f58-afb7-ff27d3c3e0a4 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:16.543087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34982471-198b-4915-a525-7190a4168790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:16.543702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982471-198b-4915-a525-7190a4168790 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:16.543981 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982471-198b-4915-a525-7190a4168790 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:16.544250 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982471-198b-4915-a525-7190a4168790 None admin] PATH_INFO: `/v3/services` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:16.544914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34982471-198b-4915-a525-7190a4168790 None admin] RBAC: Adding query filter params (type=placement) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:16.545213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34982471-198b-4915-a525-7190a4168790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:16.546596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34982471-198b-4915-a525-7190a4168790 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:16.551045 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 646/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Sep 7 12:58:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:18.727172 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a482c6-8561-410e-b06e-cd0414da8fde None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:18.727737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a482c6-8561-410e-b06e-cd0414da8fde None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:18.727737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a482c6-8561-410e-b06e-cd0414da8fde None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:18.729148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 647/1293] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:18.734667 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d040a1c-f129-43e5-8d3b-0220fbdcf215 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:18.735134 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d040a1c-f129-43e5-8d3b-0220fbdcf215 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:18.735241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d040a1c-f129-43e5-8d3b-0220fbdcf215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:18.754838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-3d040a1c-f129-43e5-8d3b-0220fbdcf215 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:18.756087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3d040a1c-f129-43e5-8d3b-0220fbdcf215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:18.789572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:18.837605 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 647/1294] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:58:19.117091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a482c6-8561-410e-b06e-cd0414da8fde None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:19.151250 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:19.229967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a482c6-8561-410e-b06e-cd0414da8fde None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:19.272158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcfcfa-0a0b-473a-a37f-a3721761df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:19.272847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcfcfa-0a0b-473a-a37f-a3721761df7e None admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:19.273128 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcfcfa-0a0b-473a-a37f-a3721761df7e None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:19.273491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcfcfa-0a0b-473a-a37f-a3721761df7e None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:19.274169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcfcfa-0a0b-473a-a37f-a3721761df7e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:19.275554 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcfcfa-0a0b-473a-a37f-a3721761df7e None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:19.295023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 648/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Sep 7 12:58:19 2022] POST /identity/v3/services => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:58:21.489401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968eb5f3-8096-41c3-b1aa-7cbee205349b None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:21.490285 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968eb5f3-8096-41c3-b1aa-7cbee205349b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:21.490285 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968eb5f3-8096-41c3-b1aa-7cbee205349b None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:21.491969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 648/1296] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:21.498050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bc7d0-bd33-494b-885f-5c4113440255 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:21.498598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bc7d0-bd33-494b-885f-5c4113440255 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:21.498598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bc7d0-bd33-494b-885f-5c4113440255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:21.518307 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-f20bc7d0-bd33-494b-885f-5c4113440255 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:21.519519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f20bc7d0-bd33-494b-885f-5c4113440255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:21.599923 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 649/1297] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:58:21.865306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968eb5f3-8096-41c3-b1aa-7cbee205349b None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:21.978638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968eb5f3-8096-41c3-b1aa-7cbee205349b None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:22.015272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c376339-6db8-4e25-8b2d-3e3a07a556f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:22.015917 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c376339-6db8-4e25-8b2d-3e3a07a556f4 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.016191 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c376339-6db8-4e25-8b2d-3e3a07a556f4 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.016493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c376339-6db8-4e25-8b2d-3e3a07a556f4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.017082 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c376339-6db8-4e25-8b2d-3e3a07a556f4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:22.018480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c376339-6db8-4e25-8b2d-3e3a07a556f4 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-8c376339-6db8-4e25-8b2d-3e3a07a556f4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:22.028003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:22.029357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:22.030236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:22.030236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:22.030236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:22.030236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:22.030236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:22.030236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:22.030236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:22.030236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:22.030236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:22.030236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:22.030236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:58:22.030236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:58:22.030236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:58:22.030236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:58:22.030236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 649/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Sep 7 12:58:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:22.035592 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bc7d0-bd33-494b-885f-5c4113440255 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:22.056914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:22.147159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bc7d0-bd33-494b-885f-5c4113440255 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:22.182111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc82c1d-4e8a-47e4-af52-2c1c4a52c3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:22.182731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc82c1d-4e8a-47e4-af52-2c1c4a52c3d1 None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.183011 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc82c1d-4e8a-47e4-af52-2c1c4a52c3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.183291 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc82c1d-4e8a-47e4-af52-2c1c4a52c3d1 None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.183930 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc82c1d-4e8a-47e4-af52-2c1c4a52c3d1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:22.184230 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc82c1d-4e8a-47e4-af52-2c1c4a52c3d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:22.185685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc82c1d-4e8a-47e4-af52-2c1c4a52c3d1 None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:22.191099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 650/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Sep 7 12:58:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:22.197541 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c376339-6db8-4e25-8b2d-3e3a07a556f4 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:22.232203 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:22.308105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c376339-6db8-4e25-8b2d-3e3a07a556f4 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:22.343325 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e674648-60ae-4e1e-91aa-13c4baf743db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:22.343935 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e674648-60ae-4e1e-91aa-13c4baf743db None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.344214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e674648-60ae-4e1e-91aa-13c4baf743db None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.344517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e674648-60ae-4e1e-91aa-13c4baf743db None admin] PATH_INFO: `/v3/endpoints` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.345227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e674648-60ae-4e1e-91aa-13c4baf743db None admin] RBAC: Adding query filter params (interface=public, service_id=da132b7bb8764115900c257f77782b71, region_id=RegionOne) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:22.345532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e674648-60ae-4e1e-91aa-13c4baf743db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:22.346928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e674648-60ae-4e1e-91aa-13c4baf743db None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:22.352557 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 650/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Sep 7 12:58:22 2022] GET /identity/v3/endpoints?service_id=da132b7bb8764115900c257f77782b71&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:22.359192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc82c1d-4e8a-47e4-af52-2c1c4a52c3d1 None admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:22.449773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:22.470706 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc82c1d-4e8a-47e4-af52-2c1c4a52c3d1 None admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:22.507591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c29d8-ba2e-4e94-81d3-732251deeddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:22.509091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c29d8-ba2e-4e94-81d3-732251deeddd None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.509373 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c29d8-ba2e-4e94-81d3-732251deeddd None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.509644 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c29d8-ba2e-4e94-81d3-732251deeddd None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.510259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c29d8-ba2e-4e94-81d3-732251deeddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:22.511664 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c29d8-ba2e-4e94-81d3-732251deeddd None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:22.519148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 651/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Sep 7 12:58:22 2022] GET /identity/v3/services => generated 2191 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 12:58:24.745520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104661ab-bac4-48c9-9a9d-b8125091c7dd None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:24.746085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104661ab-bac4-48c9-9a9d-b8125091c7dd None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:24.746085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104661ab-bac4-48c9-9a9d-b8125091c7dd None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:24.747387 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 651/1302] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:24.753009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698687ef-1240-485f-bf66-062fa9ba892b None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:24.753478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698687ef-1240-485f-bf66-062fa9ba892b None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:24.753571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698687ef-1240-485f-bf66-062fa9ba892b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:24.774536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-698687ef-1240-485f-bf66-062fa9ba892b None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:24.775828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-698687ef-1240-485f-bf66-062fa9ba892b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:24.851418 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 652/1303] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:58:25.122696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104661ab-bac4-48c9-9a9d-b8125091c7dd None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:25.229227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:25.237336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104661ab-bac4-48c9-9a9d-b8125091c7dd None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:25.274313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c43ed-b3f1-4592-aad2-41efe9b257d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:25.274950 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c43ed-b3f1-4592-aad2-41efe9b257d0 None admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:25.275229 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c43ed-b3f1-4592-aad2-41efe9b257d0 None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:25.275499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c43ed-b3f1-4592-aad2-41efe9b257d0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:25.276086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c43ed-b3f1-4592-aad2-41efe9b257d0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:25.277501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c43ed-b3f1-4592-aad2-41efe9b257d0 None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application [None req-736c43ed-b3f1-4592-aad2-41efe9b257d0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:25.286526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:25.287791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:25.289775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:25.289775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:25.289775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:25.289775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:25.289775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:25.289775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:25.289775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:25.289775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:25.289775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:25.289775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:25.289775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:58:25.289775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:58:25.289775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:58:25.289775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: ERROR keystone.server.flask.application Sep 07 12:58:25.289775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 652/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Sep 7 12:58:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:25.294079 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698687ef-1240-485f-bf66-062fa9ba892b None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:25.376428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:25.402298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698687ef-1240-485f-bf66-062fa9ba892b None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:25.440274 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350c5db-d03e-42a9-bbf1-0399c55a68fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:25.440931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350c5db-d03e-42a9-bbf1-0399c55a68fa None admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:25.441213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350c5db-d03e-42a9-bbf1-0399c55a68fa None admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:25.441476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350c5db-d03e-42a9-bbf1-0399c55a68fa None admin] PATH_INFO: `/v3/services` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:25.442117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350c5db-d03e-42a9-bbf1-0399c55a68fa None admin] RBAC: Adding query filter params (name=placement) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:25.442412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350c5db-d03e-42a9-bbf1-0399c55a68fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:25.443814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350c5db-d03e-42a9-bbf1-0399c55a68fa None admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:25.454541 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 653/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Sep 7 12:58:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:25.460781 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c43ed-b3f1-4592-aad2-41efe9b257d0 None admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:25.580199 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c43ed-b3f1-4592-aad2-41efe9b257d0 None admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:25.617821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d001d-a3ef-4076-b75a-fee98bed3e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:25.618437 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d001d-a3ef-4076-b75a-fee98bed3e4c None admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:25.618717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d001d-a3ef-4076-b75a-fee98bed3e4c None admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:25.618984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d001d-a3ef-4076-b75a-fee98bed3e4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:25.619668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d001d-a3ef-4076-b75a-fee98bed3e4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:25.621083 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d001d-a3ef-4076-b75a-fee98bed3e4c None admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:25.644039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 653/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 12:58:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:58:35.447252 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=30 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:35.641611 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:36.219444 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a91c76-5492-4dad-92a3-5d86ed257b95 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:36.220366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a91c76-5492-4dad-92a3-5d86ed257b95 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:36.220829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a91c76-5492-4dad-92a3-5d86ed257b95 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:36.226780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 654/1307] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:59:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:36.228246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93f067-750f-48a9-8feb-3adacf8fbba8 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:36.228899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93f067-750f-48a9-8feb-3adacf8fbba8 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:36.228899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93f067-750f-48a9-8feb-3adacf8fbba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:36.332011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-5a93f067-750f-48a9-8feb-3adacf8fbba8 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:36.333402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5a93f067-750f-48a9-8feb-3adacf8fbba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:36.488878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 654/1308] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:36.806664 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c6272-867a-48f4-a423-8e445fe53637 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:36.807318 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c6272-867a-48f4-a423-8e445fe53637 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:36.807610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c6272-867a-48f4-a423-8e445fe53637 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:36.809320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 655/1309] 10.222.0.30 () {54 vars in 965 bytes} [Wed Sep 7 12:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:36.827546 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cebbd-6eba-49c8-8016-5db770104980 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:36.827799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cebbd-6eba-49c8-8016-5db770104980 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:36.828527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cebbd-6eba-49c8-8016-5db770104980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:36.945439 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-d28cebbd-6eba-49c8-8016-5db770104980 None None] MFA Rules not processed for user `eefd1293a22848e3b595e54be0455d10`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:36.946619 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d28cebbd-6eba-49c8-8016-5db770104980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:36.976286 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:37.047991 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 655/1310] 10.222.0.30 () {58 vars in 1062 bytes} [Wed Sep 7 12:59:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:37.060339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c6272-867a-48f4-a423-8e445fe53637 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:37.062278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-277c6272-867a-48f4-a423-8e445fe53637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:37.182512 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c6272-867a-48f4-a423-8e445fe53637 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:37.280079 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c2a15-2afa-4a40-aded-411242a9b34d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:37.280759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c2a15-2afa-4a40-aded-411242a9b34d service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.281015 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c2a15-2afa-4a40-aded-411242a9b34d service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.281266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c2a15-2afa-4a40-aded-411242a9b34d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.282952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ba3c2a15-2afa-4a40-aded-411242a9b34d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:37.350213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:37.426220 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c2a15-2afa-4a40-aded-411242a9b34d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:37.427924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c2a15-2afa-4a40-aded-411242a9b34d service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:37.454911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 656/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:39.980727 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6764f-8893-4139-b541-9deaa004da6b None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:39.981307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6764f-8893-4139-b541-9deaa004da6b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:39.981307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6764f-8893-4139-b541-9deaa004da6b None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:39.982597 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 656/1312] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:39.988357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4062c5-29fd-4730-aa22-93b3153da44b None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:39.988867 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4062c5-29fd-4730-aa22-93b3153da44b None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:39.988971 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4062c5-29fd-4730-aa22-93b3153da44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:40.067763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-ce4062c5-29fd-4730-aa22-93b3153da44b None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:40.069044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ce4062c5-29fd-4730-aa22-93b3153da44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:40.177525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 657/1313] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:40.468187 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6764f-8893-4139-b541-9deaa004da6b None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:40.469915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5ab6764f-8893-4139-b541-9deaa004da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:40.596326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6764f-8893-4139-b541-9deaa004da6b None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:40.679752 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:40.682554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f20509-c1ef-4b12-90f7-8130c1407ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:40.683217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f20509-c1ef-4b12-90f7-8130c1407ddb service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:40.683508 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f20509-c1ef-4b12-90f7-8130c1407ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:40.683774 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f20509-c1ef-4b12-90f7-8130c1407ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:40.686126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-09f20509-c1ef-4b12-90f7-8130c1407ddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:40.803832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f20509-c1ef-4b12-90f7-8130c1407ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:40.805336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f20509-c1ef-4b12-90f7-8130c1407ddb service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:40.825725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 657/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:43.362848 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82600b13-a0c6-4a2f-a0c0-6154000cd424 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:43.363472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82600b13-a0c6-4a2f-a0c0-6154000cd424 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:43.363472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82600b13-a0c6-4a2f-a0c0-6154000cd424 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:43.364768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 658/1315] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:43.370600 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27991f83-265c-4d45-a739-c7b50d214080 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:43.371144 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27991f83-265c-4d45-a739-c7b50d214080 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:43.371144 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27991f83-265c-4d45-a739-c7b50d214080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:43.443211 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-27991f83-265c-4d45-a739-c7b50d214080 None None] MFA Rules not processed for user `0c72aeb6d2de4684b788eeaec1b07e38`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:43.444480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-27991f83-265c-4d45-a739-c7b50d214080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:43.502608 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:43.551121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 658/1316] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:43.848696 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82600b13-a0c6-4a2f-a0c0-6154000cd424 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:43.850436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-82600b13-a0c6-4a2f-a0c0-6154000cd424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:43.860989 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:43.970642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82600b13-a0c6-4a2f-a0c0-6154000cd424 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:44.049222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f56117-c181-47e6-b519-3c9dfa6deb16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:44.049841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f56117-c181-47e6-b519-3c9dfa6deb16 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:44.050096 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f56117-c181-47e6-b519-3c9dfa6deb16 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:44.050374 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f56117-c181-47e6-b519-3c9dfa6deb16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:44.052017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a7f56117-c181-47e6-b519-3c9dfa6deb16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:44.122006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:44.174356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f56117-c181-47e6-b519-3c9dfa6deb16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:44.175825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f56117-c181-47e6-b519-3c9dfa6deb16 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:44.194791 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 659/1317] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:46.959460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e41147-1b18-4b0a-be53-ba590f3028e4 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:46.960020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e41147-1b18-4b0a-be53-ba590f3028e4 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:46.960020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e41147-1b18-4b0a-be53-ba590f3028e4 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:46.961338 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 659/1318] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:46.967212 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b253a74-1147-4a32-aa55-23ebe5ed67fd None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:46.967668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b253a74-1147-4a32-aa55-23ebe5ed67fd None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:46.967761 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b253a74-1147-4a32-aa55-23ebe5ed67fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:47.039477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-1b253a74-1147-4a32-aa55-23ebe5ed67fd None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:47.040740 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1b253a74-1147-4a32-aa55-23ebe5ed67fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:47.144547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 660/1319] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:47.446374 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432df6f-4b26-47f3-86ae-9b4ba6df20d6 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:47.446839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432df6f-4b26-47f3-86ae-9b4ba6df20d6 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:47.447243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432df6f-4b26-47f3-86ae-9b4ba6df20d6 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:47.449628 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 660/1320] 10.222.0.30 () {54 vars in 965 bytes} [Wed Sep 7 12:59:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:47.456906 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e257308-f9d1-44c0-b895-15fa0344e754 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:47.457233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e257308-f9d1-44c0-b895-15fa0344e754 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:47.457520 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e257308-f9d1-44c0-b895-15fa0344e754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:47.483908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:47.549322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-0e257308-f9d1-44c0-b895-15fa0344e754 None None] MFA Rules not processed for user `eefd1293a22848e3b595e54be0455d10`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:47.550559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0e257308-f9d1-44c0-b895-15fa0344e754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:47.633230 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 661/1321] 10.222.0.30 () {58 vars in 1062 bytes} [Wed Sep 7 12:59:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:47.643490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432df6f-4b26-47f3-86ae-9b4ba6df20d6 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:47.645212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f432df6f-4b26-47f3-86ae-9b4ba6df20d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:47.754230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432df6f-4b26-47f3-86ae-9b4ba6df20d6 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:47.832112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a53ec-44b7-4135-8d58-027a5531c46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:47.832867 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a53ec-44b7-4135-8d58-027a5531c46f service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:47.833156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a53ec-44b7-4135-8d58-027a5531c46f service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:47.833426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a53ec-44b7-4135-8d58-027a5531c46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:47.835224 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-cc5a53ec-44b7-4135-8d58-027a5531c46f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:47.843553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:47.956514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a53ec-44b7-4135-8d58-027a5531c46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:47.958001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a53ec-44b7-4135-8d58-027a5531c46f service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:47.982614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 661/1322] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:51.342324 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f085-e243-4b3a-b46e-e8cc6cb39581 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:51.342919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f085-e243-4b3a-b46e-e8cc6cb39581 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:51.342919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f085-e243-4b3a-b46e-e8cc6cb39581 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:51.344329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 662/1323] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:51.350708 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08f46-763b-40c9-af04-48179c38d1b7 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:51.351288 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08f46-763b-40c9-af04-48179c38d1b7 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:51.351288 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08f46-763b-40c9-af04-48179c38d1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:51.441233 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-40c08f46-763b-40c9-af04-48179c38d1b7 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:51.442562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-40c08f46-763b-40c9-af04-48179c38d1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:51.518024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:51.588415 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 662/1324] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:51.865365 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f085-e243-4b3a-b46e-e8cc6cb39581 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:51.866926 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-eb65f085-e243-4b3a-b46e-e8cc6cb39581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:51.982453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f085-e243-4b3a-b46e-e8cc6cb39581 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:51.995659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:52.059819 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061f609-a988-4dc2-a790-bcd9ae3b2b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:52.060437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061f609-a988-4dc2-a790-bcd9ae3b2b8f service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:52.060726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061f609-a988-4dc2-a790-bcd9ae3b2b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:52.060991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061f609-a988-4dc2-a790-bcd9ae3b2b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:52.062636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d061f609-a988-4dc2-a790-bcd9ae3b2b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:52.184063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061f609-a988-4dc2-a790-bcd9ae3b2b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:52.185512 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061f609-a988-4dc2-a790-bcd9ae3b2b8f service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:52.206133 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 663/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:54.463678 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e2e35-83c2-4e63-a6d7-5f1d68c74c3e None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:54.464267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e2e35-83c2-4e63-a6d7-5f1d68c74c3e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:54.464414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e2e35-83c2-4e63-a6d7-5f1d68c74c3e None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:54.466289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 663/1326] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:54.472659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacb4bf-a99e-44a7-b056-1590c5d1e86e None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:54.473494 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacb4bf-a99e-44a7-b056-1590c5d1e86e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:54.473494 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacb4bf-a99e-44a7-b056-1590c5d1e86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:54.533469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:54.552781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-feacb4bf-a99e-44a7-b056-1590c5d1e86e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:54.553919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-feacb4bf-a99e-44a7-b056-1590c5d1e86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:54.673382 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 664/1327] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:54.976080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e2e35-83c2-4e63-a6d7-5f1d68c74c3e None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:54.977694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-e10e2e35-83c2-4e63-a6d7-5f1d68c74c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:55.100885 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e2e35-83c2-4e63-a6d7-5f1d68c74c3e None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:55.185982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a5c89-b7ac-4a4c-b2a5-bdbc68adcbf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:55.186509 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a5c89-b7ac-4a4c-b2a5-bdbc68adcbf9 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:55.186788 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a5c89-b7ac-4a4c-b2a5-bdbc68adcbf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:55.187034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a5c89-b7ac-4a4c-b2a5-bdbc68adcbf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:55.188740 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fe1a5c89-b7ac-4a4c-b2a5-bdbc68adcbf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:55.207401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:55.305302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a5c89-b7ac-4a4c-b2a5-bdbc68adcbf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:55.306761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a5c89-b7ac-4a4c-b2a5-bdbc68adcbf9 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:55.326085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 664/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:57.595993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4909c6-a368-4a11-8069-217bfae611d3 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.596605 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4909c6-a368-4a11-8069-217bfae611d3 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.596746 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4909c6-a368-4a11-8069-217bfae611d3 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.598810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 665/1329] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 12:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:57.603773 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62fdb1-b6b0-46f6-8046-f567f33f0b59 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.604241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62fdb1-b6b0-46f6-8046-f567f33f0b59 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.604333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62fdb1-b6b0-46f6-8046-f567f33f0b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.678810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-0e62fdb1-b6b0-46f6-8046-f567f33f0b59 None None] MFA Rules not processed for user `0c72aeb6d2de4684b788eeaec1b07e38`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:57.680060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0e62fdb1-b6b0-46f6-8046-f567f33f0b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:57.751205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:57.786393 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 665/1330] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:58.076663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4909c6-a368-4a11-8069-217bfae611d3 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:58.078247 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ba4909c6-a368-4a11-8069-217bfae611d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:58.196110 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4909c6-a368-4a11-8069-217bfae611d3 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:58.218813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:58.281384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78317679-7934-4f46-8e5c-251788ced59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:58.282118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317679-7934-4f46-8e5c-251788ced59e service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:58.282431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317679-7934-4f46-8e5c-251788ced59e service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:58.282541 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317679-7934-4f46-8e5c-251788ced59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:58.284171 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-78317679-7934-4f46-8e5c-251788ced59e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:58.416529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78317679-7934-4f46-8e5c-251788ced59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:58.418549 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78317679-7934-4f46-8e5c-251788ced59e service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:58.439979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 666/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:00.882621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f47e7-a63c-46f8-977d-d886f5276b29 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:00.883409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f47e7-a63c-46f8-977d-d886f5276b29 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:00.883409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f47e7-a63c-46f8-977d-d886f5276b29 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:00.884669 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 666/1332] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:00.891135 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430cc7f-66ab-4b39-a178-aa5bb9c58acb None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:00.891624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430cc7f-66ab-4b39-a178-aa5bb9c58acb None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:00.896228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430cc7f-66ab-4b39-a178-aa5bb9c58acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:00.959108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:00.962158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-e430cc7f-66ab-4b39-a178-aa5bb9c58acb None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:00.963893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e430cc7f-66ab-4b39-a178-aa5bb9c58acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:01.067677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 667/1333] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:01.344473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f47e7-a63c-46f8-977d-d886f5276b29 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:01.346046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-9c9f47e7-a63c-46f8-977d-d886f5276b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:01.457876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f47e7-a63c-46f8-977d-d886f5276b29 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:01.537542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc185-2dc5-4d30-8376-511e45fcfe6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:01.538141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc185-2dc5-4d30-8376-511e45fcfe6c service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:01.538410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc185-2dc5-4d30-8376-511e45fcfe6c service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:01.538674 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc185-2dc5-4d30-8376-511e45fcfe6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:01.540276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-11ebc185-2dc5-4d30-8376-511e45fcfe6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:01.568966 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:01.655243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebc185-2dc5-4d30-8376-511e45fcfe6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:01.656652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebc185-2dc5-4d30-8376-511e45fcfe6c service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:01.679362 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 667/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:03.897996 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85356b5e-9905-4a08-9c49-0a46f04a112d None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:03.898641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85356b5e-9905-4a08-9c49-0a46f04a112d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:03.898641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85356b5e-9905-4a08-9c49-0a46f04a112d None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:03.899897 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 668/1335] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:03.906178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2e6cb-41f9-4e41-abd7-1c622374090d None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:03.906775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2e6cb-41f9-4e41-abd7-1c622374090d None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:03.906775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2e6cb-41f9-4e41-abd7-1c622374090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:03.979521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-68b2e6cb-41f9-4e41-abd7-1c622374090d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:03.981055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-68b2e6cb-41f9-4e41-abd7-1c622374090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:04.061303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:04.085030 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 668/1336] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:04.364680 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85356b5e-9905-4a08-9c49-0a46f04a112d None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:04.366259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-85356b5e-9905-4a08-9c49-0a46f04a112d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:04.482598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85356b5e-9905-4a08-9c49-0a46f04a112d None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:04.513233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:04.564100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f55b5-c35f-47c8-9232-6e3cb04833db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:04.564757 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f55b5-c35f-47c8-9232-6e3cb04833db service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:04.565037 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f55b5-c35f-47c8-9232-6e3cb04833db service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:04.565307 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f55b5-c35f-47c8-9232-6e3cb04833db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:04.566945 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-523f55b5-c35f-47c8-9232-6e3cb04833db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:04.689316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f55b5-c35f-47c8-9232-6e3cb04833db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:04.690724 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f55b5-c35f-47c8-9232-6e3cb04833db service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:04.709596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 669/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:07.258426 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d9cc0-4ef6-4528-8b25-a418bfe3365a None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:07.258986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d9cc0-4ef6-4528-8b25-a418bfe3365a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:07.258986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d9cc0-4ef6-4528-8b25-a418bfe3365a None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:07.260355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 669/1338] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:07.266844 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed49148-eb58-4ccb-9560-3a008cc54241 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:07.267431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed49148-eb58-4ccb-9560-3a008cc54241 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:07.267554 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed49148-eb58-4ccb-9560-3a008cc54241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:07.343835 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-fed49148-eb58-4ccb-9560-3a008cc54241 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:07.345127 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-fed49148-eb58-4ccb-9560-3a008cc54241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:07.355038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:07.467513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 670/1339] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:07.751088 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d9cc0-4ef6-4528-8b25-a418bfe3365a None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:07.752703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f50d9cc0-4ef6-4528-8b25-a418bfe3365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:07.863571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d9cc0-4ef6-4528-8b25-a418bfe3365a None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:07.941181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ef1c7-1f6c-4bad-aabe-6cdb299fa45c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:07.941798 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ef1c7-1f6c-4bad-aabe-6cdb299fa45c service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:07.942076 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ef1c7-1f6c-4bad-aabe-6cdb299fa45c service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:07.942348 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ef1c7-1f6c-4bad-aabe-6cdb299fa45c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:07.943982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a45ef1c7-1f6c-4bad-aabe-6cdb299fa45c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:07.988791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:08.069324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ef1c7-1f6c-4bad-aabe-6cdb299fa45c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:08.070734 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ef1c7-1f6c-4bad-aabe-6cdb299fa45c service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:08.090354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 670/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:12.394916 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415dc0-b56a-403f-a12d-cc6d8105fa7d None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:12.395488 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415dc0-b56a-403f-a12d-cc6d8105fa7d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:12.395488 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415dc0-b56a-403f-a12d-cc6d8105fa7d None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:12.397020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 671/1341] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:12.402455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c489894-b4b9-4d34-9aa7-354c72469c2d None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:12.402918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c489894-b4b9-4d34-9aa7-354c72469c2d None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:12.403011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c489894-b4b9-4d34-9aa7-354c72469c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:12.477477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-0c489894-b4b9-4d34-9aa7-354c72469c2d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:12.478669 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0c489894-b4b9-4d34-9aa7-354c72469c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:12.574519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:12.586858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 671/1342] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:00:12.876950 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13415dc0-b56a-403f-a12d-cc6d8105fa7d None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:12.878571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-13415dc0-b56a-403f-a12d-cc6d8105fa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:12.995726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13415dc0-b56a-403f-a12d-cc6d8105fa7d None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:13.036272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:13.076012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476aaac-c419-4623-84dd-0b98c65c193f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:13.076668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476aaac-c419-4623-84dd-0b98c65c193f service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:13.076948 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476aaac-c419-4623-84dd-0b98c65c193f service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:13.077217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476aaac-c419-4623-84dd-0b98c65c193f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:13.078878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8476aaac-c419-4623-84dd-0b98c65c193f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:13.203680 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476aaac-c419-4623-84dd-0b98c65c193f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:13.205114 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476aaac-c419-4623-84dd-0b98c65c193f service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:13.223953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 672/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:16.102784 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b439e6-c197-40a6-a285-d223fcff1dd5 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:16.103332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b439e6-c197-40a6-a285-d223fcff1dd5 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:16.103332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b439e6-c197-40a6-a285-d223fcff1dd5 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:16.104704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 672/1344] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:16.110122 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1822d-f41c-4a13-bec6-d46f62ed5877 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:16.110628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1822d-f41c-4a13-bec6-d46f62ed5877 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:16.110628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1822d-f41c-4a13-bec6-d46f62ed5877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:16.182338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-cfe1822d-f41c-4a13-bec6-d46f62ed5877 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:16.183685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-cfe1822d-f41c-4a13-bec6-d46f62ed5877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:16.203110 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:16.291850 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 673/1345] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:16.569272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b439e6-c197-40a6-a285-d223fcff1dd5 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:16.570884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-47b439e6-c197-40a6-a285-d223fcff1dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:16.690145 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b439e6-c197-40a6-a285-d223fcff1dd5 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:16.776355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728327b9-83d4-41df-9d46-3bfc87c0e1b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:16.777228 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728327b9-83d4-41df-9d46-3bfc87c0e1b9 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:16.777366 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728327b9-83d4-41df-9d46-3bfc87c0e1b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:16.777651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728327b9-83d4-41df-9d46-3bfc87c0e1b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:16.779397 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-728327b9-83d4-41df-9d46-3bfc87c0e1b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:16.830857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:16.908055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728327b9-83d4-41df-9d46-3bfc87c0e1b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:16.909582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728327b9-83d4-41df-9d46-3bfc87c0e1b9 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:16.934437 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 673/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:21.250080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bfe38-6c88-4a6e-882a-284e3cb9676c None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:21.250577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bfe38-6c88-4a6e-882a-284e3cb9676c None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:21.250577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bfe38-6c88-4a6e-882a-284e3cb9676c None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:21.251994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 674/1347] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:21.257969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe93fd6-7af3-452f-bb0a-f2c26cf78b66 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:21.258398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe93fd6-7af3-452f-bb0a-f2c26cf78b66 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:21.258674 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe93fd6-7af3-452f-bb0a-f2c26cf78b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:21.337610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-3fe93fd6-7af3-452f-bb0a-f2c26cf78b66 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:21.338933 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3fe93fd6-7af3-452f-bb0a-f2c26cf78b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:21.444716 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:21.448704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 674/1348] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:21.724804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bfe38-6c88-4a6e-882a-284e3cb9676c None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:21.726483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7c8bfe38-6c88-4a6e-882a-284e3cb9676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:21.837929 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bfe38-6c88-4a6e-882a-284e3cb9676c None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:21.890272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:21.923291 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b4674-a2f0-4ac1-b70a-cf63cd0b2d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:21.923904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b4674-a2f0-4ac1-b70a-cf63cd0b2d0d service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:21.924184 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b4674-a2f0-4ac1-b70a-cf63cd0b2d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:21.924489 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b4674-a2f0-4ac1-b70a-cf63cd0b2d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:21.926192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-bd8b4674-a2f0-4ac1-b70a-cf63cd0b2d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:22.046590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b4674-a2f0-4ac1-b70a-cf63cd0b2d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:22.048037 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b4674-a2f0-4ac1-b70a-cf63cd0b2d0d service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:22.066596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 675/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:27.263125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcc32f-dadc-4dab-a50b-419166fd2c6d None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:27.263974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcc32f-dadc-4dab-a50b-419166fd2c6d None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:27.263974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcc32f-dadc-4dab-a50b-419166fd2c6d None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:27.265620 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 675/1350] 10.222.0.30 () {54 vars in 921 bytes} [Wed Sep 7 13:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:27.272609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fc105-34ee-4ff9-8879-98c8def80f77 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:27.273077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fc105-34ee-4ff9-8879-98c8def80f77 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:27.273349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fc105-34ee-4ff9-8879-98c8def80f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:27.395632 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-e93fc105-34ee-4ff9-8879-98c8def80f77 None None] MFA Rules not processed for user `f2420def47ee4a5b8cf4373252583d75`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:27.397105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e93fc105-34ee-4ff9-8879-98c8def80f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:27.435139 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:27.546071 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 676/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Sep 7 13:00:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:31.821290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d145d-b61d-4148-9d0f-dd6e9b4a3158 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:31.822084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d145d-b61d-4148-9d0f-dd6e9b4a3158 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:31.822084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d145d-b61d-4148-9d0f-dd6e9b4a3158 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:31.823480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 676/1352] 10.222.0.30 () {54 vars in 921 bytes} [Wed Sep 7 13:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:31.828794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0b6a0-ba92-4863-a749-3175df811cfd None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:31.829730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0b6a0-ba92-4863-a749-3175df811cfd None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:31.830073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0b6a0-ba92-4863-a749-3175df811cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:31.937804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-39f0b6a0-ba92-4863-a749-3175df811cfd None None] MFA Rules not processed for user `f2420def47ee4a5b8cf4373252583d75`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:31.939246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-39f0b6a0-ba92-4863-a749-3175df811cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:32.029641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:32.102963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 677/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Sep 7 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:00:33.534733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b79333-2e6e-4e10-a769-56db0019aadb None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:33.535322 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b79333-2e6e-4e10-a769-56db0019aadb None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:33.535322 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b79333-2e6e-4e10-a769-56db0019aadb None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:33.536635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 677/1354] 10.222.0.30 () {54 vars in 921 bytes} [Wed Sep 7 13:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:33.542225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91255e2-142e-4715-b2f3-9b0e5284a2ab None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:33.542724 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91255e2-142e-4715-b2f3-9b0e5284a2ab None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:33.542828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91255e2-142e-4715-b2f3-9b0e5284a2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:33.639939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-c91255e2-142e-4715-b2f3-9b0e5284a2ab None None] MFA Rules not processed for user `f2420def47ee4a5b8cf4373252583d75`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:33.641411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c91255e2-142e-4715-b2f3-9b0e5284a2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:33.774323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 678/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Sep 7 13:00:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:37.549881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35342cf-02d5-449a-a027-61e544568d99 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:37.550902 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35342cf-02d5-449a-a027-61e544568d99 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:37.550902 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35342cf-02d5-449a-a027-61e544568d99 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:37.552070 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 678/1356] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:37.558488 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ec4d4-2455-4aa4-a8ea-ff49687f6874 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:37.559042 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ec4d4-2455-4aa4-a8ea-ff49687f6874 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:37.559042 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ec4d4-2455-4aa4-a8ea-ff49687f6874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:37.609637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:37.664222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-e84ec4d4-2455-4aa4-a8ea-ff49687f6874 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:37.666035 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e84ec4d4-2455-4aa4-a8ea-ff49687f6874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:37.780916 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 679/1357] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:38.106989 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780081c-c094-459a-b3e9-2ca3666a9a1d None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:38.107774 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780081c-c094-459a-b3e9-2ca3666a9a1d None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:38.108198 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780081c-c094-459a-b3e9-2ca3666a9a1d None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:38.110010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 679/1358] 10.222.0.30 () {54 vars in 962 bytes} [Wed Sep 7 13:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:38.119921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2e1a4-0064-4520-82bd-32f2f1c56d23 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:38.120567 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2e1a4-0064-4520-82bd-32f2f1c56d23 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:38.121072 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2e1a4-0064-4520-82bd-32f2f1c56d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:38.225197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-84b2e1a4-0064-4520-82bd-32f2f1c56d23 None None] MFA Rules not processed for user `fbe8fa8ab8094aa69933398280810692`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:38.226808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-84b2e1a4-0064-4520-82bd-32f2f1c56d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:38.299094 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:38.386117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 680/1359] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Sep 7 13:00:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:00:38.394597 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780081c-c094-459a-b3e9-2ca3666a9a1d None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:38.396199 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c780081c-c094-459a-b3e9-2ca3666a9a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:38.560421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780081c-c094-459a-b3e9-2ca3666a9a1d None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:38.658721 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:38.708967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05850d89-93c4-4735-8186-702374ad515d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:38.709590 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05850d89-93c4-4735-8186-702374ad515d service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:38.709865 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05850d89-93c4-4735-8186-702374ad515d service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:38.710135 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05850d89-93c4-4735-8186-702374ad515d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:38.711927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-05850d89-93c4-4735-8186-702374ad515d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:38.820032 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05850d89-93c4-4735-8186-702374ad515d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:38.821822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05850d89-93c4-4735-8186-702374ad515d service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:38.844516 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 680/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:00:41.311992 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44857-834c-42a0-8ac5-0c80893e4ac3 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:41.312606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44857-834c-42a0-8ac5-0c80893e4ac3 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:41.312848 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44857-834c-42a0-8ac5-0c80893e4ac3 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:41.314257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 681/1361] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:41.320132 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f09ba-4ef5-47d5-a6a5-f2c773251a98 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:41.321468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f09ba-4ef5-47d5-a6a5-f2c773251a98 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:41.321468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f09ba-4ef5-47d5-a6a5-f2c773251a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:41.400216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-b46f09ba-4ef5-47d5-a6a5-f2c773251a98 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:41.401517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b46f09ba-4ef5-47d5-a6a5-f2c773251a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:41.447988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:41.521207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 681/1362] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:41.827225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd44857-834c-42a0-8ac5-0c80893e4ac3 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:41.829234 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0cd44857-834c-42a0-8ac5-0c80893e4ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:42.038077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd44857-834c-42a0-8ac5-0c80893e4ac3 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:42.048437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:42.178274 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caade8-2790-40f3-85e4-bc77de5ea329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:42.178872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caade8-2790-40f3-85e4-bc77de5ea329 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:42.179147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caade8-2790-40f3-85e4-bc77de5ea329 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:42.179419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caade8-2790-40f3-85e4-bc77de5ea329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:42.181157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-63caade8-2790-40f3-85e4-bc77de5ea329 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:42.301073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caade8-2790-40f3-85e4-bc77de5ea329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:42.302701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caade8-2790-40f3-85e4-bc77de5ea329 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:42.325270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 682/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:00:44.895322 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff8918-5713-49cf-8e56-30a4ec586c94 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:44.895889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff8918-5713-49cf-8e56-30a4ec586c94 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:44.895889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff8918-5713-49cf-8e56-30a4ec586c94 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:44.897314 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 682/1364] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:44.903417 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ac3cb-90ba-46d5-8196-0db08a0daf37 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:44.904172 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ac3cb-90ba-46d5-8196-0db08a0daf37 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:44.904172 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ac3cb-90ba-46d5-8196-0db08a0daf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:44.921325 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:44.990808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-fe1ac3cb-90ba-46d5-8196-0db08a0daf37 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:44.992289 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-fe1ac3cb-90ba-46d5-8196-0db08a0daf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:45.106606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 683/1365] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:45.395477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ade8fe-a01b-405f-9775-50376d0ccf19 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:45.395826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ade8fe-a01b-405f-9775-50376d0ccf19 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:45.396032 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ade8fe-a01b-405f-9775-50376d0ccf19 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:45.397533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 683/1366] 10.222.0.30 () {54 vars in 962 bytes} [Wed Sep 7 13:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:45.403619 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee125e-bd71-478d-9421-42e57332333a None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:45.403979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee125e-bd71-478d-9421-42e57332333a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:45.404325 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee125e-bd71-478d-9421-42e57332333a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:45.491292 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-7bee125e-bd71-478d-9421-42e57332333a None None] MFA Rules not processed for user `fbe8fa8ab8094aa69933398280810692`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:45.492788 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7bee125e-bd71-478d-9421-42e57332333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:45.532134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:45.630157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 684/1367] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Sep 7 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:45.640190 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ade8fe-a01b-405f-9775-50376d0ccf19 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:45.642196 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a7ade8fe-a01b-405f-9775-50376d0ccf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:45.836445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ade8fe-a01b-405f-9775-50376d0ccf19 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:45.858551 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:45.914585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0643a-5c9b-46f5-ab79-1ec4b15e8055 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:45.915109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0643a-5c9b-46f5-ab79-1ec4b15e8055 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:45.915227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0643a-5c9b-46f5-ab79-1ec4b15e8055 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:45.916878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 685/1368] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:00:45.922174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f9c2-dc3f-4cca-9ed6-98973d73dc49 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:45.922443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f9c2-dc3f-4cca-9ed6-98973d73dc49 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:45.922718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f9c2-dc3f-4cca-9ed6-98973d73dc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:45.978903 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db911443-2321-49ab-9b12-2b0094701e28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:45.979538 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db911443-2321-49ab-9b12-2b0094701e28 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:45.979774 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db911443-2321-49ab-9b12-2b0094701e28 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:45.980026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db911443-2321-49ab-9b12-2b0094701e28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:45.981723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-db911443-2321-49ab-9b12-2b0094701e28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:46.000631 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-8bb0f9c2-dc3f-4cca-9ed6-98973d73dc49 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:46.001884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8bb0f9c2-dc3f-4cca-9ed6-98973d73dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:46.105072 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db911443-2321-49ab-9b12-2b0094701e28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:46.106861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db911443-2321-49ab-9b12-2b0094701e28 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:46.113092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:46.123936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 686/1369] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:00:46.128714 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 684/1370] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:00:46.420636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e5895-bb19-467c-84e6-a8395d7e3597 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:46.421092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e5895-bb19-467c-84e6-a8395d7e3597 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:46.421466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e5895-bb19-467c-84e6-a8395d7e3597 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:46.424152 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 687/1371] 10.222.0.30 () {54 vars in 964 bytes} [Wed Sep 7 13:00:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:46.430876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cad6a-28a8-4050-ae6c-3498efbf5900 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:46.431322 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cad6a-28a8-4050-ae6c-3498efbf5900 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:46.431699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cad6a-28a8-4050-ae6c-3498efbf5900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:46.465484 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:46.520703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-531cad6a-28a8-4050-ae6c-3498efbf5900 None None] MFA Rules not processed for user `4089419bb88e4aeda23bf141370cb6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:46.522321 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-531cad6a-28a8-4050-ae6c-3498efbf5900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:46.609189 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 685/1372] 10.222.0.30 () {58 vars in 1061 bytes} [Wed Sep 7 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:46.617075 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e5895-bb19-467c-84e6-a8395d7e3597 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:46.618917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-140e5895-bb19-467c-84e6-a8395d7e3597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:46.738008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e5895-bb19-467c-84e6-a8395d7e3597 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:46.820458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed68bf6-09db-497f-b668-e0729e956135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:46.821234 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed68bf6-09db-497f-b668-e0729e956135 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:46.821615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed68bf6-09db-497f-b668-e0729e956135 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:46.822004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed68bf6-09db-497f-b668-e0729e956135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:46.823793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-bed68bf6-09db-497f-b668-e0729e956135 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:46.886706 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:46.959417 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed68bf6-09db-497f-b668-e0729e956135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:46.961057 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed68bf6-09db-497f-b668-e0729e956135 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:46.983873 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 688/1373] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:48.441941 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42e8c5-9f27-4027-b53b-903a84eee1f8 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:48.442463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42e8c5-9f27-4027-b53b-903a84eee1f8 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:48.442463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42e8c5-9f27-4027-b53b-903a84eee1f8 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:48.444035 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 686/1374] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:48.449877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ccaf7-a0b0-4a78-9844-928c6bc118c2 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:48.450415 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ccaf7-a0b0-4a78-9844-928c6bc118c2 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:48.450415 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ccaf7-a0b0-4a78-9844-928c6bc118c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:48.523212 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-5d9ccaf7-a0b0-4a78-9844-928c6bc118c2 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:48.524514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5d9ccaf7-a0b0-4a78-9844-928c6bc118c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:48.646712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 689/1375] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:48.945115 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42e8c5-9f27-4027-b53b-903a84eee1f8 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:48.946673 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6a42e8c5-9f27-4027-b53b-903a84eee1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:49.081067 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:49.127067 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42e8c5-9f27-4027-b53b-903a84eee1f8 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:49.274057 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e72fa6-76db-4dff-843a-da828340f2e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:49.274677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e72fa6-76db-4dff-843a-da828340f2e2 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:49.274947 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e72fa6-76db-4dff-843a-da828340f2e2 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:49.275207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e72fa6-76db-4dff-843a-da828340f2e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:49.277031 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-61e72fa6-76db-4dff-843a-da828340f2e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:49.364896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:49.382312 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e72fa6-76db-4dff-843a-da828340f2e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:49.383972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e72fa6-76db-4dff-843a-da828340f2e2 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:49.409592 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 687/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:51.689322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78b3cb-6c05-4888-9ce8-1d4dff0edc50 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:51.689949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78b3cb-6c05-4888-9ce8-1d4dff0edc50 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:51.689949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78b3cb-6c05-4888-9ce8-1d4dff0edc50 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:51.691375 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 690/1377] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:51.696952 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce2f80-3d78-461a-9cb3-972bd8574bb3 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:51.697420 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce2f80-3d78-461a-9cb3-972bd8574bb3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:51.697504 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce2f80-3d78-461a-9cb3-972bd8574bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:51.771143 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-14ce2f80-3d78-461a-9cb3-972bd8574bb3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:51.772740 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-14ce2f80-3d78-461a-9cb3-972bd8574bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:51.885277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 688/1378] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:52.171291 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78b3cb-6c05-4888-9ce8-1d4dff0edc50 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:52.172862 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8a78b3cb-6c05-4888-9ce8-1d4dff0edc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:52.175814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:52.342706 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78b3cb-6c05-4888-9ce8-1d4dff0edc50 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:52.435147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:52.482846 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1c638-937a-45ff-b431-5cbc1a497f12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:52.483540 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1c638-937a-45ff-b431-5cbc1a497f12 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:52.483745 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1c638-937a-45ff-b431-5cbc1a497f12 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:52.484024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1c638-937a-45ff-b431-5cbc1a497f12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:52.485691 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-52c1c638-937a-45ff-b431-5cbc1a497f12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:52.585369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1c638-937a-45ff-b431-5cbc1a497f12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:52.587175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1c638-937a-45ff-b431-5cbc1a497f12 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:52.608346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 691/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:54.957853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80b9d3-befc-41fd-80f8-6ae0f444a1a1 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:54.958418 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80b9d3-befc-41fd-80f8-6ae0f444a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:54.958418 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80b9d3-befc-41fd-80f8-6ae0f444a1a1 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:54.959774 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 689/1380] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:54.965735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99598fec-a40f-40f8-a768-d59526b78546 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:54.966287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99598fec-a40f-40f8-a768-d59526b78546 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:54.966287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99598fec-a40f-40f8-a768-d59526b78546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:55.045779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-99598fec-a40f-40f8-a768-d59526b78546 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:55.047088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-99598fec-a40f-40f8-a768-d59526b78546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:55.091275 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:55.165041 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 692/1381] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:55.477722 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80b9d3-befc-41fd-80f8-6ae0f444a1a1 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:55.479402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6b80b9d3-befc-41fd-80f8-6ae0f444a1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:55.550864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:55.653837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80b9d3-befc-41fd-80f8-6ae0f444a1a1 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:55.809282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6da27-6aed-4cfa-8132-9727b56405e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:55.810651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6da27-6aed-4cfa-8132-9727b56405e1 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:55.811014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6da27-6aed-4cfa-8132-9727b56405e1 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:55.811730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6da27-6aed-4cfa-8132-9727b56405e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:55.813952 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-dbb6da27-6aed-4cfa-8132-9727b56405e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:55.838222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:55.938416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6da27-6aed-4cfa-8132-9727b56405e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:55.941598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6da27-6aed-4cfa-8132-9727b56405e1 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:55.965893 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 690/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:00:58.248078 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a2c0c-5cfe-4447-aefc-30b8e7a066c9 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:58.248684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a2c0c-5cfe-4447-aefc-30b8e7a066c9 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:58.248929 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a2c0c-5cfe-4447-aefc-30b8e7a066c9 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:58.250418 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 693/1383] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:58.258977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b292a-1583-45f6-80a3-4fc69aa1745d None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:58.259767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b292a-1583-45f6-80a3-4fc69aa1745d None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:58.259767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b292a-1583-45f6-80a3-4fc69aa1745d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:58.338267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-4c3b292a-1583-45f6-80a3-4fc69aa1745d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:58.339456 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4c3b292a-1583-45f6-80a3-4fc69aa1745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:58.464570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:58.474711 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 691/1384] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:58.831281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a2c0c-5cfe-4447-aefc-30b8e7a066c9 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:58.832973 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-dd1a2c0c-5cfe-4447-aefc-30b8e7a066c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:59.043834 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a2c0c-5cfe-4447-aefc-30b8e7a066c9 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:59.066877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:59.183166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ca19a-feb2-419c-aea7-a8d02b908eb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:59.183896 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ca19a-feb2-419c-aea7-a8d02b908eb6 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:59.184584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ca19a-feb2-419c-aea7-a8d02b908eb6 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:59.184879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ca19a-feb2-419c-aea7-a8d02b908eb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:59.187236 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-154ca19a-feb2-419c-aea7-a8d02b908eb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:59.297399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ca19a-feb2-419c-aea7-a8d02b908eb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:59.299060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ca19a-feb2-419c-aea7-a8d02b908eb6 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:59.319336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 694/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:01.548339 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd867a1b-9e84-436f-a18c-c6e0877245af None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:01.548921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd867a1b-9e84-436f-a18c-c6e0877245af None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:01.548921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd867a1b-9e84-436f-a18c-c6e0877245af None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:01.550240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 692/1386] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:01.555974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757de85c-f4d1-4ab3-8fd1-8de76653bbf3 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:01.556532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757de85c-f4d1-4ab3-8fd1-8de76653bbf3 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:01.556532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757de85c-f4d1-4ab3-8fd1-8de76653bbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:01.593834 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:01.628366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-757de85c-f4d1-4ab3-8fd1-8de76653bbf3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:01.629610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-757de85c-f4d1-4ab3-8fd1-8de76653bbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:01.736593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 695/1387] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:01:02.028290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd867a1b-9e84-436f-a18c-c6e0877245af None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:02.029912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-cd867a1b-9e84-436f-a18c-c6e0877245af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:02.196909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd867a1b-9e84-436f-a18c-c6e0877245af None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:02.270311 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:02.321015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadaf0c-2fda-4284-95c1-f5c913db1341 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:02.321633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadaf0c-2fda-4284-95c1-f5c913db1341 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:02.321905 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadaf0c-2fda-4284-95c1-f5c913db1341 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:02.322186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadaf0c-2fda-4284-95c1-f5c913db1341 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:02.323812 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ccadaf0c-2fda-4284-95c1-f5c913db1341 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:02.425068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadaf0c-2fda-4284-95c1-f5c913db1341 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:02.426685 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadaf0c-2fda-4284-95c1-f5c913db1341 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:02.445580 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 693/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:02.678994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74736a-d0c0-477e-9acf-598e4b3ec162 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:02.679597 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74736a-d0c0-477e-9acf-598e4b3ec162 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:02.679597 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74736a-d0c0-477e-9acf-598e4b3ec162 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:02.680997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 696/1389] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:02.687830 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d14fb-63ed-405f-9256-84d283d46a81 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:02.688366 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d14fb-63ed-405f-9256-84d283d46a81 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:02.688494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d14fb-63ed-405f-9256-84d283d46a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:02.762637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-a90d14fb-63ed-405f-9256-84d283d46a81 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:02.763873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a90d14fb-63ed-405f-9256-84d283d46a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:02.800073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:02.871760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 694/1390] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:03.197121 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795e7c1-15e7-4413-ad97-73a92a2ba6ea None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:03.197396 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795e7c1-15e7-4413-ad97-73a92a2ba6ea None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:03.197671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795e7c1-15e7-4413-ad97-73a92a2ba6ea None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:03.199203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 697/1391] 10.222.0.30 () {54 vars in 961 bytes} [Wed Sep 7 13:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:01:03.205034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79000cf-b8e7-4b8f-b8d2-1609bd84952b None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:03.205323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79000cf-b8e7-4b8f-b8d2-1609bd84952b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:03.205590 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79000cf-b8e7-4b8f-b8d2-1609bd84952b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:03.310421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-e79000cf-b8e7-4b8f-b8d2-1609bd84952b None None] MFA Rules not processed for user `f332ac2346f0444a8d336ed2b3121be2`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:03.311546 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-e79000cf-b8e7-4b8f-b8d2-1609bd84952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:03.404003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 695/1392] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Sep 7 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:03.414243 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795e7c1-15e7-4413-ad97-73a92a2ba6ea None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:03.415903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a795e7c1-15e7-4413-ad97-73a92a2ba6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:03.538279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795e7c1-15e7-4413-ad97-73a92a2ba6ea None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:03.546077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:03.618118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de7a85-31cb-4a5b-ba31-47a424632beb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f332ac2346f0444a8d336ed2b3121be2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:03.618663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de7a85-31cb-4a5b-ba31-47a424632beb service glance] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:03.618940 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de7a85-31cb-4a5b-ba31-47a424632beb service glance] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:03.619212 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de7a85-31cb-4a5b-ba31-47a424632beb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:03.620886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c8de7a85-31cb-4a5b-ba31-47a424632beb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:03.755132 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de7a85-31cb-4a5b-ba31-47a424632beb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:03.756707 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de7a85-31cb-4a5b-ba31-47a424632beb service glance] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:03.777098 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 698/1393] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:04.550405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829f452-aa89-4422-9b5c-1ac611437a4f None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:04.550953 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829f452-aa89-4422-9b5c-1ac611437a4f None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:04.551064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829f452-aa89-4422-9b5c-1ac611437a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:04.590661 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:04.631864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-e829f452-aa89-4422-9b5c-1ac611437a4f None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:04.633114 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-e829f452-aa89-4422-9b5c-1ac611437a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:04.724610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da914336-65af-40ff-8209-77cea4ee8799 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:04.725021 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da914336-65af-40ff-8209-77cea4ee8799 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:04.725991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da914336-65af-40ff-8209-77cea4ee8799 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:04.727193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 699/1394] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:01:04.729278 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 696/1395] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Sep 7 13:01:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:04.732537 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96639e93-9607-46a1-80b0-659b0b2b56ae None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:04.732810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96639e93-9607-46a1-80b0-659b0b2b56ae None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:04.733083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96639e93-9607-46a1-80b0-659b0b2b56ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:04.776887 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe845f3-56ae-4b96-9bd9-3355b8ff7ab8 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:04.777118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe845f3-56ae-4b96-9bd9-3355b8ff7ab8 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:04.777354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe845f3-56ae-4b96-9bd9-3355b8ff7ab8 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:04.778785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 697/1396] 10.222.0.30 () {54 vars in 943 bytes} [Wed Sep 7 13:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:04.785373 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4f478-9ac2-4947-b958-b64cbd8ad6ef None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:04.785562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:04.785985 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4f478-9ac2-4947-b958-b64cbd8ad6ef None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:04.785985 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4f478-9ac2-4947-b958-b64cbd8ad6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:04.810907 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-96639e93-9607-46a1-80b0-659b0b2b56ae None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:04.812065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-96639e93-9607-46a1-80b0-659b0b2b56ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:04.875356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-fdc4f478-9ac2-4947-b958-b64cbd8ad6ef None None] MFA Rules not processed for user `f3796ca94b914fd18946551fa2bff331`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:04.876650 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fdc4f478-9ac2-4947-b958-b64cbd8ad6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:04.919032 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 700/1397] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:04.939423 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:04.995880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 698/1398] 10.222.0.30 () {58 vars in 1040 bytes} [Wed Sep 7 13:01:04 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:01:05.005404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96639e93-9607-46a1-80b0-659b0b2b56ae None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:05.007188 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-96639e93-9607-46a1-80b0-659b0b2b56ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:05.120197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96639e93-9607-46a1-80b0-659b0b2b56ae None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:05.139517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:05.213306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4f478-9ac2-4947-b958-b64cbd8ad6ef None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:05.214517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fdc4f478-9ac2-4947-b958-b64cbd8ad6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:05.238153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdcc65-6d9c-4d1b-8d1b-5958f8452297 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:05.238780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdcc65-6d9c-4d1b-8d1b-5958f8452297 service swift] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:05.239206 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdcc65-6d9c-4d1b-8d1b-5958f8452297 service swift] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:05.239489 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdcc65-6d9c-4d1b-8d1b-5958f8452297 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:05.241273 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d7cdcc65-6d9c-4d1b-8d1b-5958f8452297 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:05.323425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4f478-9ac2-4947-b958-b64cbd8ad6ef None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:05.337044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdcc65-6d9c-4d1b-8d1b-5958f8452297 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:05.338662 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdcc65-6d9c-4d1b-8d1b-5958f8452297 service swift] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:05.347043 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 701/1399] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:01:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:01:05.409493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:05.461816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaef476-02cc-48a9-aee8-fa8b1aa8cf2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:05.462682 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaef476-02cc-48a9-aee8-fa8b1aa8cf2d service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:05.463190 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaef476-02cc-48a9-aee8-fa8b1aa8cf2d service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:05.463592 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaef476-02cc-48a9-aee8-fa8b1aa8cf2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:05.465694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-aeaef476-02cc-48a9-aee8-fa8b1aa8cf2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:05.579885 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaef476-02cc-48a9-aee8-fa8b1aa8cf2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:05.581550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaef476-02cc-48a9-aee8-fa8b1aa8cf2d service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:05.602394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 699/1400] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:01:07.883651 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f6444-c54d-4a8f-adb4-7c388abc631e None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:07.884222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f6444-c54d-4a8f-adb4-7c388abc631e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:07.884222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f6444-c54d-4a8f-adb4-7c388abc631e None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:07.885598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 702/1401] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:07.895253 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f9892-4b5b-48b6-8569-2a09f8fcaf9b None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:07.895253 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f9892-4b5b-48b6-8569-2a09f8fcaf9b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:07.895253 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f9892-4b5b-48b6-8569-2a09f8fcaf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:07.980273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-5e1f9892-4b5b-48b6-8569-2a09f8fcaf9b None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:07.981378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5e1f9892-4b5b-48b6-8569-2a09f8fcaf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:08.039247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:08.113309 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 700/1402] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:08.408279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f6444-c54d-4a8f-adb4-7c388abc631e None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:08.410213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e17f6444-c54d-4a8f-adb4-7c388abc631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:08.469484 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:08.591278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f6444-c54d-4a8f-adb4-7c388abc631e None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:08.750718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43352de8-eca5-4912-b2de-f608c6f4dc92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:08.751524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352de8-eca5-4912-b2de-f608c6f4dc92 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:08.751695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352de8-eca5-4912-b2de-f608c6f4dc92 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:08.751969 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352de8-eca5-4912-b2de-f608c6f4dc92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:08.753738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-43352de8-eca5-4912-b2de-f608c6f4dc92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:08.768622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:08.889022 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43352de8-eca5-4912-b2de-f608c6f4dc92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:08.890647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43352de8-eca5-4912-b2de-f608c6f4dc92 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:08.920416 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 703/1403] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:11.211023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa3dab-74aa-494a-abd6-0ea18f9d07e2 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:11.211579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa3dab-74aa-494a-abd6-0ea18f9d07e2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:11.211579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa3dab-74aa-494a-abd6-0ea18f9d07e2 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:11.216928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 701/1404] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:01:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:11.218856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18ea40-7e17-4d2e-b2f4-4ad5c849e94d None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:11.219331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18ea40-7e17-4d2e-b2f4-4ad5c849e94d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:11.219419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18ea40-7e17-4d2e-b2f4-4ad5c849e94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:11.300119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-ee18ea40-7e17-4d2e-b2f4-4ad5c849e94d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:11.301436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ee18ea40-7e17-4d2e-b2f4-4ad5c849e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:11.402360 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:11.425812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 704/1405] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:11.727405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa3dab-74aa-494a-abd6-0ea18f9d07e2 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:11.729042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f7fa3dab-74aa-494a-abd6-0ea18f9d07e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:11.911410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa3dab-74aa-494a-abd6-0ea18f9d07e2 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:11.943713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:12.055189 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c785e-718c-4a86-b39f-86f000f60a5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:12.055880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c785e-718c-4a86-b39f-86f000f60a5c service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:12.056171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c785e-718c-4a86-b39f-86f000f60a5c service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:12.056473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c785e-718c-4a86-b39f-86f000f60a5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:12.058239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ff7c785e-718c-4a86-b39f-86f000f60a5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:12.171802 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c785e-718c-4a86-b39f-86f000f60a5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:12.173412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c785e-718c-4a86-b39f-86f000f60a5c service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:12.193313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 702/1406] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:14.464741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b22ac-19d6-47c6-98e7-4a06746e8c7c None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:14.465310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b22ac-19d6-47c6-98e7-4a06746e8c7c None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:14.465310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b22ac-19d6-47c6-98e7-4a06746e8c7c None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:14.466571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 705/1407] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:14.472428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685419f-7d8a-4c06-848a-466fbbd1f2df None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:14.472981 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685419f-7d8a-4c06-848a-466fbbd1f2df None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:14.472981 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685419f-7d8a-4c06-848a-466fbbd1f2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:14.508558 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:14.558432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-a685419f-7d8a-4c06-848a-466fbbd1f2df None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:14.560093 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a685419f-7d8a-4c06-848a-466fbbd1f2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:14.709333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 703/1408] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:15.006065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b22ac-19d6-47c6-98e7-4a06746e8c7c None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:15.007672 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-4a3b22ac-19d6-47c6-98e7-4a06746e8c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:15.248781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b22ac-19d6-47c6-98e7-4a06746e8c7c None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:15.350879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:15.443619 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778c75d-6dd4-4074-af3f-911d03f9dfbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:15.444223 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778c75d-6dd4-4074-af3f-911d03f9dfbc service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:15.444591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778c75d-6dd4-4074-af3f-911d03f9dfbc service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:15.444872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778c75d-6dd4-4074-af3f-911d03f9dfbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:15.446565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8778c75d-6dd4-4074-af3f-911d03f9dfbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:15.631159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778c75d-6dd4-4074-af3f-911d03f9dfbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:15.634105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778c75d-6dd4-4074-af3f-911d03f9dfbc service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:15.675918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 706/1409] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:24.705055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=54 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:25.672584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=68 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:28.192633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21814071-14e1-4828-8377-ea60db4d10c6 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:28.192633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21814071-14e1-4828-8377-ea60db4d10c6 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:28.193290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21814071-14e1-4828-8377-ea60db4d10c6 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:28.194081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 704/1410] 10.222.0.30 () {54 vars in 918 bytes} [Wed Sep 7 13:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:28.199676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b3925-f6ef-43e4-8fd1-adc9ca162166 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:28.200243 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b3925-f6ef-43e4-8fd1-adc9ca162166 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:28.200243 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b3925-f6ef-43e4-8fd1-adc9ca162166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:28.287746 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-dc9b3925-f6ef-43e4-8fd1-adc9ca162166 None None] MFA Rules not processed for user `f2420def47ee4a5b8cf4373252583d75`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:28.289004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-dc9b3925-f6ef-43e4-8fd1-adc9ca162166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:28.408524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 707/1411] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Sep 7 13:01:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:28.424162 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312f651-5297-4498-a3d8-dca792fece1a None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:28.424471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312f651-5297-4498-a3d8-dca792fece1a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:28.424740 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312f651-5297-4498-a3d8-dca792fece1a None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:28.426179 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 705/1412] 10.222.0.30 () {54 vars in 918 bytes} [Wed Sep 7 13:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:28.431427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c696369-61c3-4b8a-909d-218df58aedd0 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:28.431864 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c696369-61c3-4b8a-909d-218df58aedd0 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:28.431989 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c696369-61c3-4b8a-909d-218df58aedd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:28.511476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:28.516854 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-0c696369-61c3-4b8a-909d-218df58aedd0 None None] MFA Rules not processed for user `fbe8fa8ab8094aa69933398280810692`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:28.518746 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0c696369-61c3-4b8a-909d-218df58aedd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:28.647493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 708/1413] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Sep 7 13:01:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:31.250096 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d1641-2921-4913-a9e4-ebb4165d3923 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:31.250679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d1641-2921-4913-a9e4-ebb4165d3923 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:31.250679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d1641-2921-4913-a9e4-ebb4165d3923 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:31.251997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:31.257524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b474e5-f1a9-40b7-9c0b-53db146c3454 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:31.257971 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b474e5-f1a9-40b7-9c0b-53db146c3454 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:31.258108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b474e5-f1a9-40b7-9c0b-53db146c3454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:31.339633 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-b7b474e5-f1a9-40b7-9c0b-53db146c3454 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:31.340920 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b7b474e5-f1a9-40b7-9c0b-53db146c3454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:31.400291 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:31.443905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:31.729457 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d1641-2921-4913-a9e4-ebb4165d3923 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:31.731376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-732d1641-2921-4913-a9e4-ebb4165d3923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:31.889413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d1641-2921-4913-a9e4-ebb4165d3923 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:31.969471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:32.017630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f4c42-fad8-4985-9b1f-8c2404ddd355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:32.018221 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f4c42-fad8-4985-9b1f-8c2404ddd355 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:32.018522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f4c42-fad8-4985-9b1f-8c2404ddd355 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:32.018785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f4c42-fad8-4985-9b1f-8c2404ddd355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:32.020775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7d8f4c42-fad8-4985-9b1f-8c2404ddd355 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:32.119659 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f4c42-fad8-4985-9b1f-8c2404ddd355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:32.121389 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f4c42-fad8-4985-9b1f-8c2404ddd355 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:32.142026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 707/1416] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:33.295942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b649ad-4a32-480e-9a98-44a0057afd39 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:33.296558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b649ad-4a32-480e-9a98-44a0057afd39 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:33.296558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b649ad-4a32-480e-9a98-44a0057afd39 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:33.297976 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:33.305221 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc458eb3-dad6-492f-88c2-a926faf22cd9 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:33.305758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc458eb3-dad6-492f-88c2-a926faf22cd9 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:33.305758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc458eb3-dad6-492f-88c2-a926faf22cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:33.390146 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-fc458eb3-dad6-492f-88c2-a926faf22cd9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:33.391388 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fc458eb3-dad6-492f-88c2-a926faf22cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:33.422839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:33.501045 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:33.653944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b649ad-4a32-480e-9a98-44a0057afd39 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:33.655428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-13b649ad-4a32-480e-9a98-44a0057afd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:33.820223 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b649ad-4a32-480e-9a98-44a0057afd39 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:33.866378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:33.950876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62db044-e640-49c5-bd12-e09cd6dbf4df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:33.951399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62db044-e640-49c5-bd12-e09cd6dbf4df service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:33.951682 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62db044-e640-49c5-bd12-e09cd6dbf4df service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:33.951953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62db044-e640-49c5-bd12-e09cd6dbf4df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:33.953675 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d62db044-e640-49c5-bd12-e09cd6dbf4df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:34.056296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62db044-e640-49c5-bd12-e09cd6dbf4df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:34.057993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62db044-e640-49c5-bd12-e09cd6dbf4df service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:34.078509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 711/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:35.315804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a28c6-69a0-4c8b-b37c-daedf1f9b53a None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:35.316858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a28c6-69a0-4c8b-b37c-daedf1f9b53a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:35.316858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a28c6-69a0-4c8b-b37c-daedf1f9b53a None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:35.318814 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:35.326878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16986-2ec8-41d2-8c13-313ebb38fed4 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:35.327385 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16986-2ec8-41d2-8c13-313ebb38fed4 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:35.327385 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16986-2ec8-41d2-8c13-313ebb38fed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:35.405265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:35.435109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-03c16986-2ec8-41d2-8c13-313ebb38fed4 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:35.436400 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-03c16986-2ec8-41d2-8c13-313ebb38fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:35.564462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:35.739486 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a28c6-69a0-4c8b-b37c-daedf1f9b53a None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:35.741345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-8f9a28c6-69a0-4c8b-b37c-daedf1f9b53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:36.046919 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a28c6-69a0-4c8b-b37c-daedf1f9b53a None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:36.060152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:36.170155 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b93d3-62b5-4d76-9cff-c5a5907d6fc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:36.170684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b93d3-62b5-4d76-9cff-c5a5907d6fc8 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:36.170964 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b93d3-62b5-4d76-9cff-c5a5907d6fc8 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:36.171231 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b93d3-62b5-4d76-9cff-c5a5907d6fc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:36.172930 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-351b93d3-62b5-4d76-9cff-c5a5907d6fc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:36.283064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b93d3-62b5-4d76-9cff-c5a5907d6fc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:36.284886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b93d3-62b5-4d76-9cff-c5a5907d6fc8 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:36.306540 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 710/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:37.465677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ecf83-e955-4630-8224-76e0d9bdf46e None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:37.466278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ecf83-e955-4630-8224-76e0d9bdf46e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:37.466278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ecf83-e955-4630-8224-76e0d9bdf46e None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:37.467614 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:37.474696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914192d8-935d-4b2b-bbf4-8e0992ed872d None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:37.475244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914192d8-935d-4b2b-bbf4-8e0992ed872d None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:37.475244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914192d8-935d-4b2b-bbf4-8e0992ed872d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:37.496187 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:37.561441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-914192d8-935d-4b2b-bbf4-8e0992ed872d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:37.562691 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-914192d8-935d-4b2b-bbf4-8e0992ed872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:37.676110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:37.832664 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ecf83-e955-4630-8224-76e0d9bdf46e None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:37.834158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e71ecf83-e955-4630-8224-76e0d9bdf46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:37.957670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:38.004942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ecf83-e955-4630-8224-76e0d9bdf46e None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:38.139431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f188088-20f6-438c-8d28-033027a57d44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:38.139961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f188088-20f6-438c-8d28-033027a57d44 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:38.140463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f188088-20f6-438c-8d28-033027a57d44 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:38.140736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f188088-20f6-438c-8d28-033027a57d44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:38.142453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5f188088-20f6-438c-8d28-033027a57d44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:38.227000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:38.244063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f188088-20f6-438c-8d28-033027a57d44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:38.245793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f188088-20f6-438c-8d28-033027a57d44 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:38.266762 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 714/1425] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:39.405826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f2a0-37a2-4506-a79b-6c907f42434e None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:39.406454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f2a0-37a2-4506-a79b-6c907f42434e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:39.406454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f2a0-37a2-4506-a79b-6c907f42434e None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:39.407715 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:39.414814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f7208-bf44-4ff5-86f1-7bd372a2ff5c None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:39.415398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f7208-bf44-4ff5-86f1-7bd372a2ff5c None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:39.415398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f7208-bf44-4ff5-86f1-7bd372a2ff5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:39.500340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-311f7208-bf44-4ff5-86f1-7bd372a2ff5c None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:39.501618 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-311f7208-bf44-4ff5-86f1-7bd372a2ff5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:39.608806 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:39.760168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01f2a0-37a2-4506-a79b-6c907f42434e None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:39.761674 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fa01f2a0-37a2-4506-a79b-6c907f42434e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:39.858216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:39.934273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01f2a0-37a2-4506-a79b-6c907f42434e None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:40.061576 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45038abd-5987-4be7-930f-bcccd15a1287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:40.062104 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45038abd-5987-4be7-930f-bcccd15a1287 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:40.062463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45038abd-5987-4be7-930f-bcccd15a1287 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:40.062855 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45038abd-5987-4be7-930f-bcccd15a1287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:40.065372 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-45038abd-5987-4be7-930f-bcccd15a1287 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:40.117257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:40.161644 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45038abd-5987-4be7-930f-bcccd15a1287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:40.163264 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45038abd-5987-4be7-930f-bcccd15a1287 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:40.182960 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 713/1428] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:01:41.255582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ec507-3597-48c1-a69b-0a8d6e463020 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:41.256215 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ec507-3597-48c1-a69b-0a8d6e463020 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:41.256215 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ec507-3597-48c1-a69b-0a8d6e463020 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:41.257562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:41.264887 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a8eaa-0a35-40da-9090-a0586993a6bb None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:41.265392 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a8eaa-0a35-40da-9090-a0586993a6bb None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:41.265532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a8eaa-0a35-40da-9090-a0586993a6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:41.349544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-933a8eaa-0a35-40da-9090-a0586993a6bb None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:41.350792 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-933a8eaa-0a35-40da-9090-a0586993a6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:41.450455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:41.600863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ec507-3597-48c1-a69b-0a8d6e463020 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:41.602523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7a3ec507-3597-48c1-a69b-0a8d6e463020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:41.655704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:41.765177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ec507-3597-48c1-a69b-0a8d6e463020 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:41.890384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a77972-9f28-4e4d-b283-1a8622e3b50d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:41.891144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77972-9f28-4e4d-b283-1a8622e3b50d service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:41.891474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77972-9f28-4e4d-b283-1a8622e3b50d service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:41.891865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77972-9f28-4e4d-b283-1a8622e3b50d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:41.894029 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b0a77972-9f28-4e4d-b283-1a8622e3b50d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:41.905656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:42.006583 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a77972-9f28-4e4d-b283-1a8622e3b50d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:42.008296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a77972-9f28-4e4d-b283-1a8622e3b50d service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:42.028333 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 717/1431] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:43.159672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b387d-d171-4e12-ac96-90a5900e926a None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:43.160216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b387d-d171-4e12-ac96-90a5900e926a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:43.160216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b387d-d171-4e12-ac96-90a5900e926a None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:43.161722 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:43.169219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea09d6-4f56-4722-9411-effc7e6a03eb None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:43.170056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea09d6-4f56-4722-9411-effc7e6a03eb None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:43.170229 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea09d6-4f56-4722-9411-effc7e6a03eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:43.251240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-41ea09d6-4f56-4722-9411-effc7e6a03eb None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:43.252531 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-41ea09d6-4f56-4722-9411-effc7e6a03eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:43.326819 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:43.358326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:01:43.511952 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b387d-d171-4e12-ac96-90a5900e926a None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:43.513562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-bd0b387d-d171-4e12-ac96-90a5900e926a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:43.532330 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:43.672492 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b387d-d171-4e12-ac96-90a5900e926a None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:43.771400 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:43.798584 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79990ad-65ec-4316-8217-dd78810116c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:43.799202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79990ad-65ec-4316-8217-dd78810116c9 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:43.799476 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79990ad-65ec-4316-8217-dd78810116c9 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:43.799744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79990ad-65ec-4316-8217-dd78810116c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:43.801938 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d79990ad-65ec-4316-8217-dd78810116c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:43.900335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79990ad-65ec-4316-8217-dd78810116c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:43.902128 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79990ad-65ec-4316-8217-dd78810116c9 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:43.921759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 716/1434] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:45.039793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea52738-fa37-4a96-8ff5-8e9a093ca909 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:45.040417 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea52738-fa37-4a96-8ff5-8e9a093ca909 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:45.040417 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea52738-fa37-4a96-8ff5-8e9a093ca909 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:45.042020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:45.049093 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb794e-c73b-49f4-8d4a-61ab54728cda None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:45.049615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb794e-c73b-49f4-8d4a-61ab54728cda None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:45.049615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb794e-c73b-49f4-8d4a-61ab54728cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:45.134682 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-49bb794e-c73b-49f4-8d4a-61ab54728cda None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:45.135878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-49bb794e-c73b-49f4-8d4a-61ab54728cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:45.180884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:45.247473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:45.397997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea52738-fa37-4a96-8ff5-8e9a093ca909 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:45.399520 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5ea52738-fa37-4a96-8ff5-8e9a093ca909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:45.557744 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea52738-fa37-4a96-8ff5-8e9a093ca909 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:45.616326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:45.682933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1990ab4-e324-453d-b9b3-c17bf635730f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:45.683450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990ab4-e324-453d-b9b3-c17bf635730f service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:45.683728 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990ab4-e324-453d-b9b3-c17bf635730f service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:45.683965 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990ab4-e324-453d-b9b3-c17bf635730f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:45.685770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d1990ab4-e324-453d-b9b3-c17bf635730f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:45.786653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1990ab4-e324-453d-b9b3-c17bf635730f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:45.788313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1990ab4-e324-453d-b9b3-c17bf635730f service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:45.807154 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 720/1437] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:46.893736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5b0e8-2d0c-4fd3-be07-1193fe0a1e59 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:46.894451 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5b0e8-2d0c-4fd3-be07-1193fe0a1e59 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:46.894451 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5b0e8-2d0c-4fd3-be07-1193fe0a1e59 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:46.895662 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:46.902402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809269af-c20b-4e8f-8f36-4d208d63cf8e None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:46.902927 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809269af-c20b-4e8f-8f36-4d208d63cf8e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:46.902927 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809269af-c20b-4e8f-8f36-4d208d63cf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:46.989422 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-809269af-c20b-4e8f-8f36-4d208d63cf8e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:46.990690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-809269af-c20b-4e8f-8f36-4d208d63cf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:46.993131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:47.107726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:47.260125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5b0e8-2d0c-4fd3-be07-1193fe0a1e59 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:47.261730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-45a5b0e8-2d0c-4fd3-be07-1193fe0a1e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:47.423521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5b0e8-2d0c-4fd3-be07-1193fe0a1e59 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:47.453566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:47.549152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900fc9c-e716-43a4-9dd6-91b69caa1ce3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:47.549820 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900fc9c-e716-43a4-9dd6-91b69caa1ce3 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:47.550094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900fc9c-e716-43a4-9dd6-91b69caa1ce3 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:47.550362 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900fc9c-e716-43a4-9dd6-91b69caa1ce3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:47.552003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4900fc9c-e716-43a4-9dd6-91b69caa1ce3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:47.651903 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4900fc9c-e716-43a4-9dd6-91b69caa1ce3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:47.653678 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4900fc9c-e716-43a4-9dd6-91b69caa1ce3 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:47.674807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 719/1440] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:49.790652 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d35820-7451-4707-99ad-0eb7b1094f94 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:49.791172 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d35820-7451-4707-99ad-0eb7b1094f94 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:49.791172 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d35820-7451-4707-99ad-0eb7b1094f94 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:49.792557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:49.798377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf817e6c-d4b1-4877-9871-a8d935d3d800 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:49.798818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf817e6c-d4b1-4877-9871-a8d935d3d800 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:49.798941 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf817e6c-d4b1-4877-9871-a8d935d3d800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:49.844171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:49.874114 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-bf817e6c-d4b1-4877-9871-a8d935d3d800 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:49.875414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-bf817e6c-d4b1-4877-9871-a8d935d3d800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:49.983859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:50.279767 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d35820-7451-4707-99ad-0eb7b1094f94 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:50.281429 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-28d35820-7451-4707-99ad-0eb7b1094f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:50.389866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d35820-7451-4707-99ad-0eb7b1094f94 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:50.425647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:50.469480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b9065-ca7a-4f46-b91d-4819a80bc603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:50.470096 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b9065-ca7a-4f46-b91d-4819a80bc603 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:50.470385 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b9065-ca7a-4f46-b91d-4819a80bc603 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:50.470649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b9065-ca7a-4f46-b91d-4819a80bc603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:50.472316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c80b9065-ca7a-4f46-b91d-4819a80bc603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:50.588268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b9065-ca7a-4f46-b91d-4819a80bc603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:50.589687 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b9065-ca7a-4f46-b91d-4819a80bc603 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:50.609137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 723/1443] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:53.081726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71b64f-c04d-47d4-a326-8ce87394d50b None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:53.082291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71b64f-c04d-47d4-a326-8ce87394d50b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:53.082291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71b64f-c04d-47d4-a326-8ce87394d50b None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:53.083621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:53.089265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d793e-7bd8-44e9-8f0d-3be8d9e61210 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:53.090108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d793e-7bd8-44e9-8f0d-3be8d9e61210 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:53.090108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d793e-7bd8-44e9-8f0d-3be8d9e61210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:53.165647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-f26d793e-7bd8-44e9-8f0d-3be8d9e61210 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:53.166847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f26d793e-7bd8-44e9-8f0d-3be8d9e61210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:53.180997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:53.277624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:53.569968 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71b64f-c04d-47d4-a326-8ce87394d50b None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:53.571550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ae71b64f-c04d-47d4-a326-8ce87394d50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:53.682578 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71b64f-c04d-47d4-a326-8ce87394d50b None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:53.695897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:53.765978 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624f19f-7a31-4d06-a0c3-1122541be0f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:53.766631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624f19f-7a31-4d06-a0c3-1122541be0f7 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:53.766889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624f19f-7a31-4d06-a0c3-1122541be0f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:53.767244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624f19f-7a31-4d06-a0c3-1122541be0f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:53.769094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f624f19f-7a31-4d06-a0c3-1122541be0f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:53.885560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624f19f-7a31-4d06-a0c3-1122541be0f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:53.887024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624f19f-7a31-4d06-a0c3-1122541be0f7 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:53.906387 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 722/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:56.516319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b0697-2f55-42d5-b208-3a7341b179b5 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:56.517065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b0697-2f55-42d5-b208-3a7341b179b5 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:56.517065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b0697-2f55-42d5-b208-3a7341b179b5 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:56.518310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:56.524139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98c39e-4b91-4274-a1e6-aac63d4633c5 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:56.524824 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98c39e-4b91-4274-a1e6-aac63d4633c5 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:56.524824 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98c39e-4b91-4274-a1e6-aac63d4633c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:56.574639 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:56.593848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-8d98c39e-4b91-4274-a1e6-aac63d4633c5 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:56.595064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-8d98c39e-4b91-4274-a1e6-aac63d4633c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:56.696915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:01:56.987678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b0697-2f55-42d5-b208-3a7341b179b5 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:56.989306 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-962b0697-2f55-42d5-b208-3a7341b179b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:57.112119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b0697-2f55-42d5-b208-3a7341b179b5 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:57.155881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:57.193423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7648a-41f9-4ebe-8552-5d706017facd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:57.194038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7648a-41f9-4ebe-8552-5d706017facd service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:57.194315 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7648a-41f9-4ebe-8552-5d706017facd service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:57.194583 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7648a-41f9-4ebe-8552-5d706017facd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:57.196221 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-09c7648a-41f9-4ebe-8552-5d706017facd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:57.314949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7648a-41f9-4ebe-8552-5d706017facd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:57.316492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7648a-41f9-4ebe-8552-5d706017facd service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:57.337486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 726/1449] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:59.745173 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7016b-7952-4261-b326-71c45ea8bf86 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:59.745760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7016b-7952-4261-b326-71c45ea8bf86 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:59.745760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7016b-7952-4261-b326-71c45ea8bf86 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:59.747099 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:59.753141 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d794f-c91c-4e83-a97f-d6139c4eecd7 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:59.753639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d794f-c91c-4e83-a97f-d6139c4eecd7 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:59.753739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d794f-c91c-4e83-a97f-d6139c4eecd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:59.832014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-6c1d794f-c91c-4e83-a97f-d6139c4eecd7 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:59.833207 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6c1d794f-c91c-4e83-a97f-d6139c4eecd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:59.854650 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:59.937070 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:00.231642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7016b-7952-4261-b326-71c45ea8bf86 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:00.233261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-06d7016b-7952-4261-b326-71c45ea8bf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:00.344998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7016b-7952-4261-b326-71c45ea8bf86 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:00.367355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:00.435445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ecac9-9278-49c4-be1b-941ebe18f808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:00.436066 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ecac9-9278-49c4-be1b-941ebe18f808 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:00.436344 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ecac9-9278-49c4-be1b-941ebe18f808 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:00.436648 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ecac9-9278-49c4-be1b-941ebe18f808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:00.438288 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-648ecac9-9278-49c4-be1b-941ebe18f808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:00.559357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ecac9-9278-49c4-be1b-941ebe18f808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:00.560761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ecac9-9278-49c4-be1b-941ebe18f808 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:00.580758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 725/1452] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:02:02.842122 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc77407-bc90-44e9-996f-fadfcb1e3132 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:02.842753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc77407-bc90-44e9-996f-fadfcb1e3132 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:02.842753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc77407-bc90-44e9-996f-fadfcb1e3132 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:02.844064 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:02.849892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c3f15-d088-4772-8cb2-ce4756020668 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:02.850366 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c3f15-d088-4772-8cb2-ce4756020668 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:02.850480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c3f15-d088-4772-8cb2-ce4756020668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:02.919414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:02.923675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-648c3f15-d088-4772-8cb2-ce4756020668 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:02.925576 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-648c3f15-d088-4772-8cb2-ce4756020668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:03.033014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:03.315116 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc77407-bc90-44e9-996f-fadfcb1e3132 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:03.316778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9cc77407-bc90-44e9-996f-fadfcb1e3132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:03.433668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc77407-bc90-44e9-996f-fadfcb1e3132 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:03.489641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:03.521554 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84caa4-1300-4f0a-ade9-10ea24bfd367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:03.522168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84caa4-1300-4f0a-ade9-10ea24bfd367 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:03.522454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84caa4-1300-4f0a-ade9-10ea24bfd367 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:03.522735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84caa4-1300-4f0a-ade9-10ea24bfd367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:03.524739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-2a84caa4-1300-4f0a-ade9-10ea24bfd367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:03.645787 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84caa4-1300-4f0a-ade9-10ea24bfd367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:03.647148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84caa4-1300-4f0a-ade9-10ea24bfd367 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:03.665928 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 729/1455] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:02:05.952910 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5fd2c-bca6-47e0-a2bc-42ba473e5383 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:05.953479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5fd2c-bca6-47e0-a2bc-42ba473e5383 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:05.953479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5fd2c-bca6-47e0-a2bc-42ba473e5383 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:05.954793 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:05.960765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7a0dd-9037-41f5-a526-ec11bd4bcb3f None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:05.961318 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7a0dd-9037-41f5-a526-ec11bd4bcb3f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:05.961318 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7a0dd-9037-41f5-a526-ec11bd4bcb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:06.035056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-62d7a0dd-9037-41f5-a526-ec11bd4bcb3f None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:06.036310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-62d7a0dd-9037-41f5-a526-ec11bd4bcb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:06.067957 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:06.142266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:06.424409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5fd2c-bca6-47e0-a2bc-42ba473e5383 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:06.426077 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-02d5fd2c-bca6-47e0-a2bc-42ba473e5383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:06.541640 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5fd2c-bca6-47e0-a2bc-42ba473e5383 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:06.570927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:06.620666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1340294-11b5-4c67-88b2-4c681cfce6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:06.621642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1340294-11b5-4c67-88b2-4c681cfce6fc service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:06.621917 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1340294-11b5-4c67-88b2-4c681cfce6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:06.622216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1340294-11b5-4c67-88b2-4c681cfce6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:06.623912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d1340294-11b5-4c67-88b2-4c681cfce6fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:06.742414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1340294-11b5-4c67-88b2-4c681cfce6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:06.743842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1340294-11b5-4c67-88b2-4c681cfce6fc service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:06.764154 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 728/1458] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:02:09.087965 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ba7d6-998e-434a-9afa-77a49d95b4ec None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:09.088695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ba7d6-998e-434a-9afa-77a49d95b4ec None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:09.088695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ba7d6-998e-434a-9afa-77a49d95b4ec None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:09.090448 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:02:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:09.098438 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb5346-1435-4506-a8e2-9e178b9c2dd3 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:09.098994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb5346-1435-4506-a8e2-9e178b9c2dd3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:09.098994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb5346-1435-4506-a8e2-9e178b9c2dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:09.173502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-6ffb5346-1435-4506-a8e2-9e178b9c2dd3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:09.174930 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6ffb5346-1435-4506-a8e2-9e178b9c2dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:09.184483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:09.288922 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:09.578344 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ba7d6-998e-434a-9afa-77a49d95b4ec None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:09.580002 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e08ba7d6-998e-434a-9afa-77a49d95b4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:09.696872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ba7d6-998e-434a-9afa-77a49d95b4ec None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:09.758955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:09.780622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc558c52-2595-442e-8d3a-f604f44213a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:09.781159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc558c52-2595-442e-8d3a-f604f44213a2 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:09.781441 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc558c52-2595-442e-8d3a-f604f44213a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:09.781710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc558c52-2595-442e-8d3a-f604f44213a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:09.783967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-fc558c52-2595-442e-8d3a-f604f44213a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:09.907447 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc558c52-2595-442e-8d3a-f604f44213a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:09.909140 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc558c52-2595-442e-8d3a-f604f44213a2 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:09.929240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 732/1461] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:02:12.211491 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b8ff1-9d73-4bc1-af6a-22368470fd8e None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:12.212085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b8ff1-9d73-4bc1-af6a-22368470fd8e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:12.212085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b8ff1-9d73-4bc1-af6a-22368470fd8e None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:12.213515 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:12.219369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce91953-5d09-4675-9f2a-1e0324b7e95f None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:12.219930 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce91953-5d09-4675-9f2a-1e0324b7e95f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:12.219930 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce91953-5d09-4675-9f2a-1e0324b7e95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:12.294497 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-4ce91953-5d09-4675-9f2a-1e0324b7e95f None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:12.295744 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-4ce91953-5d09-4675-9f2a-1e0324b7e95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:12.338508 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:12.404084 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:12.687424 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b8ff1-9d73-4bc1-af6a-22368470fd8e None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:12.689084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-825b8ff1-9d73-4bc1-af6a-22368470fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:12.799352 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b8ff1-9d73-4bc1-af6a-22368470fd8e None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:12.840405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:12.878946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b24888-39b2-4767-b8f1-ee131eb19893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:12.879566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b24888-39b2-4767-b8f1-ee131eb19893 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:12.879817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b24888-39b2-4767-b8f1-ee131eb19893 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:12.880108 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b24888-39b2-4767-b8f1-ee131eb19893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:12.881771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-71b24888-39b2-4767-b8f1-ee131eb19893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:12.999469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b24888-39b2-4767-b8f1-ee131eb19893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:13.001076 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b24888-39b2-4767-b8f1-ee131eb19893 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:13.020568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 731/1464] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:02:15.233144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8a652-2b82-4b3d-ba4c-cfbe560d2ce9 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:15.233750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8a652-2b82-4b3d-ba4c-cfbe560d2ce9 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:15.233750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8a652-2b82-4b3d-ba4c-cfbe560d2ce9 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:15.235071 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:15.241371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58f398-019b-47c8-8efb-711f158a2400 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:15.241891 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58f398-019b-47c8-8efb-711f158a2400 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:15.241891 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58f398-019b-47c8-8efb-711f158a2400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:15.315680 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-6c58f398-019b-47c8-8efb-711f158a2400 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:15.316972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6c58f398-019b-47c8-8efb-711f158a2400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:15.336731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:15.425788 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:15.716218 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8a652-2b82-4b3d-ba4c-cfbe560d2ce9 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:15.717855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7fa8a652-2b82-4b3d-ba4c-cfbe560d2ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:15.833583 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8a652-2b82-4b3d-ba4c-cfbe560d2ce9 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:15.913403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:15.922210 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37dcd2-9eae-486f-b807-1178be97dd15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:15.922956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37dcd2-9eae-486f-b807-1178be97dd15 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:15.923291 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37dcd2-9eae-486f-b807-1178be97dd15 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:15.923552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37dcd2-9eae-486f-b807-1178be97dd15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:15.925323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8f37dcd2-9eae-486f-b807-1178be97dd15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:16.050222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37dcd2-9eae-486f-b807-1178be97dd15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:16.051674 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37dcd2-9eae-486f-b807-1178be97dd15 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:16.071888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 735/1467] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:02:18.329256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed8d5e-208c-4205-a05c-9ce9f28154c1 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:18.329895 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed8d5e-208c-4205-a05c-9ce9f28154c1 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:18.329895 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed8d5e-208c-4205-a05c-9ce9f28154c1 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:18.331167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:18.337454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c885cf-d951-4a46-89e1-a8714b940b3a None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:18.337978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c885cf-d951-4a46-89e1-a8714b940b3a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:18.337978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c885cf-d951-4a46-89e1-a8714b940b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:18.415811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-33c885cf-d951-4a46-89e1-a8714b940b3a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:18.417121 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-33c885cf-d951-4a46-89e1-a8714b940b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:18.470984 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:18.521908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:18.803677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed8d5e-208c-4205-a05c-9ce9f28154c1 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:18.805865 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-07ed8d5e-208c-4205-a05c-9ce9f28154c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:18.924927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed8d5e-208c-4205-a05c-9ce9f28154c1 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:18.982783 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:19.012207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7868a-243c-4a4c-b088-8b67f5bbf752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:19.012863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7868a-243c-4a4c-b088-8b67f5bbf752 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:19.013142 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7868a-243c-4a4c-b088-8b67f5bbf752 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:19.013412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7868a-243c-4a4c-b088-8b67f5bbf752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:19.015067 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0ca7868a-243c-4a4c-b088-8b67f5bbf752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:19.134826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7868a-243c-4a4c-b088-8b67f5bbf752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:19.136246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7868a-243c-4a4c-b088-8b67f5bbf752 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:19.156290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 734/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:02:28.519941 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=22 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:29.153929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=66 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:39.392452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559f65f-16f9-48fc-89da-7fc4b54944ec None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:39.393082 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559f65f-16f9-48fc-89da-7fc4b54944ec None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:39.393082 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559f65f-16f9-48fc-89da-7fc4b54944ec None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:39.394412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 737/1471] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:39.400150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aec87-0a0e-4514-85c4-fe0d6d0071ed None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:39.400719 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aec87-0a0e-4514-85c4-fe0d6d0071ed None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:39.400719 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aec87-0a0e-4514-85c4-fe0d6d0071ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:39.473514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-0e5aec87-0a0e-4514-85c4-fe0d6d0071ed None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:39.474740 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0e5aec87-0a0e-4514-85c4-fe0d6d0071ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:39.576260 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 735/1472] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:39.868521 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df4ec5-c034-4db0-aed0-556103541b0a None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:39.868808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df4ec5-c034-4db0-aed0-556103541b0a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:39.869078 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df4ec5-c034-4db0-aed0-556103541b0a None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:39.870454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 738/1473] 10.222.0.30 () {54 vars in 961 bytes} [Wed Sep 7 13:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:39.875758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83122922-835c-48af-9031-c1cb21d25f81 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:39.876261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83122922-835c-48af-9031-c1cb21d25f81 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:39.876558 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83122922-835c-48af-9031-c1cb21d25f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:39.970098 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-83122922-835c-48af-9031-c1cb21d25f81 None None] MFA Rules not processed for user `f332ac2346f0444a8d336ed2b3121be2`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:39.971374 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-83122922-835c-48af-9031-c1cb21d25f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:39.992987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:40.052591 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 736/1474] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Sep 7 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:40.060646 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df4ec5-c034-4db0-aed0-556103541b0a None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:40.062240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-37df4ec5-c034-4db0-aed0-556103541b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:40.177116 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df4ec5-c034-4db0-aed0-556103541b0a None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:40.263204 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a61336-7d4a-4938-9001-b5bf8f314db7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f332ac2346f0444a8d336ed2b3121be2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:40.263860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a61336-7d4a-4938-9001-b5bf8f314db7 service glance] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:40.264119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a61336-7d4a-4938-9001-b5bf8f314db7 service glance] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:40.264394 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a61336-7d4a-4938-9001-b5bf8f314db7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:40.266289 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-46a61336-7d4a-4938-9001-b5bf8f314db7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:40.333156 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:40.396852 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a61336-7d4a-4938-9001-b5bf8f314db7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:40.398320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a61336-7d4a-4938-9001-b5bf8f314db7 service glance] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:40.418516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 739/1475] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:02:42.703445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d81e5-e351-4937-95ae-88c7cee5282a None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:42.704140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d81e5-e351-4937-95ae-88c7cee5282a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:42.704140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d81e5-e351-4937-95ae-88c7cee5282a None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:42.705441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 737/1476] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:42.711323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85c7cc-316d-4ef8-8533-354f76299c57 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:42.711824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85c7cc-316d-4ef8-8533-354f76299c57 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:42.711927 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85c7cc-316d-4ef8-8533-354f76299c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:42.803549 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-1e85c7cc-316d-4ef8-8533-354f76299c57 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:42.804860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1e85c7cc-316d-4ef8-8533-354f76299c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:42.913509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 740/1477] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:43.190468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d81e5-e351-4937-95ae-88c7cee5282a None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:43.192040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-138d81e5-e351-4937-95ae-88c7cee5282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:43.327456 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d81e5-e351-4937-95ae-88c7cee5282a None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:43.382037 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:43.432673 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895b7bd-cc44-48bd-9ac4-fee720893bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:43.433295 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895b7bd-cc44-48bd-9ac4-fee720893bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:43.433569 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895b7bd-cc44-48bd-9ac4-fee720893bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:43.433839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895b7bd-cc44-48bd-9ac4-fee720893bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:43.434489 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895b7bd-cc44-48bd-9ac4-fee720893bf5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:43.436301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: WARNING py.warnings [None req-7895b7bd-cc44-48bd-9ac4-fee720893bf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:02:43.436301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: warnings.warn(msg) Sep 07 13:02:43.436301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: Sep 07 13:02:43.437497 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895b7bd-cc44-48bd-9ac4-fee720893bf5 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:43.459947 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 738/1478] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Sep 7 13:02:43 2022] GET /identity/v3/projects => generated 2553 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:02:45.670854 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c0d88-c2f4-4707-a648-30ec8d5d1f36 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:45.671473 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c0d88-c2f4-4707-a648-30ec8d5d1f36 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:45.671473 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c0d88-c2f4-4707-a648-30ec8d5d1f36 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:45.673008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 741/1479] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:45.679466 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a00d4-24aa-43bb-87d2-9c5ade5c4532 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:45.680207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a00d4-24aa-43bb-87d2-9c5ade5c4532 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:45.680323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a00d4-24aa-43bb-87d2-9c5ade5c4532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:45.761482 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-a06a00d4-24aa-43bb-87d2-9c5ade5c4532 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:45.762716 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a06a00d4-24aa-43bb-87d2-9c5ade5c4532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:45.886685 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 739/1480] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:46.188305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c0d88-c2f4-4707-a648-30ec8d5d1f36 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:46.189923 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-db9c0d88-c2f4-4707-a648-30ec8d5d1f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:46.200800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:46.366620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c0d88-c2f4-4707-a648-30ec8d5d1f36 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:46.467801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:46.505766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af687c0f-8bef-447f-aed1-3366f42520fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:46.506372 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af687c0f-8bef-447f-aed1-3366f42520fe service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:46.506648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af687c0f-8bef-447f-aed1-3366f42520fe service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:46.506918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af687c0f-8bef-447f-aed1-3366f42520fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:46.508877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-af687c0f-8bef-447f-aed1-3366f42520fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:46.604862 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af687c0f-8bef-447f-aed1-3366f42520fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:46.606516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af687c0f-8bef-447f-aed1-3366f42520fe service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:46.627090 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 742/1481] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:02:49.043919 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a85c2-410c-4f84-be1c-b1e2b836f4a6 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:49.044515 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a85c2-410c-4f84-be1c-b1e2b836f4a6 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:49.044515 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a85c2-410c-4f84-be1c-b1e2b836f4a6 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:49.045844 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 740/1482] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:49.052134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5e165-9cf5-4908-a489-15533ae83af0 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:49.052809 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5e165-9cf5-4908-a489-15533ae83af0 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:49.052809 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5e165-9cf5-4908-a489-15533ae83af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:49.125015 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-c1b5e165-9cf5-4908-a489-15533ae83af0 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:49.125888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c1b5e165-9cf5-4908-a489-15533ae83af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:49.184236 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:49.241723 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 743/1483] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:49.531674 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a85c2-410c-4f84-be1c-b1e2b836f4a6 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:49.533290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-824a85c2-410c-4f84-be1c-b1e2b836f4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:49.560180 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:49.656709 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a85c2-410c-4f84-be1c-b1e2b836f4a6 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:49.739713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeef988-9744-49b1-90f1-f83917b58bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:49.740347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeef988-9744-49b1-90f1-f83917b58bce service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:49.740665 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeef988-9744-49b1-90f1-f83917b58bce service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:49.740963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeef988-9744-49b1-90f1-f83917b58bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:49.743037 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-bdeef988-9744-49b1-90f1-f83917b58bce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:49.838947 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:49.879083 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeef988-9744-49b1-90f1-f83917b58bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:49.880580 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeef988-9744-49b1-90f1-f83917b58bce service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:49.901301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 741/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:02:52.138779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6eba9-5a42-41bb-80dd-e5d2958a25f8 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:52.139336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6eba9-5a42-41bb-80dd-e5d2958a25f8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:52.139336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6eba9-5a42-41bb-80dd-e5d2958a25f8 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:52.140785 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 744/1485] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:52.147472 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9c9a8-f348-4e03-b47b-a3fedea17bd2 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:52.147947 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9c9a8-f348-4e03-b47b-a3fedea17bd2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:52.148097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9c9a8-f348-4e03-b47b-a3fedea17bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:52.236525 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-aed9c9a8-f348-4e03-b47b-a3fedea17bd2 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:52.237773 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-aed9c9a8-f348-4e03-b47b-a3fedea17bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:52.341530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 742/1486] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:52.640733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6eba9-5a42-41bb-80dd-e5d2958a25f8 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:52.642282 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-90d6eba9-5a42-41bb-80dd-e5d2958a25f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:52.764587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6eba9-5a42-41bb-80dd-e5d2958a25f8 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:52.843931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:52.845823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ac764-61e3-4b0f-8592-3cd944f727e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:52.846494 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ac764-61e3-4b0f-8592-3cd944f727e4 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:52.847213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ac764-61e3-4b0f-8592-3cd944f727e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:52.847492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ac764-61e3-4b0f-8592-3cd944f727e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:52.849977 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b30ac764-61e3-4b0f-8592-3cd944f727e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:53.108070 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ac764-61e3-4b0f-8592-3cd944f727e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:53.109660 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ac764-61e3-4b0f-8592-3cd944f727e4 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:53.129714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 745/1487] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:02:55.416748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d365a-fbbc-4af7-a405-614f498947e2 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:55.417448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d365a-fbbc-4af7-a405-614f498947e2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:55.417448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d365a-fbbc-4af7-a405-614f498947e2 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:55.419204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 743/1488] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:55.425114 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3bf5e-28c4-45db-9dbd-343b6eb3d424 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:55.425589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3bf5e-28c4-45db-9dbd-343b6eb3d424 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:55.425688 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3bf5e-28c4-45db-9dbd-343b6eb3d424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:55.495159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-a7a3bf5e-28c4-45db-9dbd-343b6eb3d424 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:55.496412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a7a3bf5e-28c4-45db-9dbd-343b6eb3d424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:55.555361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:55.604563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 746/1489] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:55.901954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d365a-fbbc-4af7-a405-614f498947e2 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:55.904564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-198d365a-fbbc-4af7-a405-614f498947e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:55.950847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:56.025916 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d365a-fbbc-4af7-a405-614f498947e2 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:56.117304 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aaec7-471c-474d-81e8-f5f8a2ae515b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:56.117836 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aaec7-471c-474d-81e8-f5f8a2ae515b service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:56.118119 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aaec7-471c-474d-81e8-f5f8a2ae515b service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:56.118379 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aaec7-471c-474d-81e8-f5f8a2ae515b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:56.120021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a47aaec7-471c-474d-81e8-f5f8a2ae515b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:56.211632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:56.244608 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47aaec7-471c-474d-81e8-f5f8a2ae515b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:56.246021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47aaec7-471c-474d-81e8-f5f8a2ae515b service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:56.266463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 744/1490] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:02:58.705632 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ed06-d7b6-4d9b-adfa-3d899803cfb9 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:58.706240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ed06-d7b6-4d9b-adfa-3d899803cfb9 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:58.706240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ed06-d7b6-4d9b-adfa-3d899803cfb9 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:58.707554 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 747/1491] 10.222.0.30 () {54 vars in 927 bytes} [Wed Sep 7 13:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:58.714099 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a6bc0-024a-40d4-beb1-ba6bc11e7dcb None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:58.714552 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a6bc0-024a-40d4-beb1-ba6bc11e7dcb None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:58.714646 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a6bc0-024a-40d4-beb1-ba6bc11e7dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:58.797746 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-469a6bc0-024a-40d4-beb1-ba6bc11e7dcb None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:58.798993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-469a6bc0-024a-40d4-beb1-ba6bc11e7dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:58.904735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 745/1492] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Sep 7 13:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:59.202785 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ed06-d7b6-4d9b-adfa-3d899803cfb9 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:59.204590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-4602ed06-d7b6-4d9b-adfa-3d899803cfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:59.316883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ed06-d7b6-4d9b-adfa-3d899803cfb9 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:59.404893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37251b5-fce5-482a-bc96-dd747d5a6648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:59.405509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37251b5-fce5-482a-bc96-dd747d5a6648 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:59.406229 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37251b5-fce5-482a-bc96-dd747d5a6648 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:59.406229 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37251b5-fce5-482a-bc96-dd747d5a6648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:59.407758 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a37251b5-fce5-482a-bc96-dd747d5a6648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:59.416865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:59.529739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37251b5-fce5-482a-bc96-dd747d5a6648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:59.531838 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37251b5-fce5-482a-bc96-dd747d5a6648 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:59.552498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 748/1493] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:03:08.902611 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=82 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:09.549789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=50 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:14.300125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b48910-705d-4031-95b8-ba9a9391322e None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:14.300807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b48910-705d-4031-95b8-ba9a9391322e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:14.300807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b48910-705d-4031-95b8-ba9a9391322e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:14.392066 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-87b48910-705d-4031-95b8-ba9a9391322e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:04:14.393360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-87b48910-705d-4031-95b8-ba9a9391322e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:14.502943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 746/1494] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:04:14.511949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a0b6f-4d24-4327-8982-8b81c7f3997d None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:14.512551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a0b6f-4d24-4327-8982-8b81c7f3997d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:14.512551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a0b6f-4d24-4327-8982-8b81c7f3997d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:14.603311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-803a0b6f-4d24-4327-8982-8b81c7f3997d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:04:14.604493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-803a0b6f-4d24-4327-8982-8b81c7f3997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:14.718617 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 749/1495] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:04:14.723620 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b48910-705d-4031-95b8-ba9a9391322e None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:14.724914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-87b48910-705d-4031-95b8-ba9a9391322e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:14.738177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b48910-705d-4031-95b8-ba9a9391322e None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:14.814832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:14.860075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505e182-8e72-4a83-8535-2faf3bacfcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:14.860673 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505e182-8e72-4a83-8535-2faf3bacfcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:14.860949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505e182-8e72-4a83-8535-2faf3bacfcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:14.861215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505e182-8e72-4a83-8535-2faf3bacfcd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:14.861866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505e182-8e72-4a83-8535-2faf3bacfcd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:04:14.862165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505e182-8e72-4a83-8535-2faf3bacfcd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:14.863205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: WARNING py.warnings [None req-c505e182-8e72-4a83-8535-2faf3bacfcd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:04:14.863205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: warnings.warn(msg) Sep 07 13:04:14.863205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: Sep 07 13:04:14.864098 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505e182-8e72-4a83-8535-2faf3bacfcd8 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:14.876910 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 747/1496] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:04:14.886333 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a0b6f-4d24-4327-8982-8b81c7f3997d None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:14.899916 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a0b6f-4d24-4327-8982-8b81c7f3997d None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:14.972098 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:15.021493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270fcb2-eacc-4cea-ad9a-e51316e1c5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:15.022124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270fcb2-eacc-4cea-ad9a-e51316e1c5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:15.022398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270fcb2-eacc-4cea-ad9a-e51316e1c5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:15.022663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270fcb2-eacc-4cea-ad9a-e51316e1c5c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:15.023294 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270fcb2-eacc-4cea-ad9a-e51316e1c5c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:15.025105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: WARNING py.warnings [None req-3270fcb2-eacc-4cea-ad9a-e51316e1c5c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:04:15.025105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: warnings.warn(msg) Sep 07 13:04:15.025105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: Sep 07 13:04:15.026283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270fcb2-eacc-4cea-ad9a-e51316e1c5c0 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:15.093027 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 750/1497] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:04:14 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:04:15.097341 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505e182-8e72-4a83-8535-2faf3bacfcd8 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:15.098884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c505e182-8e72-4a83-8535-2faf3bacfcd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:15.132904 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505e182-8e72-4a83-8535-2faf3bacfcd8 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:15.236406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61608c6f-c458-4437-8d75-a4e3e38cc370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:15.237103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61608c6f-c458-4437-8d75-a4e3e38cc370 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:15.237409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61608c6f-c458-4437-8d75-a4e3e38cc370 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:15.237655 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61608c6f-c458-4437-8d75-a4e3e38cc370 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:15.238289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61608c6f-c458-4437-8d75-a4e3e38cc370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:15.239316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: WARNING py.warnings [None req-61608c6f-c458-4437-8d75-a4e3e38cc370 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:04:15.239316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: warnings.warn(msg) Sep 07 13:04:15.239316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: Sep 07 13:04:15.240564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61608c6f-c458-4437-8d75-a4e3e38cc370 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:15.290833 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 748/1498] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:04:15 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:04:15.295790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270fcb2-eacc-4cea-ad9a-e51316e1c5c0 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:15.297385 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-3270fcb2-eacc-4cea-ad9a-e51316e1c5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:15.369528 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270fcb2-eacc-4cea-ad9a-e51316e1c5c0 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:15.462659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:15.475275 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc6de7-f37f-4bab-bd2b-11de1dcadbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:15.475898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc6de7-f37f-4bab-bd2b-11de1dcadbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:15.476171 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc6de7-f37f-4bab-bd2b-11de1dcadbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:15.476468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc6de7-f37f-4bab-bd2b-11de1dcadbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:15.477135 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc6de7-f37f-4bab-bd2b-11de1dcadbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:15.478175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: WARNING py.warnings [None req-0bdc6de7-f37f-4bab-bd2b-11de1dcadbc9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:04:15.478175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: warnings.warn(msg) Sep 07 13:04:15.478175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: Sep 07 13:04:15.479072 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc6de7-f37f-4bab-bd2b-11de1dcadbc9 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:15.492487 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 751/1499] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:04:15.498597 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61608c6f-c458-4437-8d75-a4e3e38cc370 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:15.500458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-61608c6f-c458-4437-8d75-a4e3e38cc370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:15.518771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61608c6f-c458-4437-8d75-a4e3e38cc370 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:15.547747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:15.628528 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd33c46-1b71-4d29-b2d2-d7d242da2c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:15.629149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd33c46-1b71-4d29-b2d2-d7d242da2c36 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:15.629419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd33c46-1b71-4d29-b2d2-d7d242da2c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:15.629687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd33c46-1b71-4d29-b2d2-d7d242da2c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:15.630342 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd33c46-1b71-4d29-b2d2-d7d242da2c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:15.631402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: WARNING py.warnings [None req-cfd33c46-1b71-4d29-b2d2-d7d242da2c36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:04:15.631402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: warnings.warn(msg) Sep 07 13:04:15.631402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: Sep 07 13:04:15.632647 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd33c46-1b71-4d29-b2d2-d7d242da2c36 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:15.645598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 749/1500] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:04:15.651851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc6de7-f37f-4bab-bd2b-11de1dcadbc9 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:15.654642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0bdc6de7-f37f-4bab-bd2b-11de1dcadbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:15.705015 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc6de7-f37f-4bab-bd2b-11de1dcadbc9 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:15.812257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fc59c-4a08-4c1e-8a93-eaeeb753acd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:15.812966 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fc59c-4a08-4c1e-8a93-eaeeb753acd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:15.813246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fc59c-4a08-4c1e-8a93-eaeeb753acd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:15.813517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fc59c-4a08-4c1e-8a93-eaeeb753acd9 admin admin] PATH_INFO: `/v3/projects/fcf24f237cda4ba1a7d270ab9c7ee4c0/users/f53867f5e9514c458d18c3e794c680f9/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:15.836299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fc59c-4a08-4c1e-8a93-eaeeb753acd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf24f237cda4ba1a7d270ab9c7ee4c0, user_id=f53867f5e9514c458d18c3e794c680f9, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:15.837378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: WARNING py.warnings [None req-1c4fc59c-4a08-4c1e-8a93-eaeeb753acd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:04:15.837378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: warnings.warn(msg) Sep 07 13:04:15.837378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: Sep 07 13:04:15.839339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fc59c-4a08-4c1e-8a93-eaeeb753acd9 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:15.875224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 752/1501] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:04:15 2022] PUT /identity/v3/projects/fcf24f237cda4ba1a7d270ab9c7ee4c0/users/f53867f5e9514c458d18c3e794c680f9/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:04:15.888007 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23c5f8-777c-4826-b155-306a9420724d None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:15.888300 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23c5f8-777c-4826-b155-306a9420724d None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:15.888621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23c5f8-777c-4826-b155-306a9420724d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:15.961166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-2e23c5f8-777c-4826-b155-306a9420724d None None] MFA Rules not processed for user `f53867f5e9514c458d18c3e794c680f9`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:04:15.962505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2e23c5f8-777c-4826-b155-306a9420724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:16.052784 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 750/1502] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:04:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:04:16.066938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d9bd3-6ccd-4232-b3b4-7c670fa1a139 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:16.067113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d9bd3-6ccd-4232-b3b4-7c670fa1a139 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:16.067416 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d9bd3-6ccd-4232-b3b4-7c670fa1a139 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:16.068859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 753/1503] 10.222.0.30 () {54 vars in 964 bytes} [Wed Sep 7 13:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:04:16.074048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700a425-6607-4aed-841d-b52787068c86 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:16.074331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700a425-6607-4aed-841d-b52787068c86 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:16.074601 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700a425-6607-4aed-841d-b52787068c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:16.110806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:16.164228 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-f700a425-6607-4aed-841d-b52787068c86 None None] MFA Rules not processed for user `4089419bb88e4aeda23bf141370cb6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:04:16.165515 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f700a425-6607-4aed-841d-b52787068c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:16.255830 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 751/1504] 10.222.0.30 () {58 vars in 1061 bytes} [Wed Sep 7 13:04:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:04:16.266312 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d9bd3-6ccd-4232-b3b4-7c670fa1a139 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:16.267873 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-936d9bd3-6ccd-4232-b3b4-7c670fa1a139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:16.330143 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:16.387665 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d9bd3-6ccd-4232-b3b4-7c670fa1a139 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:16.481383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80570ef1-7af5-4ec9-becd-3a4af048a0d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:16.482037 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80570ef1-7af5-4ec9-becd-3a4af048a0d7 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:16.482311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80570ef1-7af5-4ec9-becd-3a4af048a0d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:16.482587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80570ef1-7af5-4ec9-becd-3a4af048a0d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:16.484255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-80570ef1-7af5-4ec9-becd-3a4af048a0d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:16.603272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80570ef1-7af5-4ec9-becd-3a4af048a0d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:16.604657 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80570ef1-7af5-4ec9-becd-3a4af048a0d7 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:16.608130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:16.625297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 754/1505] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:04:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:04:16.683785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb93a2-4ae0-45b5-b42a-db3159dde0fd None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:16.684262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb93a2-4ae0-45b5-b42a-db3159dde0fd None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:16.684435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb93a2-4ae0-45b5-b42a-db3159dde0fd None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:16.686077 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 752/1506] 10.222.0.30 () {52 vars in 830 bytes} [Wed Sep 7 13:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:04:16.689616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80570ef1-7af5-4ec9-becd-3a4af048a0d7 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:16.690946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-80570ef1-7af5-4ec9-becd-3a4af048a0d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:16.807320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80570ef1-7af5-4ec9-becd-3a4af048a0d7 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:16.922197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf17744-a318-4f5e-b586-4c06656f71fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:16.922707 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf17744-a318-4f5e-b586-4c06656f71fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:16.923003 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf17744-a318-4f5e-b586-4c06656f71fc admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:16.923273 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf17744-a318-4f5e-b586-4c06656f71fc admin admin] PATH_INFO: `/v3/users/f53867f5e9514c458d18c3e794c680f9` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:16.943290 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf17744-a318-4f5e-b586-4c06656f71fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f53867f5e9514c458d18c3e794c680f9)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:16.944934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: WARNING py.warnings [None req-5bf17744-a318-4f5e-b586-4c06656f71fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:04:16.944934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: warnings.warn(msg) Sep 07 13:04:16.944934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: Sep 07 13:04:16.946818 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf17744-a318-4f5e-b586-4c06656f71fc admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:16.959286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:17.028620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5bf17744-a318-4f5e-b586-4c06656f71fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f53867f5e9514c458d18c3e794c680f9'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:04:17.029048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5bf17744-a318-4f5e-b586-4c06656f71fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f53867f5e9514c458d18c3e794c680f9'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:04:17.045636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5bf17744-a318-4f5e-b586-4c06656f71fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f53867f5e9514c458d18c3e794c680f9'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:04:17.073306 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5bf17744-a318-4f5e-b586-4c06656f71fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f53867f5e9514c458d18c3e794c680f9'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:04:17.085786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5bf17744-a318-4f5e-b586-4c06656f71fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f53867f5e9514c458d18c3e794c680f9'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:04:17.091974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 755/1507] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:04:16 2022] DELETE /identity/v3/users/f53867f5e9514c458d18c3e794c680f9 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:04:17.096519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b73809-d1ff-4e2e-85e6-63850ccee719 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:17.096803 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b73809-d1ff-4e2e-85e6-63850ccee719 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:17.097122 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b73809-d1ff-4e2e-85e6-63850ccee719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:17.162361 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-10b73809-d1ff-4e2e-85e6-63850ccee719 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:04:17.163674 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-10b73809-d1ff-4e2e-85e6-63850ccee719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:17.248431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:17.263521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 753/1508] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:04:17.275836 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf17744-a318-4f5e-b586-4c06656f71fc admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:17.277196 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5bf17744-a318-4f5e-b586-4c06656f71fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:17.393670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf17744-a318-4f5e-b586-4c06656f71fc admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:17.459015 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:17.484898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f99015-5830-49ef-96a1-5325ccbcea27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:17.485514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f99015-5830-49ef-96a1-5325ccbcea27 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:17.485791 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f99015-5830-49ef-96a1-5325ccbcea27 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:17.486057 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f99015-5830-49ef-96a1-5325ccbcea27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:17.487695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-78f99015-5830-49ef-96a1-5325ccbcea27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:17.615675 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f99015-5830-49ef-96a1-5325ccbcea27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:17.620145 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f99015-5830-49ef-96a1-5325ccbcea27 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:17.638343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 756/1509] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:04:18.018544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b73809-d1ff-4e2e-85e6-63850ccee719 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:18.020054 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-10b73809-d1ff-4e2e-85e6-63850ccee719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:18.033306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b73809-d1ff-4e2e-85e6-63850ccee719 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:18.140988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:18.141556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:18.141842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:18.142116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb admin admin] PATH_INFO: `/v3/projects/fcf24f237cda4ba1a7d270ab9c7ee4c0` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:18.153416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf24f237cda4ba1a7d270ab9c7ee4c0)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:18.154560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: WARNING py.warnings [None req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:04:18.154560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: warnings.warn(msg) Sep 07 13:04:18.154560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: Sep 07 13:04:18.155908 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:18.222444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf24f237cda4ba1a7d270ab9c7ee4c0', 'request_id': 'req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:04:18.232392 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf24f237cda4ba1a7d270ab9c7ee4c0', 'request_id': 'req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:04:18.238939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf24f237cda4ba1a7d270ab9c7ee4c0', 'request_id': 'req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:04:18.271812 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb admin admin] The token cache is being invalidate because project fcf24f237cda4ba1a7d270ab9c7ee4c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:04:18.272103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:04:18.272568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a2d12dd4-35f4-43c1-aee4-990ae5ab73fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:04:18.274021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 754/1510] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:04:18 2022] DELETE /identity/v3/projects/fcf24f237cda4ba1a7d270ab9c7ee4c0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:04:27.635364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=62 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:28.269643 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:02.686254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64acbaf-b97d-40ea-94d9-ec1c29c8c9e6 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:02.686901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64acbaf-b97d-40ea-94d9-ec1c29c8c9e6 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:02.686901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64acbaf-b97d-40ea-94d9-ec1c29c8c9e6 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:02.688302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:06:02.694399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd4b5a-025d-4371-9455-48f29f2893a5 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:02.695005 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd4b5a-025d-4371-9455-48f29f2893a5 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:02.695005 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd4b5a-025d-4371-9455-48f29f2893a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:02.791039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-42dd4b5a-025d-4371-9455-48f29f2893a5 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:02.792407 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-42dd4b5a-025d-4371-9455-48f29f2893a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:02.906378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:03.063764 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64acbaf-b97d-40ea-94d9-ec1c29c8c9e6 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:03.066091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b64acbaf-b97d-40ea-94d9-ec1c29c8c9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:03.197260 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64acbaf-b97d-40ea-94d9-ec1c29c8c9e6 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:03.204151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493e12f-9ee4-49a1-a261-44f4113e9713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:03.204822 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493e12f-9ee4-49a1-a261-44f4113e9713 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:03.205100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493e12f-9ee4-49a1-a261-44f4113e9713 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:03.205367 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493e12f-9ee4-49a1-a261-44f4113e9713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:03.215257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493e12f-9ee4-49a1-a261-44f4113e9713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:03.216958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493e12f-9ee4-49a1-a261-44f4113e9713 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:03.228167 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 758/1513] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:04.491220 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874c255-cce7-4ce1-b5da-d13a63da5aef None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:04.491848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874c255-cce7-4ce1-b5da-d13a63da5aef None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:04.491848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874c255-cce7-4ce1-b5da-d13a63da5aef None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:04.493440 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:06:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:06:04.500817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe4e9-911d-44df-bff3-781864168849 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:04.501423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe4e9-911d-44df-bff3-781864168849 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:04.501860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe4e9-911d-44df-bff3-781864168849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:04.525997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-1f0fe4e9-911d-44df-bff3-781864168849 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:04.527589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1f0fe4e9-911d-44df-bff3-781864168849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:04.536143 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:06:04.693264 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874c255-cce7-4ce1-b5da-d13a63da5aef None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:04.710346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874c255-cce7-4ce1-b5da-d13a63da5aef None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:04.716780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc0e4d-5d94-4633-b7a2-5327fd46e04e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:04.717428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc0e4d-5d94-4633-b7a2-5327fd46e04e service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:04.717709 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc0e4d-5d94-4633-b7a2-5327fd46e04e service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:04.717982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc0e4d-5d94-4633-b7a2-5327fd46e04e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:04.727636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc0e4d-5d94-4633-b7a2-5327fd46e04e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:04.729214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc0e4d-5d94-4633-b7a2-5327fd46e04e service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:04.740511 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 757/1516] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:04.947818 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b334a-9b41-4ff4-9eb3-c12876b489bf None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:04.948106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b334a-9b41-4ff4-9eb3-c12876b489bf None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:04.948403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b334a-9b41-4ff4-9eb3-c12876b489bf None None] PATH_INFO: `/v3` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:04.949994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 760/1517] 10.222.0.15 () {54 vars in 925 bytes} [Wed Sep 7 13:06:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:06:04.956984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd014d59-dda0-4d2c-bb87-10a35f108935 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:04.957316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd014d59-dda0-4d2c-bb87-10a35f108935 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:04.957493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd014d59-dda0-4d2c-bb87-10a35f108935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:05.028418 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-fd014d59-dda0-4d2c-bb87-10a35f108935 None None] MFA Rules not processed for user `f2420def47ee4a5b8cf4373252583d75`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:05.029596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fd014d59-dda0-4d2c-bb87-10a35f108935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:05.048231 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:05.114394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 758/1518] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Sep 7 13:06:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:08.771268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f2134-8d33-44eb-b158-0f9271ec443f None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:08.772044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f2134-8d33-44eb-b158-0f9271ec443f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:08.772044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f2134-8d33-44eb-b158-0f9271ec443f None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:08.773211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 761/1519] 10.222.0.30 () {54 vars in 961 bytes} [Wed Sep 7 13:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:06:08.779875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6d1af-f2ed-4632-a6c9-69809acac653 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:08.780469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6d1af-f2ed-4632-a6c9-69809acac653 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:08.780872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6d1af-f2ed-4632-a6c9-69809acac653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:08.805871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-6aa6d1af-f2ed-4632-a6c9-69809acac653 None None] MFA Rules not processed for user `f2420def47ee4a5b8cf4373252583d75`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:08.807132 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6aa6d1af-f2ed-4632-a6c9-69809acac653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:08.817480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 759/1520] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Sep 7 13:06:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:08.826228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f2134-8d33-44eb-b158-0f9271ec443f None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:08.842333 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f2134-8d33-44eb-b158-0f9271ec443f None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:08.847661 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46ddac-f980-4aa9-89a0-232b9ce00d43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2420def47ee4a5b8cf4373252583d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:08.848289 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46ddac-f980-4aa9-89a0-232b9ce00d43 service placement] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:08.848583 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46ddac-f980-4aa9-89a0-232b9ce00d43 service placement] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:08.848854 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46ddac-f980-4aa9-89a0-232b9ce00d43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:08.858692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46ddac-f980-4aa9-89a0-232b9ce00d43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:08.860360 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46ddac-f980-4aa9-89a0-232b9ce00d43 service placement] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:08.874378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 762/1521] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:16.381306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788a4e4-a122-46ab-8951-4b358f784935 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:16.382261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788a4e4-a122-46ab-8951-4b358f784935 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:16.382261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788a4e4-a122-46ab-8951-4b358f784935 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:16.384276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:06:16.392004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694a24a-8ffa-45ec-8fbd-f4cdba66bdd5 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:16.392736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694a24a-8ffa-45ec-8fbd-f4cdba66bdd5 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:16.392736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694a24a-8ffa-45ec-8fbd-f4cdba66bdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:16.415859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-6694a24a-8ffa-45ec-8fbd-f4cdba66bdd5 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:16.417211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6694a24a-8ffa-45ec-8fbd-f4cdba66bdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:16.426585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:16.601616 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788a4e4-a122-46ab-8951-4b358f784935 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:16.618313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788a4e4-a122-46ab-8951-4b358f784935 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:16.624299 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f4a88-abf5-4451-9dd3-a6f51e96cbad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:16.624970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f4a88-abf5-4451-9dd3-a6f51e96cbad service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:16.625256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f4a88-abf5-4451-9dd3-a6f51e96cbad service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:16.625526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f4a88-abf5-4451-9dd3-a6f51e96cbad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:16.635497 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f4a88-abf5-4451-9dd3-a6f51e96cbad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:16.637360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f4a88-abf5-4451-9dd3-a6f51e96cbad service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:16.648543 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 761/1524] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:17.900151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58913e03-3671-434d-a712-043b7a63ab7e None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:17.900783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58913e03-3671-434d-a712-043b7a63ab7e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:17.900783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58913e03-3671-434d-a712-043b7a63ab7e None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:17.902287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:06:17.912329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0353e8a-8a59-4846-abe5-b3aded754a87 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:17.912965 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0353e8a-8a59-4846-abe5-b3aded754a87 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:17.912965 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0353e8a-8a59-4846-abe5-b3aded754a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:17.936764 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-b0353e8a-8a59-4846-abe5-b3aded754a87 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:17.937946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b0353e8a-8a59-4846-abe5-b3aded754a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:17.947343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:18.163263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58913e03-3671-434d-a712-043b7a63ab7e None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:18.182487 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58913e03-3671-434d-a712-043b7a63ab7e None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:18.191470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e81449-9e6d-484d-add9-ecd552a490bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:18.192275 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e81449-9e6d-484d-add9-ecd552a490bf service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:18.192659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e81449-9e6d-484d-add9-ecd552a490bf service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:18.192994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e81449-9e6d-484d-add9-ecd552a490bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:18.205696 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e81449-9e6d-484d-add9-ecd552a490bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:18.207695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e81449-9e6d-484d-add9-ecd552a490bf service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:18.222174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 765/1527] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:06:22.619997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748f84b-6c83-4f67-99d8-c8f86ceba3ca None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:22.620742 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748f84b-6c83-4f67-99d8-c8f86ceba3ca None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:22.620742 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748f84b-6c83-4f67-99d8-c8f86ceba3ca None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:22.622329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:06:22.628676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeddc2-8613-463b-864a-9c1355d8b4aa None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:22.629276 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeddc2-8613-463b-864a-9c1355d8b4aa None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:22.629276 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeddc2-8613-463b-864a-9c1355d8b4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:22.653800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-3aeeddc2-8613-463b-864a-9c1355d8b4aa None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:22.655087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-3aeeddc2-8613-463b-864a-9c1355d8b4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:22.664342 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:22.961014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748f84b-6c83-4f67-99d8-c8f86ceba3ca None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:22.963011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7748f84b-6c83-4f67-99d8-c8f86ceba3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:23.065541 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748f84b-6c83-4f67-99d8-c8f86ceba3ca None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:23.069849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520f59d-b99e-4bcb-b2af-1560527055e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:23.070491 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520f59d-b99e-4bcb-b2af-1560527055e0 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:23.070771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520f59d-b99e-4bcb-b2af-1560527055e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:23.071027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520f59d-b99e-4bcb-b2af-1560527055e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:23.083121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520f59d-b99e-4bcb-b2af-1560527055e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:23.084797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520f59d-b99e-4bcb-b2af-1560527055e0 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:23.096672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 764/1530] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:25.468080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46624abb-e853-47bf-ab5d-b4c789648c37 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:25.468804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46624abb-e853-47bf-ab5d-b4c789648c37 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:25.468804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46624abb-e853-47bf-ab5d-b4c789648c37 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:25.470329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:06:25.479642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e820b04-d4e0-466b-8555-a5426e3ee0bc None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:25.481059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e820b04-d4e0-466b-8555-a5426e3ee0bc None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:25.481059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e820b04-d4e0-466b-8555-a5426e3ee0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:25.504335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-7e820b04-d4e0-466b-8555-a5426e3ee0bc None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:25.505623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7e820b04-d4e0-466b-8555-a5426e3ee0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:25.515610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:25.823247 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46624abb-e853-47bf-ab5d-b4c789648c37 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:25.826561 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-46624abb-e853-47bf-ab5d-b4c789648c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:25.850202 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46624abb-e853-47bf-ab5d-b4c789648c37 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:25.856834 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17485d-540a-475f-9cab-0a1a2dd07242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:25.857636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17485d-540a-475f-9cab-0a1a2dd07242 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:25.857937 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17485d-540a-475f-9cab-0a1a2dd07242 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:25.858350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17485d-540a-475f-9cab-0a1a2dd07242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:25.870322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17485d-540a-475f-9cab-0a1a2dd07242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:25.871860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17485d-540a-475f-9cab-0a1a2dd07242 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:25.885449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 768/1533] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:29.971699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab44b-74be-460e-844a-a6b37ee6a8ab None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:29.972299 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab44b-74be-460e-844a-a6b37ee6a8ab None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:29.972637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab44b-74be-460e-844a-a6b37ee6a8ab None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:29.975269 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:06:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:06:29.984291 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723accec-e342-4f67-8e42-020b70a8acf3 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:29.985057 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723accec-e342-4f67-8e42-020b70a8acf3 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:29.985057 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723accec-e342-4f67-8e42-020b70a8acf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:29.994313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=81 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:30.010416 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-723accec-e342-4f67-8e42-020b70a8acf3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:30.011747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-723accec-e342-4f67-8e42-020b70a8acf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:30.021450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:06:30.352888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ab44b-74be-460e-844a-a6b37ee6a8ab None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:30.354897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-978ab44b-74be-460e-844a-a6b37ee6a8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:30.442786 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:30.461956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ab44b-74be-460e-844a-a6b37ee6a8ab None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:30.467004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98298d6f-5d1e-4298-b41a-46e68b75dd8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:30.467748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98298d6f-5d1e-4298-b41a-46e68b75dd8b service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:30.468033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98298d6f-5d1e-4298-b41a-46e68b75dd8b service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:30.468308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98298d6f-5d1e-4298-b41a-46e68b75dd8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:30.480161 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98298d6f-5d1e-4298-b41a-46e68b75dd8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:30.481764 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98298d6f-5d1e-4298-b41a-46e68b75dd8b service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:30.494165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 767/1536] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:06:32.870791 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82650d5e-1421-4180-a59e-6202ff00ab34 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:32.871475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82650d5e-1421-4180-a59e-6202ff00ab34 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:32.871640 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82650d5e-1421-4180-a59e-6202ff00ab34 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:32.873055 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:06:32.879174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99809a-26d9-43c7-8d7b-9fb222a06541 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:32.880013 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99809a-26d9-43c7-8d7b-9fb222a06541 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:32.880013 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99809a-26d9-43c7-8d7b-9fb222a06541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:32.902107 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-7b99809a-26d9-43c7-8d7b-9fb222a06541 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:32.903289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7b99809a-26d9-43c7-8d7b-9fb222a06541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:32.914606 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:33.438950 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82650d5e-1421-4180-a59e-6202ff00ab34 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:33.441941 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-82650d5e-1421-4180-a59e-6202ff00ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:33.460829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82650d5e-1421-4180-a59e-6202ff00ab34 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:33.465840 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3619468-b69e-4afc-ba4c-16c59dfa7afe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:33.466470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3619468-b69e-4afc-ba4c-16c59dfa7afe service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:33.466749 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3619468-b69e-4afc-ba4c-16c59dfa7afe service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:33.467018 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3619468-b69e-4afc-ba4c-16c59dfa7afe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:33.478675 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3619468-b69e-4afc-ba4c-16c59dfa7afe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:33.480646 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3619468-b69e-4afc-ba4c-16c59dfa7afe service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:33.492065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 771/1539] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:42.895975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=11 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:43.486598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=8 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:04.779742 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50274cb-c461-4aac-ba66-e64be377dcde None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:04.781729 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50274cb-c461-4aac-ba66-e64be377dcde None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:04.782563 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50274cb-c461-4aac-ba66-e64be377dcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:04.817792 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-b50274cb-c461-4aac-ba66-e64be377dcde None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:04.819997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b50274cb-c461-4aac-ba66-e64be377dcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:04.850249 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 769/1540] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:04.860131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28459bd-8d31-4eac-a954-d8a8c9f71338 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:04.861455 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28459bd-8d31-4eac-a954-d8a8c9f71338 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:04.862024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28459bd-8d31-4eac-a954-d8a8c9f71338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:04.895829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-b28459bd-8d31-4eac-a954-d8a8c9f71338 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:04.897909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b28459bd-8d31-4eac-a954-d8a8c9f71338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:04.912822 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 772/1541] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:04.918428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50274cb-c461-4aac-ba66-e64be377dcde None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:04.939732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50274cb-c461-4aac-ba66-e64be377dcde None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:04.945341 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48145db9-1c28-402c-b30e-ba461b0af193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:04.946089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145db9-1c28-402c-b30e-ba461b0af193 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:04.946366 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145db9-1c28-402c-b30e-ba461b0af193 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:04.946634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145db9-1c28-402c-b30e-ba461b0af193 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:04.952654 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48145db9-1c28-402c-b30e-ba461b0af193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:08:04.953170 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48145db9-1c28-402c-b30e-ba461b0af193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:04.954934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48145db9-1c28-402c-b30e-ba461b0af193 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:04.985055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 770/1542] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:08:04.997895 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28459bd-8d31-4eac-a954-d8a8c9f71338 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:05.016291 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28459bd-8d31-4eac-a954-d8a8c9f71338 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:05.031500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7edb23-56a3-4261-86a8-1aa4b4980a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:05.033035 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7edb23-56a3-4261-86a8-1aa4b4980a45 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.033769 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7edb23-56a3-4261-86a8-1aa4b4980a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.034655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7edb23-56a3-4261-86a8-1aa4b4980a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.038251 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7edb23-56a3-4261-86a8-1aa4b4980a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:05.042456 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7edb23-56a3-4261-86a8-1aa4b4980a45 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:05.166188 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 773/1543] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:04 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:05.180255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7edb23-56a3-4261-86a8-1aa4b4980a45 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:05.181126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d92829-fc76-4c97-aa6e-f322130253ed None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.181622 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d92829-fc76-4c97-aa6e-f322130253ed None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.182317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d92829-fc76-4c97-aa6e-f322130253ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.230301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-e5d92829-fc76-4c97-aa6e-f322130253ed None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:05.232886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-e5d92829-fc76-4c97-aa6e-f322130253ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:05.370252 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7edb23-56a3-4261-86a8-1aa4b4980a45 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:05.393474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f7262-5a66-42bd-8814-3eda5fdb8237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:05.394205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f7262-5a66-42bd-8814-3eda5fdb8237 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.394580 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f7262-5a66-42bd-8814-3eda5fdb8237 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.394860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f7262-5a66-42bd-8814-3eda5fdb8237 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.395691 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f7262-5a66-42bd-8814-3eda5fdb8237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:05.400337 dv-cinder-853315-7-smb devstack@keystone.service[104922]: WARNING py.warnings [None req-487f7262-5a66-42bd-8814-3eda5fdb8237 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:08:05.400337 dv-cinder-853315-7-smb devstack@keystone.service[104922]: warnings.warn(msg) Sep 07 13:08:05.400337 dv-cinder-853315-7-smb devstack@keystone.service[104922]: Sep 07 13:08:05.402021 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f7262-5a66-42bd-8814-3eda5fdb8237 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:05.408673 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 771/1544] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:05.411057 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7f682-c085-40e7-8abd-4b403cbf1039 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.411450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7f682-c085-40e7-8abd-4b403cbf1039 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.411730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7f682-c085-40e7-8abd-4b403cbf1039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.465496 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-05d7f682-c085-40e7-8abd-4b403cbf1039 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:05.468007 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-05d7f682-c085-40e7-8abd-4b403cbf1039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:05.469119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 774/1545] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/users => generated 283 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:05.475576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd41a72-d4c5-4b42-8fa1-b6808edff290 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.475576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd41a72-d4c5-4b42-8fa1-b6808edff290 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.475576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd41a72-d4c5-4b42-8fa1-b6808edff290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.491793 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 772/1546] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:05.498791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cd939-6d4a-4130-8c55-45bdb5e6b8e4 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.500256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cd939-6d4a-4130-8c55-45bdb5e6b8e4 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.501745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cd939-6d4a-4130-8c55-45bdb5e6b8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.531445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-4fd41a72-d4c5-4b42-8fa1-b6808edff290 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:05.536062 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-4fd41a72-d4c5-4b42-8fa1-b6808edff290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:05.566599 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 775/1547] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:05.567929 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c2bea-e348-4daf-9dca-295fa76de1ec None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.568274 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c2bea-e348-4daf-9dca-295fa76de1ec None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.568578 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c2bea-e348-4daf-9dca-295fa76de1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.573902 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-850cd939-6d4a-4130-8c55-45bdb5e6b8e4 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:05.575516 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-850cd939-6d4a-4130-8c55-45bdb5e6b8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:05.584621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 773/1548] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:05.585550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cd939-6d4a-4130-8c55-45bdb5e6b8e4 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:05.600401 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-f55c2bea-e348-4daf-9dca-295fa76de1ec None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:05.601641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f55c2bea-e348-4daf-9dca-295fa76de1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:05.603530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cd939-6d4a-4130-8c55-45bdb5e6b8e4 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:05.610465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b418580-9353-4397-9491-10c566e0503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:05.611524 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b418580-9353-4397-9491-10c566e0503a admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.612019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b418580-9353-4397-9491-10c566e0503a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.612552 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b418580-9353-4397-9491-10c566e0503a admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.613759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b418580-9353-4397-9491-10c566e0503a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:05.614531 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 776/1549] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:05.616099 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b418580-9353-4397-9491-10c566e0503a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:05.623208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e86376-69b0-4084-915b-abf24f77ad1d None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.623908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e86376-69b0-4084-915b-abf24f77ad1d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.624341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e86376-69b0-4084-915b-abf24f77ad1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.639239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 774/1550] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:05.641241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844ffba-d371-4aa3-b7a9-be7c944f4152 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.641651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844ffba-d371-4aa3-b7a9-be7c944f4152 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.642071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844ffba-d371-4aa3-b7a9-be7c944f4152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.650237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-31e86376-69b0-4084-915b-abf24f77ad1d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:05.651719 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-31e86376-69b0-4084-915b-abf24f77ad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:05.667455 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 777/1551] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:05.669197 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-0844ffba-d371-4aa3-b7a9-be7c944f4152 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:05.670273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0844ffba-d371-4aa3-b7a9-be7c944f4152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:05.674138 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b639c72-c81b-49bc-841e-312af1d3bd66 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.674553 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b639c72-c81b-49bc-841e-312af1d3bd66 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.674919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b639c72-c81b-49bc-841e-312af1d3bd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.684399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 775/1552] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:05.686682 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4cdc0-abed-4904-9789-7996562e5198 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.687195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4cdc0-abed-4904-9789-7996562e5198 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.687663 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4cdc0-abed-4904-9789-7996562e5198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.697989 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-9b639c72-c81b-49bc-841e-312af1d3bd66 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:05.699831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9b639c72-c81b-49bc-841e-312af1d3bd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:05.711376 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 778/1553] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:05.712931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b639c72-c81b-49bc-841e-312af1d3bd66 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:05.716688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-17b4cdc0-abed-4904-9789-7996562e5198 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:05.718397 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-17b4cdc0-abed-4904-9789-7996562e5198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:05.726355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b639c72-c81b-49bc-841e-312af1d3bd66 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:05.728622 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 776/1554] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:05.730243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867483f-13e7-4df4-9f5f-b381448c9f28 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.730588 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867483f-13e7-4df4-9f5f-b381448c9f28 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.730851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867483f-13e7-4df4-9f5f-b381448c9f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.734290 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9d7a8-f338-47d9-a937-57c2d8f1b572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:05.735309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9d7a8-f338-47d9-a937-57c2d8f1b572 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.735782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9d7a8-f338-47d9-a937-57c2d8f1b572 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.736254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9d7a8-f338-47d9-a937-57c2d8f1b572 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.737471 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9d7a8-f338-47d9-a937-57c2d8f1b572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:08:05.738694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9d7a8-f338-47d9-a937-57c2d8f1b572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:05.740529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: WARNING py.warnings [None req-6fb9d7a8-f338-47d9-a937-57c2d8f1b572 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:08:05.740529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: warnings.warn(msg) Sep 07 13:08:05.740529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: Sep 07 13:08:05.741645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9d7a8-f338-47d9-a937-57c2d8f1b572 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:05.760003 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 779/1555] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:08:05.763193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbf790-bedd-49d6-9bb7-347615814ef4 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.763193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbf790-bedd-49d6-9bb7-347615814ef4 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.763193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbf790-bedd-49d6-9bb7-347615814ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.771985 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-9867483f-13e7-4df4-9f5f-b381448c9f28 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:05.774160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-9867483f-13e7-4df4-9f5f-b381448c9f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:05.789202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 777/1556] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:05.790451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-9fdbf790-bedd-49d6-9bb7-347615814ef4 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:05.790642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867483f-13e7-4df4-9f5f-b381448c9f28 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:05.791891 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9fdbf790-bedd-49d6-9bb7-347615814ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:05.807933 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867483f-13e7-4df4-9f5f-b381448c9f28 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:05.813851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 780/1557] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:05.814144 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054d4d9-0231-46f9-8200-511151648f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:05.814727 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d4d9-0231-46f9-8200-511151648f96 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.814899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbf790-bedd-49d6-9bb7-347615814ef4 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:05.815067 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d4d9-0231-46f9-8200-511151648f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.815338 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d4d9-0231-46f9-8200-511151648f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.816012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054d4d9-0231-46f9-8200-511151648f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:05.818444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054d4d9-0231-46f9-8200-511151648f96 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:05.827550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbf790-bedd-49d6-9bb7-347615814ef4 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:05.833645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32b7ea-faf7-4633-9873-a8ab84ef7612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:05.834545 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32b7ea-faf7-4633-9873-a8ab84ef7612 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.834783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32b7ea-faf7-4633-9873-a8ab84ef7612 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.835073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32b7ea-faf7-4633-9873-a8ab84ef7612 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.835847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32b7ea-faf7-4633-9873-a8ab84ef7612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:08:05.836212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 778/1558] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:05.836415 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32b7ea-faf7-4633-9873-a8ab84ef7612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:05.838039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f179a-c7a5-4c17-82b3-af79ddbdc21e None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.838415 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f179a-c7a5-4c17-82b3-af79ddbdc21e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.838699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f179a-c7a5-4c17-82b3-af79ddbdc21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.839432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32b7ea-faf7-4633-9873-a8ab84ef7612 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:05.864491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 781/1559] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:08:05.865416 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32b7ea-faf7-4633-9873-a8ab84ef7612 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:05.879345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-407f179a-c7a5-4c17-82b3-af79ddbdc21e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:05.880644 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-407f179a-c7a5-4c17-82b3-af79ddbdc21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:05.883452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32b7ea-faf7-4633-9873-a8ab84ef7612 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:05.890499 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28900647-3c2e-4ca7-88b4-9f099c66b65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:05.891136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28900647-3c2e-4ca7-88b4-9f099c66b65d admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.891416 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28900647-3c2e-4ca7-88b4-9f099c66b65d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.891686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28900647-3c2e-4ca7-88b4-9f099c66b65d admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.892362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28900647-3c2e-4ca7-88b4-9f099c66b65d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:08:05.892677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28900647-3c2e-4ca7-88b4-9f099c66b65d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:05.894405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28900647-3c2e-4ca7-88b4-9f099c66b65d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:05.895359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 779/1560] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:05.897874 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c276-3086-4665-af75-5e07b78c3f93 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.898377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c276-3086-4665-af75-5e07b78c3f93 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.898885 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c276-3086-4665-af75-5e07b78c3f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.914200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 782/1561] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:08:05.915255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28900647-3c2e-4ca7-88b4-9f099c66b65d admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:05.935079 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28900647-3c2e-4ca7-88b4-9f099c66b65d admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:05.936181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-5963c276-3086-4665-af75-5e07b78c3f93 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:05.938396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5963c276-3086-4665-af75-5e07b78c3f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:05.941142 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72251f03-7af4-488b-83e3-50d65827f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:05.941774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72251f03-7af4-488b-83e3-50d65827f1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.942048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72251f03-7af4-488b-83e3-50d65827f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.942317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72251f03-7af4-488b-83e3-50d65827f1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.942960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72251f03-7af4-488b-83e3-50d65827f1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:05.945053 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72251f03-7af4-488b-83e3-50d65827f1a8 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:05.953323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 780/1562] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:05.955390 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aff55c-a2ad-4d65-8eca-5d8c1da3d1ca None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:05.955892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aff55c-a2ad-4d65-8eca-5d8c1da3d1ca None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:05.956498 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aff55c-a2ad-4d65-8eca-5d8c1da3d1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:05.987271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 783/1563] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:05.987271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72251f03-7af4-488b-83e3-50d65827f1a8 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:05.997551 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-34aff55c-a2ad-4d65-8eca-5d8c1da3d1ca None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:05.999750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-34aff55c-a2ad-4d65-8eca-5d8c1da3d1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:06.012148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:06.082296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72251f03-7af4-488b-83e3-50d65827f1a8 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:06.094792 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e077f5-479b-41cb-af67-a2ea5e2979c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:06.095881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e077f5-479b-41cb-af67-a2ea5e2979c9 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:06.097445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e077f5-479b-41cb-af67-a2ea5e2979c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:06.097445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e077f5-479b-41cb-af67-a2ea5e2979c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:06.098101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e077f5-479b-41cb-af67-a2ea5e2979c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:08:06.098671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e077f5-479b-41cb-af67-a2ea5e2979c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:06.102005 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e077f5-479b-41cb-af67-a2ea5e2979c9 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:06.110727 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 781/1564] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:06.111918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aff55c-a2ad-4d65-8eca-5d8c1da3d1ca None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:06.126785 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 784/1565] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:08:06.128438 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e077f5-479b-41cb-af67-a2ea5e2979c9 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:06.133451 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aff55c-a2ad-4d65-8eca-5d8c1da3d1ca None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:06.147612 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1836953-5c9d-4a64-8bcb-be8f240296a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:06.148891 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1836953-5c9d-4a64-8bcb-be8f240296a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:06.149455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1836953-5c9d-4a64-8bcb-be8f240296a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:06.149851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1836953-5c9d-4a64-8bcb-be8f240296a5 admin admin] PATH_INFO: `/v3/projects/e9959e95d8764e1ab320f1d7162443f5/users/1dc2b35bb5bb4e29852eec13bf44a951/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:06.152608 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e077f5-479b-41cb-af67-a2ea5e2979c9 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:06.161073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f527ad-7f4f-4e6e-98bc-8175c869e1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:06.163160 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f527ad-7f4f-4e6e-98bc-8175c869e1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:06.163661 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f527ad-7f4f-4e6e-98bc-8175c869e1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:06.164161 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f527ad-7f4f-4e6e-98bc-8175c869e1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:06.165483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f527ad-7f4f-4e6e-98bc-8175c869e1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:06.169601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f527ad-7f4f-4e6e-98bc-8175c869e1e0 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:06.172969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:06.180916 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1836953-5c9d-4a64-8bcb-be8f240296a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9959e95d8764e1ab320f1d7162443f5, user_id=1dc2b35bb5bb4e29852eec13bf44a951, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:06.183875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: WARNING py.warnings [None req-e1836953-5c9d-4a64-8bcb-be8f240296a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:08:06.183875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: warnings.warn(msg) Sep 07 13:08:06.183875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: Sep 07 13:08:06.188160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1836953-5c9d-4a64-8bcb-be8f240296a5 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:06.214903 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 782/1566] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:06 2022] PUT /identity/v3/projects/e9959e95d8764e1ab320f1d7162443f5/users/1dc2b35bb5bb4e29852eec13bf44a951/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:06.217007 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1836953-5c9d-4a64-8bcb-be8f240296a5 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:06.224835 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 785/1567] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:06 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:06.226031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f527ad-7f4f-4e6e-98bc-8175c869e1e0 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:06.338103 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f527ad-7f4f-4e6e-98bc-8175c869e1e0 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:06.340733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1836953-5c9d-4a64-8bcb-be8f240296a5 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:06.346642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832924e5-e1e4-43aa-a547-7d82f89d130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:06.347632 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832924e5-e1e4-43aa-a547-7d82f89d130a admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:06.348075 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832924e5-e1e4-43aa-a547-7d82f89d130a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:06.348573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241ed90-5c9c-44e3-846f-c2f7d8dfea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:06.348798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832924e5-e1e4-43aa-a547-7d82f89d130a admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:06.349623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241ed90-5c9c-44e3-846f-c2f7d8dfea2d admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:06.349850 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832924e5-e1e4-43aa-a547-7d82f89d130a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:06.350103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241ed90-5c9c-44e3-846f-c2f7d8dfea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:06.350572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241ed90-5c9c-44e3-846f-c2f7d8dfea2d admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:06.351775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241ed90-5c9c-44e3-846f-c2f7d8dfea2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:08:06.352299 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241ed90-5c9c-44e3-846f-c2f7d8dfea2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:06.353305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832924e5-e1e4-43aa-a547-7d82f89d130a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:06.355458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241ed90-5c9c-44e3-846f-c2f7d8dfea2d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:06.379757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 783/1568] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:08:06.381614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241ed90-5c9c-44e3-846f-c2f7d8dfea2d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:06.399316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241ed90-5c9c-44e3-846f-c2f7d8dfea2d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:06.407387 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf60237-f0ac-4f4f-8dd4-7dc798302a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:06.408593 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf60237-f0ac-4f4f-8dd4-7dc798302a8d admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:06.409094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf60237-f0ac-4f4f-8dd4-7dc798302a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:06.409582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf60237-f0ac-4f4f-8dd4-7dc798302a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:06.410920 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf60237-f0ac-4f4f-8dd4-7dc798302a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:08:06.411481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf60237-f0ac-4f4f-8dd4-7dc798302a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:06.412458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 786/1569] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:06 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:06.417477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832924e5-e1e4-43aa-a547-7d82f89d130a admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:06.417666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf60237-f0ac-4f4f-8dd4-7dc798302a8d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:06.443206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 784/1570] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:08:06.444806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf60237-f0ac-4f4f-8dd4-7dc798302a8d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:06.471968 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf60237-f0ac-4f4f-8dd4-7dc798302a8d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:06.555860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832924e5-e1e4-43aa-a547-7d82f89d130a admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:06.567176 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399da99-f605-4963-914d-bfe12342ba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:06.568233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399da99-f605-4963-914d-bfe12342ba3f admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:06.568773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399da99-f605-4963-914d-bfe12342ba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:06.569251 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399da99-f605-4963-914d-bfe12342ba3f admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:06.570448 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399da99-f605-4963-914d-bfe12342ba3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:06.574466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399da99-f605-4963-914d-bfe12342ba3f admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:06.590997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40499161-cd68-47a9-985c-dd4f879f94cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:06.591687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40499161-cd68-47a9-985c-dd4f879f94cc admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:06.591982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40499161-cd68-47a9-985c-dd4f879f94cc admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:06.592229 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40499161-cd68-47a9-985c-dd4f879f94cc admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:06.593111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40499161-cd68-47a9-985c-dd4f879f94cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:08:06.593432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40499161-cd68-47a9-985c-dd4f879f94cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:06.595616 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40499161-cd68-47a9-985c-dd4f879f94cc admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:06.617736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 785/1571] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:08:06.618760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40499161-cd68-47a9-985c-dd4f879f94cc admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:06.630441 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 787/1572] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:06 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:06.631862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40499161-cd68-47a9-985c-dd4f879f94cc admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:06.632267 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399da99-f605-4963-914d-bfe12342ba3f admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:06.642041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bca16-11ab-4300-bfb0-cc2b1e0ad4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:06.642913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bca16-11ab-4300-bfb0-cc2b1e0ad4bf admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:06.643179 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bca16-11ab-4300-bfb0-cc2b1e0ad4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:06.643444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bca16-11ab-4300-bfb0-cc2b1e0ad4bf admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:06.644069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:06.644263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bca16-11ab-4300-bfb0-cc2b1e0ad4bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:06.646026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: WARNING py.warnings [None req-d16bca16-11ab-4300-bfb0-cc2b1e0ad4bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:08:06.646026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: warnings.warn(msg) Sep 07 13:08:06.646026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: Sep 07 13:08:06.648492 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bca16-11ab-4300-bfb0-cc2b1e0ad4bf admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:06.652364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399da99-f605-4963-914d-bfe12342ba3f admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:06.665740 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60372238-2fa2-4c63-b4cc-4d50d27c2f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:06.667263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60372238-2fa2-4c63-b4cc-4d50d27c2f5e admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:06.668420 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60372238-2fa2-4c63-b4cc-4d50d27c2f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:06.669006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60372238-2fa2-4c63-b4cc-4d50d27c2f5e admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:06.670796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60372238-2fa2-4c63-b4cc-4d50d27c2f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:06.674489 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60372238-2fa2-4c63-b4cc-4d50d27c2f5e admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:06.696588 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 786/1573] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:06 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:06.700430 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20938809-20f2-49b8-98ab-222841bf8808 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:06.700940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20938809-20f2-49b8-98ab-222841bf8808 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:06.701478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20938809-20f2-49b8-98ab-222841bf8808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:06.717707 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 788/1574] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:06 2022] POST /identity/v3/users => generated 284 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:06.718341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60372238-2fa2-4c63-b4cc-4d50d27c2f5e admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:06.734321 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60372238-2fa2-4c63-b4cc-4d50d27c2f5e admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:06.760845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-20938809-20f2-49b8-98ab-222841bf8808 None None] MFA Rules not processed for user `1dc2b35bb5bb4e29852eec13bf44a951`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:06.764053 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-20938809-20f2-49b8-98ab-222841bf8808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:06.821766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b518764-3791-45d2-ad2d-42c2e2a680dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:06.822390 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b518764-3791-45d2-ad2d-42c2e2a680dd admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:06.822666 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b518764-3791-45d2-ad2d-42c2e2a680dd admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:06.822934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b518764-3791-45d2-ad2d-42c2e2a680dd admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:06.823583 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b518764-3791-45d2-ad2d-42c2e2a680dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:06.825989 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b518764-3791-45d2-ad2d-42c2e2a680dd admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:06.826763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:06.871614 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 789/1575] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:06 2022] POST /identity/v3/projects => generated 393 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:06.872805 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b518764-3791-45d2-ad2d-42c2e2a680dd admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:06.896297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 787/1576] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:06.897879 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20938809-20f2-49b8-98ab-222841bf8808 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:06.915269 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20938809-20f2-49b8-98ab-222841bf8808 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.002136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b518764-3791-45d2-ad2d-42c2e2a680dd admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.020443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d720c-3b5d-448d-885d-24fd5b40c606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.021305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d720c-3b5d-448d-885d-24fd5b40c606 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.021688 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d720c-3b5d-448d-885d-24fd5b40c606 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.021937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de6cf-88f7-4414-b3a5-d3e5287d6c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.022127 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d720c-3b5d-448d-885d-24fd5b40c606 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.022650 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de6cf-88f7-4414-b3a5-d3e5287d6c50 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.023049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d720c-3b5d-448d-885d-24fd5b40c606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.023241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de6cf-88f7-4414-b3a5-d3e5287d6c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.023396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de6cf-88f7-4414-b3a5-d3e5287d6c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.023999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9de6cf-88f7-4414-b3a5-d3e5287d6c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.025465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d720c-3b5d-448d-885d-24fd5b40c606 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.026229 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9de6cf-88f7-4414-b3a5-d3e5287d6c50 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.058836 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 790/1577] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:06 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:07.059717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d720c-3b5d-448d-885d-24fd5b40c606 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.071857 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d720c-3b5d-448d-885d-24fd5b40c606 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.076607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 788/1578] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:06 2022] POST /identity/v3/projects => generated 401 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:07.078159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de6cf-88f7-4414-b3a5-d3e5287d6c50 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.078511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2daac6-4ebc-47be-8514-ffc690fd8fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.079166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2daac6-4ebc-47be-8514-ffc690fd8fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.079543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2daac6-4ebc-47be-8514-ffc690fd8fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.079823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2daac6-4ebc-47be-8514-ffc690fd8fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.080516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2daac6-4ebc-47be-8514-ffc690fd8fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.082533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2daac6-4ebc-47be-8514-ffc690fd8fd8 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.132076 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 791/1579] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:07 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:07.133686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2daac6-4ebc-47be-8514-ffc690fd8fd8 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.215162 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de6cf-88f7-4414-b3a5-d3e5287d6c50 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.241015 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:07.294063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2daac6-4ebc-47be-8514-ffc690fd8fd8 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.309889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22a99c-24e9-439e-a49d-c660341efc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.311196 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22a99c-24e9-439e-a49d-c660341efc76 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.311778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22a99c-24e9-439e-a49d-c660341efc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.312178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22a99c-24e9-439e-a49d-c660341efc76 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.313613 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22a99c-24e9-439e-a49d-c660341efc76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.317548 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22a99c-24e9-439e-a49d-c660341efc76 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.375039 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 792/1580] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:07 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:07.375039 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22a99c-24e9-439e-a49d-c660341efc76 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.387833 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb3d2c-5000-4f0c-88b4-aa81d53f389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.388959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb3d2c-5000-4f0c-88b4-aa81d53f389e admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.389410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb3d2c-5000-4f0c-88b4-aa81d53f389e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.389818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb3d2c-5000-4f0c-88b4-aa81d53f389e admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.390880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb3d2c-5000-4f0c-88b4-aa81d53f389e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.391375 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22a99c-24e9-439e-a49d-c660341efc76 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.393712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb3d2c-5000-4f0c-88b4-aa81d53f389e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.399349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923609d-c0cc-4fb8-a05d-ea56e1a91057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.400309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923609d-c0cc-4fb8-a05d-ea56e1a91057 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.400730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923609d-c0cc-4fb8-a05d-ea56e1a91057 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.401213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923609d-c0cc-4fb8-a05d-ea56e1a91057 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.402467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923609d-c0cc-4fb8-a05d-ea56e1a91057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.405038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923609d-c0cc-4fb8-a05d-ea56e1a91057 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.405492 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:07.417138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 789/1581] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:07.420498 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb3d2c-5000-4f0c-88b4-aa81d53f389e admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.427190 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 793/1582] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:07.429684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923609d-c0cc-4fb8-a05d-ea56e1a91057 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.436215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb3d2c-5000-4f0c-88b4-aa81d53f389e admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.445714 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7208bd-60e6-4a74-bfdb-2f3f76ea8849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.446720 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7208bd-60e6-4a74-bfdb-2f3f76ea8849 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.447317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7208bd-60e6-4a74-bfdb-2f3f76ea8849 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.447642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7208bd-60e6-4a74-bfdb-2f3f76ea8849 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.448599 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7208bd-60e6-4a74-bfdb-2f3f76ea8849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.451925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7208bd-60e6-4a74-bfdb-2f3f76ea8849 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.490049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 790/1583] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:07 2022] POST /identity/v3/users => generated 297 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:07.492116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7208bd-60e6-4a74-bfdb-2f3f76ea8849 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.515195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7208bd-60e6-4a74-bfdb-2f3f76ea8849 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.523634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4c79a-7001-4d34-a540-db15ccf0003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.524765 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4c79a-7001-4d34-a540-db15ccf0003c admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.525245 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4c79a-7001-4d34-a540-db15ccf0003c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.525717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4c79a-7001-4d34-a540-db15ccf0003c admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.526949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4c79a-7001-4d34-a540-db15ccf0003c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.530097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4c79a-7001-4d34-a540-db15ccf0003c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.541868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923609d-c0cc-4fb8-a05d-ea56e1a91057 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.548222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f9232-475e-4cdd-82f1-4b71d8b9ab0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.549158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f9232-475e-4cdd-82f1-4b71d8b9ab0a service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.549563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f9232-475e-4cdd-82f1-4b71d8b9ab0a service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.549979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f9232-475e-4cdd-82f1-4b71d8b9ab0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.552495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 791/1584] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:07.554042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4c79a-7001-4d34-a540-db15ccf0003c admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.572951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4c79a-7001-4d34-a540-db15ccf0003c admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.581406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445c61f-5b80-4a50-a694-61a30e307e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.582436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445c61f-5b80-4a50-a694-61a30e307e2c admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.582913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445c61f-5b80-4a50-a694-61a30e307e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.583395 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445c61f-5b80-4a50-a694-61a30e307e2c admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.584650 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445c61f-5b80-4a50-a694-61a30e307e2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.590537 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445c61f-5b80-4a50-a694-61a30e307e2c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.628440 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 792/1585] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:07 2022] POST /identity/v3/users => generated 301 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:07.629883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445c61f-5b80-4a50-a694-61a30e307e2c admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.648465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445c61f-5b80-4a50-a694-61a30e307e2c admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.656604 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7d6cc-d5e6-4ae6-a18f-2b3624092665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.657560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7d6cc-d5e6-4ae6-a18f-2b3624092665 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.657941 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7d6cc-d5e6-4ae6-a18f-2b3624092665 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.658343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7d6cc-d5e6-4ae6-a18f-2b3624092665 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.659347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7d6cc-d5e6-4ae6-a18f-2b3624092665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.661851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7d6cc-d5e6-4ae6-a18f-2b3624092665 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.677474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f9232-475e-4cdd-82f1-4b71d8b9ab0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.680288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f9232-475e-4cdd-82f1-4b71d8b9ab0a service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.697195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 793/1586] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:07 2022] POST /identity/v3/users => generated 294 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:07.699196 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7d6cc-d5e6-4ae6-a18f-2b3624092665 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.699750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 794/1587] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:07.701333 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f9232-475e-4cdd-82f1-4b71d8b9ab0a service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.719313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7d6cc-d5e6-4ae6-a18f-2b3624092665 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.722568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f9232-475e-4cdd-82f1-4b71d8b9ab0a service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.730495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b5f3a-d71f-4449-a6d0-911edf1d2480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.733527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b5f3a-d71f-4449-a6d0-911edf1d2480 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.734114 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b5f3a-d71f-4449-a6d0-911edf1d2480 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.734477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b5f3a-d71f-4449-a6d0-911edf1d2480 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.735725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b5f3a-d71f-4449-a6d0-911edf1d2480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.737721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79883a76-f4b3-4f91-8d60-200f344f255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.738718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79883a76-f4b3-4f91-8d60-200f344f255b admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.739111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79883a76-f4b3-4f91-8d60-200f344f255b admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.739478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b5f3a-d71f-4449-a6d0-911edf1d2480 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.739644 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79883a76-f4b3-4f91-8d60-200f344f255b admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.741811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79883a76-f4b3-4f91-8d60-200f344f255b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.753241 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79883a76-f4b3-4f91-8d60-200f344f255b admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.768239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 794/1588] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:07.776739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 795/1589] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:07.778403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79883a76-f4b3-4f91-8d60-200f344f255b admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.779697 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b5f3a-d71f-4449-a6d0-911edf1d2480 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.804517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79883a76-f4b3-4f91-8d60-200f344f255b admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.814328 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff0c71-9dd5-443d-a27b-c6df6c37b6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.815626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff0c71-9dd5-443d-a27b-c6df6c37b6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.816115 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff0c71-9dd5-443d-a27b-c6df6c37b6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.816676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff0c71-9dd5-443d-a27b-c6df6c37b6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.817531 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff0c71-9dd5-443d-a27b-c6df6c37b6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.819441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b5f3a-d71f-4449-a6d0-911edf1d2480 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.820160 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff0c71-9dd5-443d-a27b-c6df6c37b6e4 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.828185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8c0dc-e9a0-4623-afeb-4b35343a8d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.828185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8c0dc-e9a0-4623-afeb-4b35343a8d51 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.831270 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8c0dc-e9a0-4623-afeb-4b35343a8d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.831270 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8c0dc-e9a0-4623-afeb-4b35343a8d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.831270 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8c0dc-e9a0-4623-afeb-4b35343a8d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.834176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8c0dc-e9a0-4623-afeb-4b35343a8d51 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.836681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 796/1590] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:07.837798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff0c71-9dd5-443d-a27b-c6df6c37b6e4 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.858393 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 795/1591] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:07.859547 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8c0dc-e9a0-4623-afeb-4b35343a8d51 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.864539 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff0c71-9dd5-443d-a27b-c6df6c37b6e4 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.873753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1f5f3-03d9-4a30-b761-befdabe37791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.875183 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1f5f3-03d9-4a30-b761-befdabe37791 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.875805 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1f5f3-03d9-4a30-b761-befdabe37791 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.876491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1f5f3-03d9-4a30-b761-befdabe37791 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.877833 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1f5f3-03d9-4a30-b761-befdabe37791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.879603 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8c0dc-e9a0-4623-afeb-4b35343a8d51 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.881779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1f5f3-03d9-4a30-b761-befdabe37791 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.889727 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f92fa-0712-475e-84d7-d73def64982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.890804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f92fa-0712-475e-84d7-d73def64982c admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.891324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f92fa-0712-475e-84d7-d73def64982c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.891857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f92fa-0712-475e-84d7-d73def64982c admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.893311 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f92fa-0712-475e-84d7-d73def64982c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.896566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f92fa-0712-475e-84d7-d73def64982c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.903468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 797/1592] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:07.904462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1f5f3-03d9-4a30-b761-befdabe37791 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.918328 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 796/1593] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:07.919442 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1f5f3-03d9-4a30-b761-befdabe37791 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.919961 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f92fa-0712-475e-84d7-d73def64982c admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.932147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c1d0a-5353-43db-b42d-eb77a161cb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.933944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c1d0a-5353-43db-b42d-eb77a161cb51 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.933944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c1d0a-5353-43db-b42d-eb77a161cb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.934118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c1d0a-5353-43db-b42d-eb77a161cb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.935385 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c1d0a-5353-43db-b42d-eb77a161cb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.936718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f92fa-0712-475e-84d7-d73def64982c admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.939294 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c1d0a-5353-43db-b42d-eb77a161cb51 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.944087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df43ff6-4dd2-4a62-9afe-bddd5fd797e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.944847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df43ff6-4dd2-4a62-9afe-bddd5fd797e9 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.945303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df43ff6-4dd2-4a62-9afe-bddd5fd797e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.946081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df43ff6-4dd2-4a62-9afe-bddd5fd797e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.946845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df43ff6-4dd2-4a62-9afe-bddd5fd797e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:07.949912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df43ff6-4dd2-4a62-9afe-bddd5fd797e9 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:07.954032 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 798/1594] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:07.954742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c1d0a-5353-43db-b42d-eb77a161cb51 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.966628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c1d0a-5353-43db-b42d-eb77a161cb51 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:07.974384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8749aa-217f-40d3-9231-febe41e1ca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:07.975138 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8749aa-217f-40d3-9231-febe41e1ca14 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:07.975423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8749aa-217f-40d3-9231-febe41e1ca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:07.975733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8749aa-217f-40d3-9231-febe41e1ca14 admin admin] PATH_INFO: `/v3/projects/aed8f376841e4b9dbc897f98321afc94/users/577fa8e1211f4c16a7092b127c63ff23/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:07.983077 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 797/1595] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:07.983077 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df43ff6-4dd2-4a62-9afe-bddd5fd797e9 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.999157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8749aa-217f-40d3-9231-febe41e1ca14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed8f376841e4b9dbc897f98321afc94, user_id=577fa8e1211f4c16a7092b127c63ff23, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:08.001532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df43ff6-4dd2-4a62-9afe-bddd5fd797e9 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:08.002293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8749aa-217f-40d3-9231-febe41e1ca14 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:08.010167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348321d-d71d-48dd-a71b-054cfa8201a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:08.011258 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348321d-d71d-48dd-a71b-054cfa8201a1 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:08.011605 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348321d-d71d-48dd-a71b-054cfa8201a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:08.011938 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348321d-d71d-48dd-a71b-054cfa8201a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:08.012726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348321d-d71d-48dd-a71b-054cfa8201a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:08.014547 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348321d-d71d-48dd-a71b-054cfa8201a1 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:08.024555 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 799/1596] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:07 2022] PUT /identity/v3/projects/aed8f376841e4b9dbc897f98321afc94/users/577fa8e1211f4c16a7092b127c63ff23/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:08.026083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8749aa-217f-40d3-9231-febe41e1ca14 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:08.039346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:08.047253 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 798/1597] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:08.047253 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348321d-d71d-48dd-a71b-054cfa8201a1 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:08.066695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348321d-d71d-48dd-a71b-054cfa8201a1 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:08.160489 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e1303-99ec-4f6f-8847-127137620bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:08.161635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8749aa-217f-40d3-9231-febe41e1ca14 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:08.161856 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1303-99ec-4f6f-8847-127137620bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:08.162318 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1303-99ec-4f6f-8847-127137620bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:08.162883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1303-99ec-4f6f-8847-127137620bd3 admin admin] PATH_INFO: `/v3/projects/baa7b28b556e451e9e3270cede39723e/users/78c8e5fe62e643ec8a90fb936bd1937c/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:08.166891 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6e6e2-421f-4fda-8bc5-a27507cbd014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:08.167790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6e6e2-421f-4fda-8bc5-a27507cbd014 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:08.168105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6e6e2-421f-4fda-8bc5-a27507cbd014 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:08.168359 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6e6e2-421f-4fda-8bc5-a27507cbd014 admin admin] PATH_INFO: `/v3/projects/a817dcb50fff40e8b550c41401e88aac/users/4b60d8c353ae4d4f86126abb3e930f88/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:08.190512 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6e6e2-421f-4fda-8bc5-a27507cbd014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a817dcb50fff40e8b550c41401e88aac, user_id=4b60d8c353ae4d4f86126abb3e930f88, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:08.194598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e1303-99ec-4f6f-8847-127137620bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa7b28b556e451e9e3270cede39723e, user_id=78c8e5fe62e643ec8a90fb936bd1937c, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:08.195051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6e6e2-421f-4fda-8bc5-a27507cbd014 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:08.200600 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e1303-99ec-4f6f-8847-127137620bd3 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:08.218663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 800/1598] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:08 2022] PUT /identity/v3/projects/a817dcb50fff40e8b550c41401e88aac/users/4b60d8c353ae4d4f86126abb3e930f88/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:08.219605 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6e6e2-421f-4fda-8bc5-a27507cbd014 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:08.227520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 799/1599] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:08 2022] PUT /identity/v3/projects/baa7b28b556e451e9e3270cede39723e/users/78c8e5fe62e643ec8a90fb936bd1937c/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:08.228804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e1303-99ec-4f6f-8847-127137620bd3 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:08.281492 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:08.347209 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e1303-99ec-4f6f-8847-127137620bd3 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:08.354968 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d6425-a925-481a-8baa-f3468ec63823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:08.355928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d6425-a925-481a-8baa-f3468ec63823 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:08.356405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d6425-a925-481a-8baa-f3468ec63823 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:08.356866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d6425-a925-481a-8baa-f3468ec63823 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:08.358029 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d6425-a925-481a-8baa-f3468ec63823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:08.360744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d6425-a925-481a-8baa-f3468ec63823 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:08.365341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6e6e2-421f-4fda-8bc5-a27507cbd014 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:08.375593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73636505-2398-460c-91a9-83a43f32ca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:08.376856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73636505-2398-460c-91a9-83a43f32ca8d admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:08.377424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73636505-2398-460c-91a9-83a43f32ca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:08.379523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73636505-2398-460c-91a9-83a43f32ca8d admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:08.379523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73636505-2398-460c-91a9-83a43f32ca8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:08.380447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 800/1600] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:08.381559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d6425-a925-481a-8baa-f3468ec63823 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:08.384137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73636505-2398-460c-91a9-83a43f32ca8d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:08.398347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d6425-a925-481a-8baa-f3468ec63823 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:08.403420 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e0dca-47d7-4bbf-be1c-7886b6426eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:08.404403 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e0dca-47d7-4bbf-be1c-7886b6426eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:08.404760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e0dca-47d7-4bbf-be1c-7886b6426eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:08.404929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e0dca-47d7-4bbf-be1c-7886b6426eb7 admin admin] PATH_INFO: `/v3/projects/c3e6fec42449479ba4d4e990bba3cf45/users/8ec856149d154f3d91feb0a010006d3a/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:08.407673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 801/1601] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:08.410224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6faf8-1a38-4669-89c6-64a90804d1cb None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:08.410700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6faf8-1a38-4669-89c6-64a90804d1cb None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:08.411174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6faf8-1a38-4669-89c6-64a90804d1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:08.433924 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e0dca-47d7-4bbf-be1c-7886b6426eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e6fec42449479ba4d4e990bba3cf45, user_id=8ec856149d154f3d91feb0a010006d3a, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:08.438367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e0dca-47d7-4bbf-be1c-7886b6426eb7 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:08.461592 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-51e6faf8-1a38-4669-89c6-64a90804d1cb None None] MFA Rules not processed for user `577fa8e1211f4c16a7092b127c63ff23`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:08.463375 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-51e6faf8-1a38-4669-89c6-64a90804d1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:08.466946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 801/1602] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:08 2022] PUT /identity/v3/projects/c3e6fec42449479ba4d4e990bba3cf45/users/8ec856149d154f3d91feb0a010006d3a/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:08.468265 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e0dca-47d7-4bbf-be1c-7886b6426eb7 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:08.616451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 802/1603] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:08.616451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161195a3-4252-4de3-ac4f-3d855edcd99f None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:08.617469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161195a3-4252-4de3-ac4f-3d855edcd99f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:08.618413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161195a3-4252-4de3-ac4f-3d855edcd99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:08.622669 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e0dca-47d7-4bbf-be1c-7886b6426eb7 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:08.632557 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52245291-634f-4936-8840-f948368e99d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:08.633638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52245291-634f-4936-8840-f948368e99d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:08.634102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52245291-634f-4936-8840-f948368e99d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:08.634559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52245291-634f-4936-8840-f948368e99d5 admin admin] PATH_INFO: `/v3/projects/3b6c1bec29b942eb938592a894917a38/users/a48139e448064f27bb93baea83ae6697/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:08.673668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-161195a3-4252-4de3-ac4f-3d855edcd99f None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:08.676483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-161195a3-4252-4de3-ac4f-3d855edcd99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:08.684394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52245291-634f-4936-8840-f948368e99d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6c1bec29b942eb938592a894917a38, user_id=a48139e448064f27bb93baea83ae6697, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:08.688206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52245291-634f-4936-8840-f948368e99d5 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:08.695330 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 803/1604] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:08.706482 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8adb3-3fc7-4ba2-a362-6c699bc017c2 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:08.707061 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8adb3-3fc7-4ba2-a362-6c699bc017c2 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:08.707715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8adb3-3fc7-4ba2-a362-6c699bc017c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:08.740570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 802/1605] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:08 2022] PUT /identity/v3/projects/3b6c1bec29b942eb938592a894917a38/users/a48139e448064f27bb93baea83ae6697/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:08.742213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52245291-634f-4936-8840-f948368e99d5 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:08.744443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:08.772892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-aeb8adb3-3fc7-4ba2-a362-6c699bc017c2 None None] MFA Rules not processed for user `4b60d8c353ae4d4f86126abb3e930f88`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:08.774122 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-aeb8adb3-3fc7-4ba2-a362-6c699bc017c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:08.859128 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52245291-634f-4936-8840-f948368e99d5 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:08.865193 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba21785-22d1-4a49-8c89-56e8f6964328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:08.866202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba21785-22d1-4a49-8c89-56e8f6964328 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:08.866654 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba21785-22d1-4a49-8c89-56e8f6964328 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:08.867096 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba21785-22d1-4a49-8c89-56e8f6964328 admin admin] PATH_INFO: `/v3/projects/3e5908d5dcbd423784262d5fddaf00f0/users/e4a0c3740593402c955abe8ce23640c4/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:08.898188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba21785-22d1-4a49-8c89-56e8f6964328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5908d5dcbd423784262d5fddaf00f0, user_id=e4a0c3740593402c955abe8ce23640c4, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:08.898401 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 804/1606] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:08.902008 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba21785-22d1-4a49-8c89-56e8f6964328 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:08.902893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8adb3-3fc7-4ba2-a362-6c699bc017c2 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:08.928558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8adb3-3fc7-4ba2-a362-6c699bc017c2 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:08.943280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 803/1607] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:08 2022] PUT /identity/v3/projects/3e5908d5dcbd423784262d5fddaf00f0/users/e4a0c3740593402c955abe8ce23640c4/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:08.945586 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f7ac2-43cf-492c-be8c-0ec9c27529bb None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:08.946103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f7ac2-43cf-492c-be8c-0ec9c27529bb None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:08.946579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f7ac2-43cf-492c-be8c-0ec9c27529bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:08.972616 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:09.024259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-617f7ac2-43cf-492c-be8c-0ec9c27529bb None None] MFA Rules not processed for user `8ec856149d154f3d91feb0a010006d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:09.026340 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-617f7ac2-43cf-492c-be8c-0ec9c27529bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:09.041906 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7353dc-7a95-4474-9dbf-4c6715b93b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:09.042533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7353dc-7a95-4474-9dbf-4c6715b93b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:09.042997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7353dc-7a95-4474-9dbf-4c6715b93b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:09.043681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7353dc-7a95-4474-9dbf-4c6715b93b8b admin admin] PATH_INFO: `/v3/projects/38219520d703492994d218440c44db54/users/db205097b4fc4424b912ae5004ed1ba2/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:09.074026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7353dc-7a95-4474-9dbf-4c6715b93b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38219520d703492994d218440c44db54, user_id=db205097b4fc4424b912ae5004ed1ba2, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:09.079458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7353dc-7a95-4474-9dbf-4c6715b93b8b admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:09.104587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 805/1608] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:08 2022] PUT /identity/v3/projects/38219520d703492994d218440c44db54/users/db205097b4fc4424b912ae5004ed1ba2/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:09.105993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7353dc-7a95-4474-9dbf-4c6715b93b8b admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:09.163323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 804/1609] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:09.165670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f7ac2-43cf-492c-be8c-0ec9c27529bb None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:09.238354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7353dc-7a95-4474-9dbf-4c6715b93b8b admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:09.245446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047fd48-3da9-45cd-b3ed-dfd824205ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:09.246410 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047fd48-3da9-45cd-b3ed-dfd824205ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:09.246882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047fd48-3da9-45cd-b3ed-dfd824205ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:09.247962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047fd48-3da9-45cd-b3ed-dfd824205ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:09.248451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047fd48-3da9-45cd-b3ed-dfd824205ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:09.251956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047fd48-3da9-45cd-b3ed-dfd824205ed8 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:09.280660 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f7ac2-43cf-492c-be8c-0ec9c27529bb None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:09.313703 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 806/1610] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:09 2022] POST /identity/v3/projects => generated 363 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:09.315754 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e20f62-37ef-4217-a2dd-3964da554fc3 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:09.316209 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e20f62-37ef-4217-a2dd-3964da554fc3 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:09.316689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e20f62-37ef-4217-a2dd-3964da554fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:09.330114 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:09.349969 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-02e20f62-37ef-4217-a2dd-3964da554fc3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:09.351967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-02e20f62-37ef-4217-a2dd-3964da554fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:09.363308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fe972-9206-4115-ade7-c5afa4037132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:09.364087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fe972-9206-4115-ade7-c5afa4037132 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:09.364500 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fe972-9206-4115-ade7-c5afa4037132 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:09.364880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fe972-9206-4115-ade7-c5afa4037132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:09.376752 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fe972-9206-4115-ade7-c5afa4037132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:09.378398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fe972-9206-4115-ade7-c5afa4037132 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:09.389982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 805/1611] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:09.390842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fe972-9206-4115-ade7-c5afa4037132 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:09.401064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fe972-9206-4115-ade7-c5afa4037132 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:09.443908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 807/1612] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:09.447516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5efed6-0857-4c3f-b8ba-9f748c4d32c5 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:09.447516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5efed6-0857-4c3f-b8ba-9f748c4d32c5 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:09.447516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5efed6-0857-4c3f-b8ba-9f748c4d32c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:09.467998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-cd5efed6-0857-4c3f-b8ba-9f748c4d32c5 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:09.469428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-cd5efed6-0857-4c3f-b8ba-9f748c4d32c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:09.484464 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 808/1613] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:09.484464 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f91b3-21f8-4ec6-958c-428e00f7b4d0 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:09.484464 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f91b3-21f8-4ec6-958c-428e00f7b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:09.484464 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f91b3-21f8-4ec6-958c-428e00f7b4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:09.485237 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:09.511819 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775b0b0-bc1c-463b-bc4f-d750705cc454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:09.512102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-129f91b3-21f8-4ec6-958c-428e00f7b4d0 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:09.512556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775b0b0-bc1c-463b-bc4f-d750705cc454 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:09.512918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775b0b0-bc1c-463b-bc4f-d750705cc454 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:09.513202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775b0b0-bc1c-463b-bc4f-d750705cc454 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:09.513904 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775b0b0-bc1c-463b-bc4f-d750705cc454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:09.514073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-129f91b3-21f8-4ec6-958c-428e00f7b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:09.516668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775b0b0-bc1c-463b-bc4f-d750705cc454 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:09.526264 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 809/1614] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:09.527778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f91b3-21f8-4ec6-958c-428e00f7b4d0 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:09.544967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f91b3-21f8-4ec6-958c-428e00f7b4d0 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:09.558392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110de813-e1e3-4d27-ab87-939958c299c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:09.558782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110de813-e1e3-4d27-ab87-939958c299c0 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:09.558782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110de813-e1e3-4d27-ab87-939958c299c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:09.559432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110de813-e1e3-4d27-ab87-939958c299c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:09.560126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110de813-e1e3-4d27-ab87-939958c299c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:09.562166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110de813-e1e3-4d27-ab87-939958c299c0 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:09.565042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 806/1615] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:09 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:09.566122 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775b0b0-bc1c-463b-bc4f-d750705cc454 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:09.596324 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 810/1616] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:09 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:09.597698 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110de813-e1e3-4d27-ab87-939958c299c0 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:09.650761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775b0b0-bc1c-463b-bc4f-d750705cc454 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:09.689681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110de813-e1e3-4d27-ab87-939958c299c0 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:09.697987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc2500-4ab7-4c76-b465-c1c6a77d9ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:09.699177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc2500-4ab7-4c76-b465-c1c6a77d9ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:09.699177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc2500-4ab7-4c76-b465-c1c6a77d9ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:09.699430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc2500-4ab7-4c76-b465-c1c6a77d9ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:09.757776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f467a7-c3c2-4b4a-9c54-3dfe9d21a2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:09.758996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f467a7-c3c2-4b4a-9c54-3dfe9d21a2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:09.759139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f467a7-c3c2-4b4a-9c54-3dfe9d21a2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:09.759567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f467a7-c3c2-4b4a-9c54-3dfe9d21a2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:09.760514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f467a7-c3c2-4b4a-9c54-3dfe9d21a2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:09.763723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f467a7-c3c2-4b4a-9c54-3dfe9d21a2d8 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:09.799163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 807/1617] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:09 2022] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:09.800219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f467a7-c3c2-4b4a-9c54-3dfe9d21a2d8 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:09.817713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f467a7-c3c2-4b4a-9c54-3dfe9d21a2d8 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:09.818760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc2500-4ab7-4c76-b465-c1c6a77d9ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:09.822539 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc2500-4ab7-4c76-b465-c1c6a77d9ba8 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:09.836759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faba1f-8092-484f-820c-da548ca80b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:09.836759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faba1f-8092-484f-820c-da548ca80b45 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:09.836759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faba1f-8092-484f-820c-da548ca80b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:09.836759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faba1f-8092-484f-820c-da548ca80b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:09.841992 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 811/1618] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:09.843641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc2500-4ab7-4c76-b465-c1c6a77d9ba8 service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:09.854777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faba1f-8092-484f-820c-da548ca80b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:09.858343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faba1f-8092-484f-820c-da548ca80b45 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:09.859751 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc2500-4ab7-4c76-b465-c1c6a77d9ba8 service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:09.865919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac72e90-dedc-4a17-aeae-6f068469b8fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:09.866735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac72e90-dedc-4a17-aeae-6f068469b8fa service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:09.867726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac72e90-dedc-4a17-aeae-6f068469b8fa service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:09.867726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac72e90-dedc-4a17-aeae-6f068469b8fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:09.873818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 808/1619] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:09.875361 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faba1f-8092-484f-820c-da548ca80b45 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:09.889178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac72e90-dedc-4a17-aeae-6f068469b8fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:09.891966 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac72e90-dedc-4a17-aeae-6f068469b8fa service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:09.893081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faba1f-8092-484f-820c-da548ca80b45 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:09.903400 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090a83a-9c0b-49c3-adfe-511cea87617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:09.904593 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090a83a-9c0b-49c3-adfe-511cea87617d admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:09.905086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090a83a-9c0b-49c3-adfe-511cea87617d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:09.906014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090a83a-9c0b-49c3-adfe-511cea87617d admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:09.907689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090a83a-9c0b-49c3-adfe-511cea87617d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:09.908995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 812/1620] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:09.910014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac72e90-dedc-4a17-aeae-6f068469b8fa service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:09.913190 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090a83a-9c0b-49c3-adfe-511cea87617d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:09.925266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac72e90-dedc-4a17-aeae-6f068469b8fa service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:09.932825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995719d6-6d29-4387-82ae-cb929f70f742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:09.935457 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995719d6-6d29-4387-82ae-cb929f70f742 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:09.935812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995719d6-6d29-4387-82ae-cb929f70f742 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:09.936187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995719d6-6d29-4387-82ae-cb929f70f742 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:09.938410 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995719d6-6d29-4387-82ae-cb929f70f742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:09.941551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995719d6-6d29-4387-82ae-cb929f70f742 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:09.955501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:09.967018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 809/1621] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:09 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:09.971554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090a83a-9c0b-49c3-adfe-511cea87617d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:09.988257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 813/1622] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:09 2022] POST /identity/v3/users => generated 293 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:09.989765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995719d6-6d29-4387-82ae-cb929f70f742 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:09.990188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090a83a-9c0b-49c3-adfe-511cea87617d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:10.001962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc208-12f4-4729-a9a2-89ae631b2119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:10.003679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc208-12f4-4729-a9a2-89ae631b2119 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:10.004966 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc208-12f4-4729-a9a2-89ae631b2119 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:10.005633 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995719d6-6d29-4387-82ae-cb929f70f742 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:10.005840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc208-12f4-4729-a9a2-89ae631b2119 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:10.007416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fc208-12f4-4729-a9a2-89ae631b2119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:10.011514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fc208-12f4-4729-a9a2-89ae631b2119 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:10.013859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef119a53-6e25-4d68-a49f-a5333f9a8e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:10.014859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef119a53-6e25-4d68-a49f-a5333f9a8e41 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:10.015332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef119a53-6e25-4d68-a49f-a5333f9a8e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:10.015905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef119a53-6e25-4d68-a49f-a5333f9a8e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:10.016687 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef119a53-6e25-4d68-a49f-a5333f9a8e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:10.019899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef119a53-6e25-4d68-a49f-a5333f9a8e41 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:10.035435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 810/1623] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:10.036682 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc208-12f4-4729-a9a2-89ae631b2119 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:10.045097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 814/1624] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:10.046064 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef119a53-6e25-4d68-a49f-a5333f9a8e41 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:10.056614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc208-12f4-4729-a9a2-89ae631b2119 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:10.063509 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838faf1-b862-4ff2-ad12-02cf57b41dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:10.064494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838faf1-b862-4ff2-ad12-02cf57b41dbe admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:10.064941 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838faf1-b862-4ff2-ad12-02cf57b41dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:10.065527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838faf1-b862-4ff2-ad12-02cf57b41dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:10.066463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838faf1-b862-4ff2-ad12-02cf57b41dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:10.068273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838faf1-b862-4ff2-ad12-02cf57b41dbe admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:10.072201 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef119a53-6e25-4d68-a49f-a5333f9a8e41 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:10.082150 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc75792-871f-4511-b168-82215cd6c3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:10.083297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc75792-871f-4511-b168-82215cd6c3e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:10.083697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc75792-871f-4511-b168-82215cd6c3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:10.084219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc75792-871f-4511-b168-82215cd6c3e3 admin admin] PATH_INFO: `/v3/projects/d2d58991a7a34786a4aae50d73aeb7ad/users/fddf6d8834a5423da70c053e4091097c/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:10.084908 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 811/1625] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:10.086291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838faf1-b862-4ff2-ad12-02cf57b41dbe admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:10.101332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838faf1-b862-4ff2-ad12-02cf57b41dbe admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:10.110442 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf4512-46a0-4df9-aad5-075c6082338a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:10.111550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4512-46a0-4df9-aad5-075c6082338a admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:10.112280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4512-46a0-4df9-aad5-075c6082338a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:10.113066 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4512-46a0-4df9-aad5-075c6082338a admin admin] PATH_INFO: `/v3/projects/6e220d74cc914a8499f776bf7d694818/users/9575c878627e42a7aef8e4fe4148a3ae/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:10.115994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc75792-871f-4511-b168-82215cd6c3e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d58991a7a34786a4aae50d73aeb7ad, user_id=fddf6d8834a5423da70c053e4091097c, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:10.119686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc75792-871f-4511-b168-82215cd6c3e3 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:10.147031 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf4512-46a0-4df9-aad5-075c6082338a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e220d74cc914a8499f776bf7d694818, user_id=9575c878627e42a7aef8e4fe4148a3ae, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:10.153438 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf4512-46a0-4df9-aad5-075c6082338a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:10.167299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 815/1626] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:10 2022] PUT /identity/v3/projects/d2d58991a7a34786a4aae50d73aeb7ad/users/fddf6d8834a5423da70c053e4091097c/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:10.167299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc75792-871f-4511-b168-82215cd6c3e3 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:10.173534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:10.198837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 812/1627] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:10 2022] PUT /identity/v3/projects/6e220d74cc914a8499f776bf7d694818/users/9575c878627e42a7aef8e4fe4148a3ae/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:10.202504 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf4512-46a0-4df9-aad5-075c6082338a admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:10.335376 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc75792-871f-4511-b168-82215cd6c3e3 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:10.370436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf4512-46a0-4df9-aad5-075c6082338a admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:10.382293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c716c-1e4b-43b8-83fc-b0b2dedd2af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:10.384294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c716c-1e4b-43b8-83fc-b0b2dedd2af9 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:10.385086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c716c-1e4b-43b8-83fc-b0b2dedd2af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:10.385471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c716c-1e4b-43b8-83fc-b0b2dedd2af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:10.388147 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c716c-1e4b-43b8-83fc-b0b2dedd2af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:10.391562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c716c-1e4b-43b8-83fc-b0b2dedd2af9 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:10.437846 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 813/1628] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:10.439599 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c716c-1e4b-43b8-83fc-b0b2dedd2af9 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:10.462702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c716c-1e4b-43b8-83fc-b0b2dedd2af9 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:10.479600 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76c5a6-7155-43bb-980b-06ba940169be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:10.480156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76c5a6-7155-43bb-980b-06ba940169be admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:10.481438 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76c5a6-7155-43bb-980b-06ba940169be admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:10.482007 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76c5a6-7155-43bb-980b-06ba940169be admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:10.484219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76c5a6-7155-43bb-980b-06ba940169be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:10.490445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76c5a6-7155-43bb-980b-06ba940169be admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:10.522526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 814/1629] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:10.522526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4718715-1585-4cd7-bf7d-893632604df5 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:10.522526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4718715-1585-4cd7-bf7d-893632604df5 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:10.522526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4718715-1585-4cd7-bf7d-893632604df5 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:10.525501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac52e46-ab49-451f-8e5b-64a22961b205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:10.526341 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 815/1630] 10.222.0.30 () {54 vars in 962 bytes} [Wed Sep 7 13:08:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:08:10.526621 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac52e46-ab49-451f-8e5b-64a22961b205 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:10.527530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac52e46-ab49-451f-8e5b-64a22961b205 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:10.527686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac52e46-ab49-451f-8e5b-64a22961b205 admin admin] PATH_INFO: `/v3/projects/fcc5d28ee6c64183a78a27b83bc32d57/users/19e414bcb3974a7ba7c22c65647d6008/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:10.528704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4718715-1585-4cd7-bf7d-893632604df5 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:10.564454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4718715-1585-4cd7-bf7d-893632604df5 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:10.565393 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac52e46-ab49-451f-8e5b-64a22961b205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc5d28ee6c64183a78a27b83bc32d57, user_id=19e414bcb3974a7ba7c22c65647d6008, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:10.577890 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac52e46-ab49-451f-8e5b-64a22961b205 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:10.583038 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099f526-4f34-4de4-9271-bb61c32ccbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:10.584279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099f526-4f34-4de4-9271-bb61c32ccbe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:10.585011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099f526-4f34-4de4-9271-bb61c32ccbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:10.585200 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099f526-4f34-4de4-9271-bb61c32ccbe7 admin admin] PATH_INFO: `/v3/projects/d2d58991a7a34786a4aae50d73aeb7ad/users/fddf6d8834a5423da70c053e4091097c/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:10.589524 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099f526-4f34-4de4-9271-bb61c32ccbe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d58991a7a34786a4aae50d73aeb7ad, user_id=fddf6d8834a5423da70c053e4091097c, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:10.594747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099f526-4f34-4de4-9271-bb61c32ccbe7 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:10.615311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 816/1631] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:10 2022] PUT /identity/v3/projects/fcc5d28ee6c64183a78a27b83bc32d57/users/19e414bcb3974a7ba7c22c65647d6008/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:10.617503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac52e46-ab49-451f-8e5b-64a22961b205 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:10.638851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 816/1632] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:10 2022] PUT /identity/v3/projects/d2d58991a7a34786a4aae50d73aeb7ad/users/fddf6d8834a5423da70c053e4091097c/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:10.649499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aef7a5-4aa0-4259-b1ac-16d88ce9bce0 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:10.650028 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aef7a5-4aa0-4259-b1ac-16d88ce9bce0 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:10.650457 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aef7a5-4aa0-4259-b1ac-16d88ce9bce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:10.730325 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:10.738269 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-96aef7a5-4aa0-4259-b1ac-16d88ce9bce0 None None] MFA Rules not processed for user `fbe8fa8ab8094aa69933398280810692`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:10.741070 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-96aef7a5-4aa0-4259-b1ac-16d88ce9bce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:10.789231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac52e46-ab49-451f-8e5b-64a22961b205 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:10.921596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 817/1633] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Sep 7 13:08:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:10.922797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aef7a5-4aa0-4259-b1ac-16d88ce9bce0 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:10.944552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab989c2b-4df2-4311-9e68-506c06476465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:10.949470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989c2b-4df2-4311-9e68-506c06476465 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:10.950121 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989c2b-4df2-4311-9e68-506c06476465 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:10.951794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989c2b-4df2-4311-9e68-506c06476465 admin admin] PATH_INFO: `/v3/projects/6e220d74cc914a8499f776bf7d694818/users/9575c878627e42a7aef8e4fe4148a3ae/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:10.955845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab989c2b-4df2-4311-9e68-506c06476465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e220d74cc914a8499f776bf7d694818, user_id=9575c878627e42a7aef8e4fe4148a3ae, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:10.961725 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab989c2b-4df2-4311-9e68-506c06476465 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:10.983026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 817/1634] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:10 2022] PUT /identity/v3/projects/6e220d74cc914a8499f776bf7d694818/users/9575c878627e42a7aef8e4fe4148a3ae/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:10.985465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd064af-f6c5-465f-ae20-487a0fed3cd6 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:10.986058 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd064af-f6c5-465f-ae20-487a0fed3cd6 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:10.986686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd064af-f6c5-465f-ae20-487a0fed3cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:11.028601 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:11.051659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-cbd064af-f6c5-465f-ae20-487a0fed3cd6 None None] MFA Rules not processed for user `fddf6d8834a5423da70c053e4091097c`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:11.054442 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-cbd064af-f6c5-465f-ae20-487a0fed3cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:11.101618 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aef7a5-4aa0-4259-b1ac-16d88ce9bce0 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:11.216831 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075b7af-b8fb-4c3d-b5b7-5da188ef367e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:11.218413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075b7af-b8fb-4c3d-b5b7-5da188ef367e admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:11.218915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075b7af-b8fb-4c3d-b5b7-5da188ef367e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:11.220086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075b7af-b8fb-4c3d-b5b7-5da188ef367e admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:11.225901 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075b7af-b8fb-4c3d-b5b7-5da188ef367e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:11.230306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075b7af-b8fb-4c3d-b5b7-5da188ef367e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:11.280547 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 818/1635] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:11.282728 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57e6eb-43fa-4c49-bee9-495fa17dba47 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:11.283195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57e6eb-43fa-4c49-bee9-495fa17dba47 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:11.283670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57e6eb-43fa-4c49-bee9-495fa17dba47 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:11.294297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 819/1636] 10.222.0.30 () {54 vars in 912 bytes} [Wed Sep 7 13:08:11 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:08:11.297076 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2289d-cde2-41ca-a7e9-4ade1d77d30c None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:11.297543 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2289d-cde2-41ca-a7e9-4ade1d77d30c None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:11.298021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2289d-cde2-41ca-a7e9-4ade1d77d30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:11.313483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 818/1637] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:11.314550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd064af-f6c5-465f-ae20-487a0fed3cd6 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:11.353592 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd064af-f6c5-465f-ae20-487a0fed3cd6 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:11.377520 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a605375-d251-4581-982b-347012fa251e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:11.381197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a605375-d251-4581-982b-347012fa251e admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:11.383806 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a605375-d251-4581-982b-347012fa251e admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:11.384548 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a605375-d251-4581-982b-347012fa251e admin admin] PATH_INFO: `/v3/projects/fcc5d28ee6c64183a78a27b83bc32d57/users/19e414bcb3974a7ba7c22c65647d6008/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:11.396139 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a605375-d251-4581-982b-347012fa251e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc5d28ee6c64183a78a27b83bc32d57, user_id=19e414bcb3974a7ba7c22c65647d6008, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:11.400786 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-86c2289d-cde2-41ca-a7e9-4ade1d77d30c None None] MFA Rules not processed for user `9575c878627e42a7aef8e4fe4148a3ae`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:11.405827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-86c2289d-cde2-41ca-a7e9-4ade1d77d30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:11.412793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a605375-d251-4581-982b-347012fa251e admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:11.476126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 819/1638] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:11 2022] PUT /identity/v3/projects/fcc5d28ee6c64183a78a27b83bc32d57/users/19e414bcb3974a7ba7c22c65647d6008/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:11.480412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b28293-7d04-49c7-bd6d-178aad90d6c8 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:11.486827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b28293-7d04-49c7-bd6d-178aad90d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:11.488767 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b28293-7d04-49c7-bd6d-178aad90d6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:11.550137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-67b28293-7d04-49c7-bd6d-178aad90d6c8 None None] MFA Rules not processed for user `fbe8fa8ab8094aa69933398280810692`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:11.551962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-67b28293-7d04-49c7-bd6d-178aad90d6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:11.646738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 820/1639] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:11.647950 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2289d-cde2-41ca-a7e9-4ade1d77d30c None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:11.727932 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:11.795163 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 820/1640] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Sep 7 13:08:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:11.797814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c8fa9-b92e-4182-b55a-863cbbb95c7a None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:11.798195 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c8fa9-b92e-4182-b55a-863cbbb95c7a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:11.798501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c8fa9-b92e-4182-b55a-863cbbb95c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:11.852136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2289d-cde2-41ca-a7e9-4ade1d77d30c None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:11.911222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-b20c8fa9-b92e-4182-b55a-863cbbb95c7a None None] MFA Rules not processed for user `19e414bcb3974a7ba7c22c65647d6008`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:11.914942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b20c8fa9-b92e-4182-b55a-863cbbb95c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:11.971450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:12.020500 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfaee18-1da6-46ce-91e7-bd30deabc7ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:12.022425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfaee18-1da6-46ce-91e7-bd30deabc7ad service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:12.023102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfaee18-1da6-46ce-91e7-bd30deabc7ad service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:12.023643 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfaee18-1da6-46ce-91e7-bd30deabc7ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:12.144958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 821/1641] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:12.146527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c8fa9-b92e-4182-b55a-863cbbb95c7a None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:12.157863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfaee18-1da6-46ce-91e7-bd30deabc7ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:12.161321 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfaee18-1da6-46ce-91e7-bd30deabc7ad service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:12.174655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c8fa9-b92e-4182-b55a-863cbbb95c7a None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:12.181728 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea8e46-8d69-476f-98ff-2c0b15accdf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:12.182938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea8e46-8d69-476f-98ff-2c0b15accdf8 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:12.183460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 821/1642] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:12.183631 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea8e46-8d69-476f-98ff-2c0b15accdf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:12.184193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea8e46-8d69-476f-98ff-2c0b15accdf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:12.330501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfaee18-1da6-46ce-91e7-bd30deabc7ad service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:12.346238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfaee18-1da6-46ce-91e7-bd30deabc7ad service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:12.346554 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea8e46-8d69-476f-98ff-2c0b15accdf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:12.350875 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea8e46-8d69-476f-98ff-2c0b15accdf8 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:12.353548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e25591-419e-49f7-b2e2-6347e5fdff9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:12.354630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e25591-419e-49f7-b2e2-6347e5fdff9a service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:12.355128 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e25591-419e-49f7-b2e2-6347e5fdff9a service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:12.355557 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e25591-419e-49f7-b2e2-6347e5fdff9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:12.367656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 822/1643] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:12.389440 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e25591-419e-49f7-b2e2-6347e5fdff9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:12.400061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e25591-419e-49f7-b2e2-6347e5fdff9a service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:12.433181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 822/1644] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:08:12.434668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea8e46-8d69-476f-98ff-2c0b15accdf8 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:12.454212 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea8e46-8d69-476f-98ff-2c0b15accdf8 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:12.462535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653b481-5ed4-4aca-a38f-7e97620c5ab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:12.463613 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653b481-5ed4-4aca-a38f-7e97620c5ab8 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:12.465137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653b481-5ed4-4aca-a38f-7e97620c5ab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:12.466331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653b481-5ed4-4aca-a38f-7e97620c5ab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:12.496174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653b481-5ed4-4aca-a38f-7e97620c5ab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:12.498706 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653b481-5ed4-4aca-a38f-7e97620c5ab8 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:12.521229 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 823/1645] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:08:12.628944 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e25591-419e-49f7-b2e2-6347e5fdff9a service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:12.656605 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e25591-419e-49f7-b2e2-6347e5fdff9a service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:12.663081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84231bf1-7e66-4207-8b82-85bd9e88df7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:12.664115 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84231bf1-7e66-4207-8b82-85bd9e88df7a service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:12.664755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84231bf1-7e66-4207-8b82-85bd9e88df7a service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:12.666348 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84231bf1-7e66-4207-8b82-85bd9e88df7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:12.862430 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84231bf1-7e66-4207-8b82-85bd9e88df7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:12.865336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84231bf1-7e66-4207-8b82-85bd9e88df7a service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:12.912653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 823/1646] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:13.526451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653b481-5ed4-4aca-a38f-7e97620c5ab8 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:13.634062 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653b481-5ed4-4aca-a38f-7e97620c5ab8 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:13.634062 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2400df-6be8-4816-b73b-98e4824c2d49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:13.634062 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2400df-6be8-4816-b73b-98e4824c2d49 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:13.634062 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2400df-6be8-4816-b73b-98e4824c2d49 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:13.636263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2400df-6be8-4816-b73b-98e4824c2d49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:13.733176 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:13.755791 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2400df-6be8-4816-b73b-98e4824c2d49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:13.760944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2400df-6be8-4816-b73b-98e4824c2d49 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:13.866014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 824/1647] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:13.938689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84231bf1-7e66-4207-8b82-85bd9e88df7a service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:13.963124 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84231bf1-7e66-4207-8b82-85bd9e88df7a service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:13.969801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd86df0-81e7-4ace-bbcf-0503fa5825dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:13.970864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd86df0-81e7-4ace-bbcf-0503fa5825dd service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:13.971403 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd86df0-81e7-4ace-bbcf-0503fa5825dd service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:13.971915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd86df0-81e7-4ace-bbcf-0503fa5825dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:14.174513 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd86df0-81e7-4ace-bbcf-0503fa5825dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:14.177016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd86df0-81e7-4ace-bbcf-0503fa5825dd service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:14.219980 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 824/1648] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:14.930978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ce0ac-e008-4744-b4e3-d78cfe710d1e None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:14.932596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ce0ac-e008-4744-b4e3-d78cfe710d1e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:14.933306 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ce0ac-e008-4744-b4e3-d78cfe710d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:14.990082 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-485ce0ac-e008-4744-b4e3-d78cfe710d1e None None] MFA Rules not processed for user `db205097b4fc4424b912ae5004ed1ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:14.991651 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-485ce0ac-e008-4744-b4e3-d78cfe710d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:15.135100 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd86df0-81e7-4ace-bbcf-0503fa5825dd service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:15.145186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 825/1649] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:14 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:15.149369 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:15.316803 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd86df0-81e7-4ace-bbcf-0503fa5825dd service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:15.336011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b075dd-4381-409d-96d1-d14a6345eef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:15.340683 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b075dd-4381-409d-96d1-d14a6345eef3 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:15.341349 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b075dd-4381-409d-96d1-d14a6345eef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:15.341835 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b075dd-4381-409d-96d1-d14a6345eef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:15.343086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b075dd-4381-409d-96d1-d14a6345eef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:15.353900 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b075dd-4381-409d-96d1-d14a6345eef3 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:15.511317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 825/1650] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:15 2022] POST /identity/v3/projects => generated 403 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:15.512746 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ce0ac-e008-4744-b4e3-d78cfe710d1e None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:15.575339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ce0ac-e008-4744-b4e3-d78cfe710d1e None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:15.877824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc83be-3170-4393-adf1-b39e4a07a2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:15.881692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc83be-3170-4393-adf1-b39e4a07a2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:15.882187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc83be-3170-4393-adf1-b39e4a07a2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:15.882673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc83be-3170-4393-adf1-b39e4a07a2e3 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:15.883880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc83be-3170-4393-adf1-b39e4a07a2e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:15.895673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc83be-3170-4393-adf1-b39e4a07a2e3 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:16.027079 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 826/1651] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:15 2022] POST /identity/v3/users => generated 308 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:08:16.030229 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b075dd-4381-409d-96d1-d14a6345eef3 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:16.081183 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b075dd-4381-409d-96d1-d14a6345eef3 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:16.110503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f479884-76c3-40ca-b511-93bce674941a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:16.112870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f479884-76c3-40ca-b511-93bce674941a admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:16.115085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f479884-76c3-40ca-b511-93bce674941a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:16.117999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f479884-76c3-40ca-b511-93bce674941a admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:16.119539 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f479884-76c3-40ca-b511-93bce674941a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:16.127813 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f479884-76c3-40ca-b511-93bce674941a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:16.191402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 826/1652] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:16.191851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc83be-3170-4393-adf1-b39e4a07a2e3 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:16.222041 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc83be-3170-4393-adf1-b39e4a07a2e3 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:16.238678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde297e-ae98-4247-8107-f02dd5b3b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:16.241837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde297e-ae98-4247-8107-f02dd5b3b668 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:16.242130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde297e-ae98-4247-8107-f02dd5b3b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:16.242414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde297e-ae98-4247-8107-f02dd5b3b668 admin admin] PATH_INFO: `/v3/projects/e33491a16e0f4c449b39f08a3b5de47d/users/e8ad0967772e4e9187075fb093940b36/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:16.291952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde297e-ae98-4247-8107-f02dd5b3b668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33491a16e0f4c449b39f08a3b5de47d, user_id=e8ad0967772e4e9187075fb093940b36, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:16.296717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde297e-ae98-4247-8107-f02dd5b3b668 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:16.353074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 827/1653] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:16 2022] PUT /identity/v3/projects/e33491a16e0f4c449b39f08a3b5de47d/users/e8ad0967772e4e9187075fb093940b36/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:16.355575 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f479884-76c3-40ca-b511-93bce674941a admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:16.409464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f479884-76c3-40ca-b511-93bce674941a admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:16.643429 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dd8a3-4f72-45af-807b-76817f1c4bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:16.645615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dd8a3-4f72-45af-807b-76817f1c4bda admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:16.651082 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dd8a3-4f72-45af-807b-76817f1c4bda admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:16.651546 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dd8a3-4f72-45af-807b-76817f1c4bda admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:16.652609 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dd8a3-4f72-45af-807b-76817f1c4bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:16.656596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dd8a3-4f72-45af-807b-76817f1c4bda admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:16.715178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 827/1654] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:16.717438 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde297e-ae98-4247-8107-f02dd5b3b668 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:16.748796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde297e-ae98-4247-8107-f02dd5b3b668 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:16.772675 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718925d-c086-4b02-be7d-3216220a0a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:16.774100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718925d-c086-4b02-be7d-3216220a0a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:16.774398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718925d-c086-4b02-be7d-3216220a0a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:16.774677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718925d-c086-4b02-be7d-3216220a0a16 admin admin] PATH_INFO: `/v3/projects/e33491a16e0f4c449b39f08a3b5de47d/users/e8ad0967772e4e9187075fb093940b36/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:16.791291 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718925d-c086-4b02-be7d-3216220a0a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33491a16e0f4c449b39f08a3b5de47d, user_id=e8ad0967772e4e9187075fb093940b36, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:16.802476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718925d-c086-4b02-be7d-3216220a0a16 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:16.852301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 828/1655] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:16 2022] PUT /identity/v3/projects/e33491a16e0f4c449b39f08a3b5de47d/users/e8ad0967772e4e9187075fb093940b36/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:16.860827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af7a8f-20b7-4583-9db2-85ecd6d89ac2 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:16.861179 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af7a8f-20b7-4583-9db2-85ecd6d89ac2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:16.861548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af7a8f-20b7-4583-9db2-85ecd6d89ac2 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:16.868134 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 828/1656] 10.222.0.30 () {54 vars in 962 bytes} [Wed Sep 7 13:08:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:08:16.963934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40eb1e-bf19-4567-bf95-253a4f75227a None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:16.964351 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40eb1e-bf19-4567-bf95-253a4f75227a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:16.964851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40eb1e-bf19-4567-bf95-253a4f75227a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:17.051303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-fd40eb1e-bf19-4567-bf95-253a4f75227a None None] MFA Rules not processed for user `fbe8fa8ab8094aa69933398280810692`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:17.064686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-fd40eb1e-bf19-4567-bf95-253a4f75227a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:17.344763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:17.548316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 829/1657] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Sep 7 13:08:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 585 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:17.556928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03344e19-2c50-4bc1-b439-91fd781fb091 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:17.557797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03344e19-2c50-4bc1-b439-91fd781fb091 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:17.557797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03344e19-2c50-4bc1-b439-91fd781fb091 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:17.559401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 829/1658] 10.222.0.30 () {54 vars in 912 bytes} [Wed Sep 7 13:08:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:08:17.574451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d20cc-f7d8-4418-be18-17ec17cb368e None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:17.575273 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d20cc-f7d8-4418-be18-17ec17cb368e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:17.575878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d20cc-f7d8-4418-be18-17ec17cb368e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:17.633927 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-2c4d20cc-f7d8-4418-be18-17ec17cb368e None None] MFA Rules not processed for user `fbe8fa8ab8094aa69933398280810692`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:17.636592 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-2c4d20cc-f7d8-4418-be18-17ec17cb368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:17.672540 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 830/1659] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Sep 7 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:08:17.690017 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03344e19-2c50-4bc1-b439-91fd781fb091 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:17.815556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03344e19-2c50-4bc1-b439-91fd781fb091 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:17.824150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3d050-e464-4eaa-93d9-78ce30fef9bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:17.825390 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3d050-e464-4eaa-93d9-78ce30fef9bd service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:17.826064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3d050-e464-4eaa-93d9-78ce30fef9bd service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:17.826502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3d050-e464-4eaa-93d9-78ce30fef9bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:17.846981 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3d050-e464-4eaa-93d9-78ce30fef9bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:17.849053 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3d050-e464-4eaa-93d9-78ce30fef9bd service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:17.871992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 830/1660] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:20.672847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbffae9-d548-4199-9ff0-7289bdfde64a None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:20.674295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbffae9-d548-4199-9ff0-7289bdfde64a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:20.675008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbffae9-d548-4199-9ff0-7289bdfde64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:20.858994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-afbffae9-d548-4199-9ff0-7289bdfde64a None None] MFA Rules not processed for user `e8ad0967772e4e9187075fb093940b36`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:20.863478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-afbffae9-d548-4199-9ff0-7289bdfde64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:21.389503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 831/1661] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:20 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 719 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:23.134633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3d050-e464-4eaa-93d9-78ce30fef9bd service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:23.243922 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:23.448149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3d050-e464-4eaa-93d9-78ce30fef9bd service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:23.477735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da657b6-421b-4f75-b751-830da6a3f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:23.479637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da657b6-421b-4f75-b751-830da6a3f3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:23.483474 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da657b6-421b-4f75-b751-830da6a3f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:23.485626 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da657b6-421b-4f75-b751-830da6a3f3b7 admin admin] PATH_INFO: `/v3/users/4b60d8c353ae4d4f86126abb3e930f88` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:23.491381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da657b6-421b-4f75-b751-830da6a3f3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b60d8c353ae4d4f86126abb3e930f88)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:23.503535 dv-cinder-853315-7-smb devstack@keystone.service[104921]: WARNING py.warnings [None req-5da657b6-421b-4f75-b751-830da6a3f3b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:08:23.503535 dv-cinder-853315-7-smb devstack@keystone.service[104921]: warnings.warn(msg) Sep 07 13:08:23.503535 dv-cinder-853315-7-smb devstack@keystone.service[104921]: Sep 07 13:08:23.513375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da657b6-421b-4f75-b751-830da6a3f3b7 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:23.849311 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-5da657b6-421b-4f75-b751-830da6a3f3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b60d8c353ae4d4f86126abb3e930f88'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:23.857680 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-5da657b6-421b-4f75-b751-830da6a3f3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b60d8c353ae4d4f86126abb3e930f88'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:23.924641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-5da657b6-421b-4f75-b751-830da6a3f3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b60d8c353ae4d4f86126abb3e930f88'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:23.931006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-5da657b6-421b-4f75-b751-830da6a3f3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b60d8c353ae4d4f86126abb3e930f88'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:24.028072 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-5da657b6-421b-4f75-b751-830da6a3f3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b60d8c353ae4d4f86126abb3e930f88'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:24.184492 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 831/1662] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:23 2022] DELETE /identity/v3/users/4b60d8c353ae4d4f86126abb3e930f88 => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:24.192228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe66f0-a1aa-4cf7-b6df-024f7e2b33b0 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:24.193050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe66f0-a1aa-4cf7-b6df-024f7e2b33b0 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:24.193205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe66f0-a1aa-4cf7-b6df-024f7e2b33b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:24.290956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-74fe66f0-a1aa-4cf7-b6df-024f7e2b33b0 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:24.305470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-74fe66f0-a1aa-4cf7-b6df-024f7e2b33b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:24.704813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 832/1663] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:24.745709 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da657b6-421b-4f75-b751-830da6a3f3b7 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:24.752125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5da657b6-421b-4f75-b751-830da6a3f3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:25.116546 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da657b6-421b-4f75-b751-830da6a3f3b7 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:25.175309 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4c7ed-e066-4508-ac0c-172c730178fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:25.176762 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4c7ed-e066-4508-ac0c-172c730178fd service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:25.188968 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4c7ed-e066-4508-ac0c-172c730178fd service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:25.189883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4c7ed-e066-4508-ac0c-172c730178fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:25.253939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4c7ed-e066-4508-ac0c-172c730178fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:25.257060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4c7ed-e066-4508-ac0c-172c730178fd service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:25.326385 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 832/1664] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:08:26.086128 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe66f0-a1aa-4cf7-b6df-024f7e2b33b0 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:26.089206 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-74fe66f0-a1aa-4cf7-b6df-024f7e2b33b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:26.166470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe66f0-a1aa-4cf7-b6df-024f7e2b33b0 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:26.211069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83edd12-d17f-49d3-8fb5-052973315da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:26.220308 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83edd12-d17f-49d3-8fb5-052973315da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:26.220872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83edd12-d17f-49d3-8fb5-052973315da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:26.238303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83edd12-d17f-49d3-8fb5-052973315da1 admin admin] PATH_INFO: `/v3/users/577fa8e1211f4c16a7092b127c63ff23` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:26.264161 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83edd12-d17f-49d3-8fb5-052973315da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=577fa8e1211f4c16a7092b127c63ff23)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:26.269540 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83edd12-d17f-49d3-8fb5-052973315da1 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:26.506132 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:26.517107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-f83edd12-d17f-49d3-8fb5-052973315da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577fa8e1211f4c16a7092b127c63ff23'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:26.518699 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-f83edd12-d17f-49d3-8fb5-052973315da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577fa8e1211f4c16a7092b127c63ff23'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:26.557597 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-f83edd12-d17f-49d3-8fb5-052973315da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577fa8e1211f4c16a7092b127c63ff23'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:26.593327 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-f83edd12-d17f-49d3-8fb5-052973315da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577fa8e1211f4c16a7092b127c63ff23'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:26.622584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-f83edd12-d17f-49d3-8fb5-052973315da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577fa8e1211f4c16a7092b127c63ff23'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:26.642517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 833/1665] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:26 2022] DELETE /identity/v3/users/577fa8e1211f4c16a7092b127c63ff23 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:26.648343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff39fd9-9dab-48de-a79e-0026303b9570 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:26.649400 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff39fd9-9dab-48de-a79e-0026303b9570 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:26.649936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff39fd9-9dab-48de-a79e-0026303b9570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:26.685394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-aff39fd9-9dab-48de-a79e-0026303b9570 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:26.688207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-aff39fd9-9dab-48de-a79e-0026303b9570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:26.787271 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:26.889968 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 833/1666] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:26.908997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83edd12-d17f-49d3-8fb5-052973315da1 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:26.912625 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f83edd12-d17f-49d3-8fb5-052973315da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:27.008941 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f508f5d-71d2-4aab-9954-cb47f0060fcd None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:27.009784 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f508f5d-71d2-4aab-9954-cb47f0060fcd None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:27.011929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f508f5d-71d2-4aab-9954-cb47f0060fcd None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:27.015352 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 834/1667] 10.222.0.30 () {54 vars in 921 bytes} [Wed Sep 7 13:08:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:08:27.050304 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40e580-392e-48aa-a37b-bb2d8c3135cb None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:27.050941 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40e580-392e-48aa-a37b-bb2d8c3135cb None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:27.053186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40e580-392e-48aa-a37b-bb2d8c3135cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:27.156612 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-df40e580-392e-48aa-a37b-bb2d8c3135cb None None] MFA Rules not processed for user `f2420def47ee4a5b8cf4373252583d75`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:27.165720 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83edd12-d17f-49d3-8fb5-052973315da1 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:27.172334 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-df40e580-392e-48aa-a37b-bb2d8c3135cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:27.180330 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d407c-4560-48e6-9a61-54d2a19eb19c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:27.180330 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d407c-4560-48e6-9a61-54d2a19eb19c service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:27.180330 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d407c-4560-48e6-9a61-54d2a19eb19c service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:27.180330 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d407c-4560-48e6-9a61-54d2a19eb19c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:27.219338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d407c-4560-48e6-9a61-54d2a19eb19c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:27.221398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d407c-4560-48e6-9a61-54d2a19eb19c service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:27.278291 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 834/1668] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:27.586783 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 835/1669] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Sep 7 13:08:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 538 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:08:27.913502 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d407c-4560-48e6-9a61-54d2a19eb19c service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:27.917726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5e4d407c-4560-48e6-9a61-54d2a19eb19c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:27.991213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d407c-4560-48e6-9a61-54d2a19eb19c service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:28.013707 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16914f01-26af-466b-91f3-1e91df848779 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2420def47ee4a5b8cf4373252583d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:28.022187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16914f01-26af-466b-91f3-1e91df848779 service placement] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:28.025939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16914f01-26af-466b-91f3-1e91df848779 service placement] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:28.026433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16914f01-26af-466b-91f3-1e91df848779 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:28.087538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16914f01-26af-466b-91f3-1e91df848779 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:28.089123 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16914f01-26af-466b-91f3-1e91df848779 service placement] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:28.118364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 835/1670] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:28.379902 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbb075-d563-43af-8290-716680455d5d None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:28.380497 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbb075-d563-43af-8290-716680455d5d None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:28.380905 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbb075-d563-43af-8290-716680455d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:28.475364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-a2cbb075-d563-43af-8290-716680455d5d None None] MFA Rules not processed for user `78c8e5fe62e643ec8a90fb936bd1937c`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:28.478444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a2cbb075-d563-43af-8290-716680455d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:28.721924 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 836/1671] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:28.722881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80f6a4-ef34-48da-8e55-08e6207fb4af None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:28.723869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80f6a4-ef34-48da-8e55-08e6207fb4af None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:28.724521 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80f6a4-ef34-48da-8e55-08e6207fb4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:28.798788 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-0c80f6a4-ef34-48da-8e55-08e6207fb4af None None] MFA Rules not processed for user `78c8e5fe62e643ec8a90fb936bd1937c`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:28.801313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0c80f6a4-ef34-48da-8e55-08e6207fb4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:28.848920 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 836/1672] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:28.855682 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbb075-d563-43af-8290-716680455d5d None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:28.859832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a2cbb075-d563-43af-8290-716680455d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:29.010091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80f6a4-ef34-48da-8e55-08e6207fb4af None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:29.013645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0c80f6a4-ef34-48da-8e55-08e6207fb4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:29.081445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80f6a4-ef34-48da-8e55-08e6207fb4af None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:29.093956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:29.095349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:29.095819 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:29.096299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] PATH_INFO: `/v3/projects/aed8f376841e4b9dbc897f98321afc94` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:29.097879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed8f376841e4b9dbc897f98321afc94)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:29.099228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: WARNING py.warnings [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:08:29.099228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: warnings.warn(msg) Sep 07 13:08:29.099228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: Sep 07 13:08:29.100886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:29.176850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:29.187072 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbb075-d563-43af-8290-716680455d5d None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:29.249430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed8f376841e4b9dbc897f98321afc94', 'request_id': 'req-78c280b7-02ad-483d-8fc9-b67f02867222'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:29.322763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6122278-728c-4265-9233-52e3bde7b30b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:29.323918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6122278-728c-4265-9233-52e3bde7b30b service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:29.324549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6122278-728c-4265-9233-52e3bde7b30b service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:29.325204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6122278-728c-4265-9233-52e3bde7b30b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:29.339733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed8f376841e4b9dbc897f98321afc94', 'request_id': 'req-78c280b7-02ad-483d-8fc9-b67f02867222'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:29.362972 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed8f376841e4b9dbc897f98321afc94', 'request_id': 'req-78c280b7-02ad-483d-8fc9-b67f02867222'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:29.412310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] The token cache is being invalidate because project aed8f376841e4b9dbc897f98321afc94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:08:29.415250 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:29.419208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:29.427747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 837/1673] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:08:29 2022] DELETE /identity/v3/projects/aed8f376841e4b9dbc897f98321afc94 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:29.436241 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:29.441818 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:29.464141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6122278-728c-4265-9233-52e3bde7b30b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:29.466852 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6122278-728c-4265-9233-52e3bde7b30b service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:29.496203 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 837/1674] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:29.554673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:29.655737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c280b7-02ad-483d-8fc9-b67f02867222 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:29.670804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894ab2d-df5f-4113-987a-105d673f9562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:29.673580 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894ab2d-df5f-4113-987a-105d673f9562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:29.674336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894ab2d-df5f-4113-987a-105d673f9562 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:29.674980 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894ab2d-df5f-4113-987a-105d673f9562 admin admin] PATH_INFO: `/v3/users/fddf6d8834a5423da70c053e4091097c` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:29.677858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894ab2d-df5f-4113-987a-105d673f9562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fddf6d8834a5423da70c053e4091097c)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:29.682847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894ab2d-df5f-4113-987a-105d673f9562 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:29.821252 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a894ab2d-df5f-4113-987a-105d673f9562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fddf6d8834a5423da70c053e4091097c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:29.822518 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a894ab2d-df5f-4113-987a-105d673f9562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fddf6d8834a5423da70c053e4091097c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:29.855895 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a894ab2d-df5f-4113-987a-105d673f9562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fddf6d8834a5423da70c053e4091097c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:29.875470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a894ab2d-df5f-4113-987a-105d673f9562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fddf6d8834a5423da70c053e4091097c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:29.891895 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a894ab2d-df5f-4113-987a-105d673f9562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fddf6d8834a5423da70c053e4091097c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:29.907139 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 838/1675] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:29 2022] DELETE /identity/v3/users/fddf6d8834a5423da70c053e4091097c => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:30.543232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6122278-728c-4265-9233-52e3bde7b30b service nova] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:30.545331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d6122278-728c-4265-9233-52e3bde7b30b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:30.581654 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6122278-728c-4265-9233-52e3bde7b30b service nova] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:30.733537 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b530d-cfe1-4398-be49-18f9d82b0590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:30.734360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b530d-cfe1-4398-be49-18f9d82b0590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:30.734733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b530d-cfe1-4398-be49-18f9d82b0590 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:30.735099 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b530d-cfe1-4398-be49-18f9d82b0590 admin admin] PATH_INFO: `/v3/users/1dc2b35bb5bb4e29852eec13bf44a951` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:30.736726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b530d-cfe1-4398-be49-18f9d82b0590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc2b35bb5bb4e29852eec13bf44a951)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:30.739899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b530d-cfe1-4398-be49-18f9d82b0590 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:30.860645 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:30.872075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ef9b530d-cfe1-4398-be49-18f9d82b0590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc2b35bb5bb4e29852eec13bf44a951'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:30.873153 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ef9b530d-cfe1-4398-be49-18f9d82b0590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc2b35bb5bb4e29852eec13bf44a951'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:30.880803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f70307-a6c9-4ab6-bb46-176340b401d9 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:30.880803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f70307-a6c9-4ab6-bb46-176340b401d9 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:30.881339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f70307-a6c9-4ab6-bb46-176340b401d9 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:30.883317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 839/1676] 10.222.0.30 () {54 vars in 912 bytes} [Wed Sep 7 13:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:08:30.893186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ef9b530d-cfe1-4398-be49-18f9d82b0590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc2b35bb5bb4e29852eec13bf44a951'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:30.894359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ef9b530d-cfe1-4398-be49-18f9d82b0590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc2b35bb5bb4e29852eec13bf44a951'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:30.895361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090a7b0-1b78-44c4-ab9d-5235a5d62771 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:30.895703 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090a7b0-1b78-44c4-ab9d-5235a5d62771 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:30.896186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090a7b0-1b78-44c4-ab9d-5235a5d62771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:30.921945 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ef9b530d-cfe1-4398-be49-18f9d82b0590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc2b35bb5bb4e29852eec13bf44a951'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:31.002677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 838/1677] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:30 2022] DELETE /identity/v3/users/1dc2b35bb5bb4e29852eec13bf44a951 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:31.011756 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7582ef-b4f4-4a1d-a60d-728669c052c4 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:31.014023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7582ef-b4f4-4a1d-a60d-728669c052c4 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:31.014637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7582ef-b4f4-4a1d-a60d-728669c052c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:31.093789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-7090a7b0-1b78-44c4-ab9d-5235a5d62771 None None] MFA Rules not processed for user `eefd1293a22848e3b595e54be0455d10`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:31.096074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7090a7b0-1b78-44c4-ab9d-5235a5d62771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:31.143039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-3b7582ef-b4f4-4a1d-a60d-728669c052c4 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:31.148681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3b7582ef-b4f4-4a1d-a60d-728669c052c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:31.258603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 840/1678] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Sep 7 13:08:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:08:31.280679 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090a7b0-1b78-44c4-ab9d-5235a5d62771 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:31.282960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7090a7b0-1b78-44c4-ab9d-5235a5d62771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:31.303974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090a7b0-1b78-44c4-ab9d-5235a5d62771 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:31.315603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e572359-0cad-4bcb-8b06-28a7b06c4197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:31.317553 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e572359-0cad-4bcb-8b06-28a7b06c4197 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:31.317893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e572359-0cad-4bcb-8b06-28a7b06c4197 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:31.318127 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e572359-0cad-4bcb-8b06-28a7b06c4197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:31.344431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e572359-0cad-4bcb-8b06-28a7b06c4197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:31.350565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e572359-0cad-4bcb-8b06-28a7b06c4197 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:31.390903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 841/1679] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:31.403271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e572359-0cad-4bcb-8b06-28a7b06c4197 service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:31.407573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5e572359-0cad-4bcb-8b06-28a7b06c4197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:31.428675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 839/1680] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:31.450538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e572359-0cad-4bcb-8b06-28a7b06c4197 service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:31.458227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e9fbe-7e45-4a3c-971f-7230689197b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:31.459025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e9fbe-7e45-4a3c-971f-7230689197b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:31.459411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e9fbe-7e45-4a3c-971f-7230689197b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:31.459850 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e9fbe-7e45-4a3c-971f-7230689197b0 admin admin] PATH_INFO: `/v3/projects/a817dcb50fff40e8b550c41401e88aac` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:31.463904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e9fbe-7e45-4a3c-971f-7230689197b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a817dcb50fff40e8b550c41401e88aac)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:31.465909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e9fbe-7e45-4a3c-971f-7230689197b0 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:31.502690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7582ef-b4f4-4a1d-a60d-728669c052c4 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:31.523484 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:31.530417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7582ef-b4f4-4a1d-a60d-728669c052c4 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:31.551373 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeccadc-e7f1-4bee-8138-02d5d0d63c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:31.552433 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeccadc-e7f1-4bee-8138-02d5d0d63c71 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:31.552861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeccadc-e7f1-4bee-8138-02d5d0d63c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:31.553313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeccadc-e7f1-4bee-8138-02d5d0d63c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:31.611048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7e6e9fbe-7e45-4a3c-971f-7230689197b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a817dcb50fff40e8b550c41401e88aac', 'request_id': 'req-7e6e9fbe-7e45-4a3c-971f-7230689197b0'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:31.612735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeccadc-e7f1-4bee-8138-02d5d0d63c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:31.616174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeccadc-e7f1-4bee-8138-02d5d0d63c71 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:31.629655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7e6e9fbe-7e45-4a3c-971f-7230689197b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a817dcb50fff40e8b550c41401e88aac', 'request_id': 'req-7e6e9fbe-7e45-4a3c-971f-7230689197b0'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:31.641530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 840/1681] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:08:31.660169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7e6e9fbe-7e45-4a3c-971f-7230689197b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a817dcb50fff40e8b550c41401e88aac', 'request_id': 'req-7e6e9fbe-7e45-4a3c-971f-7230689197b0'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:31.703412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7e6e9fbe-7e45-4a3c-971f-7230689197b0 admin admin] The token cache is being invalidate because project a817dcb50fff40e8b550c41401e88aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:08:31.703759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7e6e9fbe-7e45-4a3c-971f-7230689197b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:31.705081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7e6e9fbe-7e45-4a3c-971f-7230689197b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:31.706965 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 842/1682] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:08:31 2022] DELETE /identity/v3/projects/a817dcb50fff40e8b550c41401e88aac => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:31.711193 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeccadc-e7f1-4bee-8138-02d5d0d63c71 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:31.724475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeccadc-e7f1-4bee-8138-02d5d0d63c71 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:31.899093 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba91240-9983-40b4-9c0d-b9ad397c083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:31.899794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba91240-9983-40b4-9c0d-b9ad397c083c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:31.900074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba91240-9983-40b4-9c0d-b9ad397c083c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:31.900345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba91240-9983-40b4-9c0d-b9ad397c083c admin admin] PATH_INFO: `/v3/users/9575c878627e42a7aef8e4fe4148a3ae` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:31.905003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba91240-9983-40b4-9c0d-b9ad397c083c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9575c878627e42a7aef8e4fe4148a3ae)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:31.912161 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba91240-9983-40b4-9c0d-b9ad397c083c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:31.949912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e9fbe-7e45-4a3c-971f-7230689197b0 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:31.951415 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7e6e9fbe-7e45-4a3c-971f-7230689197b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:31.973655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e9fbe-7e45-4a3c-971f-7230689197b0 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:32.010585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf31af9-5baf-4c69-986a-d670485b4533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:32.011697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf31af9-5baf-4c69-986a-d670485b4533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:32.012008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf31af9-5baf-4c69-986a-d670485b4533 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:32.012595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf31af9-5baf-4c69-986a-d670485b4533 admin admin] PATH_INFO: `/v3/projects/d2d58991a7a34786a4aae50d73aeb7ad` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:32.014735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf31af9-5baf-4c69-986a-d670485b4533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d58991a7a34786a4aae50d73aeb7ad)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:32.017271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf31af9-5baf-4c69-986a-d670485b4533 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:32.130409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3ba91240-9983-40b4-9c0d-b9ad397c083c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9575c878627e42a7aef8e4fe4148a3ae'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:32.131295 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3ba91240-9983-40b4-9c0d-b9ad397c083c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9575c878627e42a7aef8e4fe4148a3ae'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:32.139699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:32.161012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3ba91240-9983-40b4-9c0d-b9ad397c083c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9575c878627e42a7aef8e4fe4148a3ae'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:32.165063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3ba91240-9983-40b4-9c0d-b9ad397c083c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9575c878627e42a7aef8e4fe4148a3ae'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:32.190890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3ba91240-9983-40b4-9c0d-b9ad397c083c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9575c878627e42a7aef8e4fe4148a3ae'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:32.224135 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9bf31af9-5baf-4c69-986a-d670485b4533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d58991a7a34786a4aae50d73aeb7ad', 'request_id': 'req-9bf31af9-5baf-4c69-986a-d670485b4533'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:32.257809 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9bf31af9-5baf-4c69-986a-d670485b4533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d58991a7a34786a4aae50d73aeb7ad', 'request_id': 'req-9bf31af9-5baf-4c69-986a-d670485b4533'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:32.266803 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 841/1683] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:31 2022] DELETE /identity/v3/users/9575c878627e42a7aef8e4fe4148a3ae => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:32.280246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9bf31af9-5baf-4c69-986a-d670485b4533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d58991a7a34786a4aae50d73aeb7ad', 'request_id': 'req-9bf31af9-5baf-4c69-986a-d670485b4533'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:32.351080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9bf31af9-5baf-4c69-986a-d670485b4533 admin admin] The token cache is being invalidate because project d2d58991a7a34786a4aae50d73aeb7ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:08:32.351705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9bf31af9-5baf-4c69-986a-d670485b4533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:32.353119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9bf31af9-5baf-4c69-986a-d670485b4533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:32.363564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 843/1684] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:08:31 2022] DELETE /identity/v3/projects/d2d58991a7a34786a4aae50d73aeb7ad => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:32.369288 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5093eb7-5eb2-4689-be58-0b5e69a68ed8 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:32.369582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5093eb7-5eb2-4689-be58-0b5e69a68ed8 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:32.369905 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5093eb7-5eb2-4689-be58-0b5e69a68ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:32.440171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-e5093eb7-5eb2-4689-be58-0b5e69a68ed8 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:32.441596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-e5093eb7-5eb2-4689-be58-0b5e69a68ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:32.628455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 842/1685] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:08:32.633981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a2e94-05e4-4c7f-a05b-2c4474109e5e None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:32.633981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a2e94-05e4-4c7f-a05b-2c4474109e5e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:32.633981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a2e94-05e4-4c7f-a05b-2c4474109e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:32.694806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5093eb7-5eb2-4689-be58-0b5e69a68ed8 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:32.696299 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-e5093eb7-5eb2-4689-be58-0b5e69a68ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:32.707214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-309a2e94-05e4-4c7f-a05b-2c4474109e5e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:32.733070 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-309a2e94-05e4-4c7f-a05b-2c4474109e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:32.756638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5093eb7-5eb2-4689-be58-0b5e69a68ed8 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:32.760881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 844/1686] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:08:32.770154 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a2e94-05e4-4c7f-a05b-2c4474109e5e None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:32.782645 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71033d7-3697-40e8-85c5-bac369e10417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:32.787490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71033d7-3697-40e8-85c5-bac369e10417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:32.788157 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71033d7-3697-40e8-85c5-bac369e10417 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:32.789260 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71033d7-3697-40e8-85c5-bac369e10417 admin admin] PATH_INFO: `/v3/users/db205097b4fc4424b912ae5004ed1ba2` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:32.795501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71033d7-3697-40e8-85c5-bac369e10417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db205097b4fc4424b912ae5004ed1ba2)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:32.815072 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71033d7-3697-40e8-85c5-bac369e10417 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:32.822770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a2e94-05e4-4c7f-a05b-2c4474109e5e None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:32.837486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3462e-4531-494c-849f-a9a1909a07ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:32.841660 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3462e-4531-494c-849f-a9a1909a07ae admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:32.842251 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3462e-4531-494c-849f-a9a1909a07ae admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:32.842406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3462e-4531-494c-849f-a9a1909a07ae admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:32.859461 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3462e-4531-494c-849f-a9a1909a07ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:08:32.859803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3462e-4531-494c-849f-a9a1909a07ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:32.869056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3462e-4531-494c-849f-a9a1909a07ae admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:32.941026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 845/1687] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:08:32.951026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3462e-4531-494c-849f-a9a1909a07ae admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:32.973043 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3462e-4531-494c-849f-a9a1909a07ae admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:32.992350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc6218-0b26-47ee-b554-698d8f94f574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:32.993026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc6218-0b26-47ee-b554-698d8f94f574 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:32.993308 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc6218-0b26-47ee-b554-698d8f94f574 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:32.993579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc6218-0b26-47ee-b554-698d8f94f574 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:32.994245 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc6218-0b26-47ee-b554-698d8f94f574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:32.996789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc6218-0b26-47ee-b554-698d8f94f574 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:33.032109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a71033d7-3697-40e8-85c5-bac369e10417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db205097b4fc4424b912ae5004ed1ba2'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:33.033591 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a71033d7-3697-40e8-85c5-bac369e10417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db205097b4fc4424b912ae5004ed1ba2'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:33.054365 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a71033d7-3697-40e8-85c5-bac369e10417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db205097b4fc4424b912ae5004ed1ba2'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:33.055623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a71033d7-3697-40e8-85c5-bac369e10417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db205097b4fc4424b912ae5004ed1ba2'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:33.084306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a71033d7-3697-40e8-85c5-bac369e10417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db205097b4fc4424b912ae5004ed1ba2'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:33.091529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 846/1688] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:32 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:33.097438 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc6218-0b26-47ee-b554-698d8f94f574 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:33.105775 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-dcfc6218-0b26-47ee-b554-698d8f94f574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:33.164771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 843/1689] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:32 2022] DELETE /identity/v3/users/db205097b4fc4424b912ae5004ed1ba2 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:33.275211 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71033d7-3697-40e8-85c5-bac369e10417 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:33.277360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a71033d7-3697-40e8-85c5-bac369e10417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:33.341198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:33.377014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc6218-0b26-47ee-b554-698d8f94f574 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:33.421642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:33.503279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71033d7-3697-40e8-85c5-bac369e10417 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:33.519641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606de3f-b398-44f8-9cb8-49f4466f6fd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2420def47ee4a5b8cf4373252583d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:33.522728 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606de3f-b398-44f8-9cb8-49f4466f6fd0 service placement] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:33.523162 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606de3f-b398-44f8-9cb8-49f4466f6fd0 service placement] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:33.523544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606de3f-b398-44f8-9cb8-49f4466f6fd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:33.533493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3606de3f-b398-44f8-9cb8-49f4466f6fd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:33.559075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606de3f-b398-44f8-9cb8-49f4466f6fd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:33.563289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606de3f-b398-44f8-9cb8-49f4466f6fd0 service placement] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:33.603129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 844/1690] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:08:33.612060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748030c2-0f28-4db2-9f19-386ef5332a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:33.612788 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748030c2-0f28-4db2-9f19-386ef5332a22 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:33.613902 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748030c2-0f28-4db2-9f19-386ef5332a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:33.614186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748030c2-0f28-4db2-9f19-386ef5332a22 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:33.614863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748030c2-0f28-4db2-9f19-386ef5332a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:33.617599 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748030c2-0f28-4db2-9f19-386ef5332a22 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:33.679561 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 847/1691] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:33 2022] POST /identity/v3/users => generated 294 bytes in 582 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:33.683705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606de3f-b398-44f8-9cb8-49f4466f6fd0 service placement] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:33.703157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748030c2-0f28-4db2-9f19-386ef5332a22 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:33.704520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606de3f-b398-44f8-9cb8-49f4466f6fd0 service placement] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:33.707783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-748030c2-0f28-4db2-9f19-386ef5332a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:33.729453 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d115cc-2e27-4407-8d1a-1c3c7ab08b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:33.732309 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d115cc-2e27-4407-8d1a-1c3c7ab08b96 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:33.732626 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d115cc-2e27-4407-8d1a-1c3c7ab08b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:33.734052 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d115cc-2e27-4407-8d1a-1c3c7ab08b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:33.737923 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d115cc-2e27-4407-8d1a-1c3c7ab08b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:33.742024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d115cc-2e27-4407-8d1a-1c3c7ab08b96 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:33.764505 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748030c2-0f28-4db2-9f19-386ef5332a22 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:33.807537 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa091f-f2a8-400a-a40c-12527469bfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:33.808595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa091f-f2a8-400a-a40c-12527469bfc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:33.809219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa091f-f2a8-400a-a40c-12527469bfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:33.809219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa091f-f2a8-400a-a40c-12527469bfc2 admin admin] PATH_INFO: `/v3/projects/e9959e95d8764e1ab320f1d7162443f5` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:33.818473 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa091f-f2a8-400a-a40c-12527469bfc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9959e95d8764e1ab320f1d7162443f5)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:33.820089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 845/1692] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:33.822795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa091f-f2a8-400a-a40c-12527469bfc2 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:33.824163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d115cc-2e27-4407-8d1a-1c3c7ab08b96 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:33.829505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-44d115cc-2e27-4407-8d1a-1c3c7ab08b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:33.863980 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d115cc-2e27-4407-8d1a-1c3c7ab08b96 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:33.876144 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f59e6d-dfe8-48c5-98d2-26a2958f14df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:33.876843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f59e6d-dfe8-48c5-98d2-26a2958f14df admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:33.877153 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f59e6d-dfe8-48c5-98d2-26a2958f14df admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:33.877423 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f59e6d-dfe8-48c5-98d2-26a2958f14df admin admin] PATH_INFO: `/v3/projects/6e220d74cc914a8499f776bf7d694818` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:33.880579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f59e6d-dfe8-48c5-98d2-26a2958f14df admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e220d74cc914a8499f776bf7d694818)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:33.882777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f59e6d-dfe8-48c5-98d2-26a2958f14df admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:33.946531 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8faa091f-f2a8-400a-a40c-12527469bfc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9959e95d8764e1ab320f1d7162443f5', 'request_id': 'req-8faa091f-f2a8-400a-a40c-12527469bfc2'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:33.962340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8faa091f-f2a8-400a-a40c-12527469bfc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9959e95d8764e1ab320f1d7162443f5', 'request_id': 'req-8faa091f-f2a8-400a-a40c-12527469bfc2'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:33.976812 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-24f59e6d-dfe8-48c5-98d2-26a2958f14df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e220d74cc914a8499f776bf7d694818', 'request_id': 'req-24f59e6d-dfe8-48c5-98d2-26a2958f14df'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:33.978146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8faa091f-f2a8-400a-a40c-12527469bfc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9959e95d8764e1ab320f1d7162443f5', 'request_id': 'req-8faa091f-f2a8-400a-a40c-12527469bfc2'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:33.993878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-24f59e6d-dfe8-48c5-98d2-26a2958f14df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e220d74cc914a8499f776bf7d694818', 'request_id': 'req-24f59e6d-dfe8-48c5-98d2-26a2958f14df'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:34.013347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-24f59e6d-dfe8-48c5-98d2-26a2958f14df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e220d74cc914a8499f776bf7d694818', 'request_id': 'req-24f59e6d-dfe8-48c5-98d2-26a2958f14df'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:34.029628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8faa091f-f2a8-400a-a40c-12527469bfc2 admin admin] The token cache is being invalidate because project e9959e95d8764e1ab320f1d7162443f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:08:34.030144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8faa091f-f2a8-400a-a40c-12527469bfc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:34.031831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8faa091f-f2a8-400a-a40c-12527469bfc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:34.036495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 848/1693] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:08:33 2022] DELETE /identity/v3/projects/e9959e95d8764e1ab320f1d7162443f5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:08:34.038638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa091f-f2a8-400a-a40c-12527469bfc2 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:34.043277 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8faa091f-f2a8-400a-a40c-12527469bfc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:34.056606 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-24f59e6d-dfe8-48c5-98d2-26a2958f14df admin admin] The token cache is being invalidate because project 6e220d74cc914a8499f776bf7d694818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:08:34.057186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-24f59e6d-dfe8-48c5-98d2-26a2958f14df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:34.060927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-24f59e6d-dfe8-48c5-98d2-26a2958f14df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:34.075041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 846/1694] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:08:33 2022] DELETE /identity/v3/projects/6e220d74cc914a8499f776bf7d694818 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:34.077407 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4399f6-cedf-40c3-b1eb-85999952e109 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:34.077885 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4399f6-cedf-40c3-b1eb-85999952e109 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:34.079559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4399f6-cedf-40c3-b1eb-85999952e109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:34.129109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-2b4399f6-cedf-40c3-b1eb-85999952e109 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:34.131258 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2b4399f6-cedf-40c3-b1eb-85999952e109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:34.222630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa091f-f2a8-400a-a40c-12527469bfc2 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:34.279901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:34.290054 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 847/1695] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:34.295226 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4bea-3354-4654-a392-719605547fa3 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:34.295812 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4bea-3354-4654-a392-719605547fa3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:34.296614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4bea-3354-4654-a392-719605547fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:34.366520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-7c9b4bea-3354-4654-a392-719605547fa3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:34.368006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7c9b4bea-3354-4654-a392-719605547fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:34.396569 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 848/1696] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:34.399436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a34cf8-4d96-448b-a618-1f5cdbde44a3 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:34.399892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a34cf8-4d96-448b-a618-1f5cdbde44a3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:34.400268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a34cf8-4d96-448b-a618-1f5cdbde44a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:34.446506 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-b7a34cf8-4d96-448b-a618-1f5cdbde44a3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:34.450776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b7a34cf8-4d96-448b-a618-1f5cdbde44a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:34.470367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 849/1697] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:34.478558 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a34cf8-4d96-448b-a618-1f5cdbde44a3 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:34.481631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b7a34cf8-4d96-448b-a618-1f5cdbde44a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:34.486209 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723b72e-85e3-47e3-857e-a6ff980ad8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:34.486933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723b72e-85e3-47e3-857e-a6ff980ad8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:34.487530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723b72e-85e3-47e3-857e-a6ff980ad8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:34.487803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723b72e-85e3-47e3-857e-a6ff980ad8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:34.488690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723b72e-85e3-47e3-857e-a6ff980ad8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:34.494157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723b72e-85e3-47e3-857e-a6ff980ad8e1 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:34.522869 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a34cf8-4d96-448b-a618-1f5cdbde44a3 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:34.606302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 849/1698] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 569 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:34.607913 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6541944-6554-4476-9454-98e363a7dcb0 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:34.608202 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6541944-6554-4476-9454-98e363a7dcb0 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:34.608509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6541944-6554-4476-9454-98e363a7dcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:34.617065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:34.620036 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:34.621036 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:34.622105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346 admin admin] PATH_INFO: `/v3/projects/38219520d703492994d218440c44db54` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:34.624586 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38219520d703492994d218440c44db54)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:34.631212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:34.692715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-f6541944-6554-4476-9454-98e363a7dcb0 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:34.694141 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f6541944-6554-4476-9454-98e363a7dcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:34.722048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 850/1699] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:34.723055 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6541944-6554-4476-9454-98e363a7dcb0 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:34.743594 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6541944-6554-4476-9454-98e363a7dcb0 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:34.750246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a333c9f-fed0-48cf-9fed-c6553df3c836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:34.750903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a333c9f-fed0-48cf-9fed-c6553df3c836 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:34.751209 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a333c9f-fed0-48cf-9fed-c6553df3c836 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:34.751461 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a333c9f-fed0-48cf-9fed-c6553df3c836 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:34.752102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a333c9f-fed0-48cf-9fed-c6553df3c836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:08:34.752496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a333c9f-fed0-48cf-9fed-c6553df3c836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:34.754421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a333c9f-fed0-48cf-9fed-c6553df3c836 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:34.772489 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 851/1700] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:08:34.773384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a333c9f-fed0-48cf-9fed-c6553df3c836 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:34.779313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8a333c9f-fed0-48cf-9fed-c6553df3c836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:34.807023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a333c9f-fed0-48cf-9fed-c6553df3c836 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:34.820789 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:34.849056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76deb4-8359-4cec-bd9f-9511dab61700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:34.850821 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76deb4-8359-4cec-bd9f-9511dab61700 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:34.850956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76deb4-8359-4cec-bd9f-9511dab61700 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:34.851267 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76deb4-8359-4cec-bd9f-9511dab61700 admin admin] PATH_INFO: `/v3/projects/748c76235e974c6fafe15dbf92829002/users/01f9842a079c4f759d16aa3b3826a774/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:34.940027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38219520d703492994d218440c44db54', 'request_id': 'req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:34.950682 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76deb4-8359-4cec-bd9f-9511dab61700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=748c76235e974c6fafe15dbf92829002, user_id=01f9842a079c4f759d16aa3b3826a774, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:34.959261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76deb4-8359-4cec-bd9f-9511dab61700 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:34.971574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38219520d703492994d218440c44db54', 'request_id': 'req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:34.986805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38219520d703492994d218440c44db54', 'request_id': 'req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:35.034156 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 852/1701] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:34 2022] PUT /identity/v3/projects/748c76235e974c6fafe15dbf92829002/users/01f9842a079c4f759d16aa3b3826a774/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:35.040954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346 admin admin] The token cache is being invalidate because project 38219520d703492994d218440c44db54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:08:35.041419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:35.042598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:35.043865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76deb4-8359-4cec-bd9f-9511dab61700 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:35.051697 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 850/1702] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:08:34 2022] DELETE /identity/v3/projects/38219520d703492994d218440c44db54 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:35.052144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-db76deb4-8359-4cec-bd9f-9511dab61700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:35.055089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:35.059690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:35.278236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c31bb-56b5-4322-9d1a-2461f1d3a346 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:35.292528 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76deb4-8359-4cec-bd9f-9511dab61700 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:35.312249 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc63fbb-aafc-4d38-bfa4-2bf63afbc2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:35.313112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc63fbb-aafc-4d38-bfa4-2bf63afbc2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:35.315125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc63fbb-aafc-4d38-bfa4-2bf63afbc2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:35.318009 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc63fbb-aafc-4d38-bfa4-2bf63afbc2f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:35.320615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc63fbb-aafc-4d38-bfa4-2bf63afbc2f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:35.322576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8a3d6-cbb8-4a99-aec8-b02df98188ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:35.323596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8a3d6-cbb8-4a99-aec8-b02df98188ae admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:35.326953 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc63fbb-aafc-4d38-bfa4-2bf63afbc2f8 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:35.327115 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8a3d6-cbb8-4a99-aec8-b02df98188ae admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:35.327592 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8a3d6-cbb8-4a99-aec8-b02df98188ae admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:35.333255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8a3d6-cbb8-4a99-aec8-b02df98188ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:08:35.335133 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8a3d6-cbb8-4a99-aec8-b02df98188ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:35.352879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8a3d6-cbb8-4a99-aec8-b02df98188ae admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:35.460087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 853/1703] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:08:35.464047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9830d-2917-4593-8611-3531af3e55a2 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:35.466464 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9830d-2917-4593-8611-3531af3e55a2 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:35.466969 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9830d-2917-4593-8611-3531af3e55a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:35.475238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 851/1704] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:35 2022] POST /identity/v3/projects => generated 373 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:35.475238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc63fbb-aafc-4d38-bfa4-2bf63afbc2f8 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:35.490566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ffc63fbb-aafc-4d38-bfa4-2bf63afbc2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:35.581277 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-0aa9830d-2917-4593-8611-3531af3e55a2 None None] MFA Rules not processed for user `01f9842a079c4f759d16aa3b3826a774`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:35.585288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0aa9830d-2917-4593-8611-3531af3e55a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:35.712425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:35.734379 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc63fbb-aafc-4d38-bfa4-2bf63afbc2f8 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:35.747715 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200235d-69c1-4c07-9950-337022fd249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:35.748705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200235d-69c1-4c07-9950-337022fd249b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:35.750301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200235d-69c1-4c07-9950-337022fd249b admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:35.750920 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200235d-69c1-4c07-9950-337022fd249b admin admin] PATH_INFO: `/v3/users/e8ad0967772e4e9187075fb093940b36` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:35.754915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 854/1705] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:35.757700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200235d-69c1-4c07-9950-337022fd249b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ad0967772e4e9187075fb093940b36)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:35.762233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9830d-2917-4593-8611-3531af3e55a2 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:35.765628 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200235d-69c1-4c07-9950-337022fd249b admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:35.778414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9830d-2917-4593-8611-3531af3e55a2 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:35.786256 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e074d-79cb-4bba-bd2f-17fe01c3f68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:35.787009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e074d-79cb-4bba-bd2f-17fe01c3f68f admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:35.787386 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e074d-79cb-4bba-bd2f-17fe01c3f68f admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:35.787728 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e074d-79cb-4bba-bd2f-17fe01c3f68f admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:35.788518 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e074d-79cb-4bba-bd2f-17fe01c3f68f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:35.791152 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e074d-79cb-4bba-bd2f-17fe01c3f68f admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:35.833505 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 855/1706] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:35 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:35.833505 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e074d-79cb-4bba-bd2f-17fe01c3f68f admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:35.879631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:35.898890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0200235d-69c1-4c07-9950-337022fd249b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ad0967772e4e9187075fb093940b36'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:35.901637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0200235d-69c1-4c07-9950-337022fd249b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ad0967772e4e9187075fb093940b36'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:35.922564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0200235d-69c1-4c07-9950-337022fd249b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ad0967772e4e9187075fb093940b36'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:35.928107 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0200235d-69c1-4c07-9950-337022fd249b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ad0967772e4e9187075fb093940b36'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:35.942074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0200235d-69c1-4c07-9950-337022fd249b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ad0967772e4e9187075fb093940b36'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:35.983813 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 852/1707] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:35 2022] DELETE /identity/v3/users/e8ad0967772e4e9187075fb093940b36 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:35.984747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200235d-69c1-4c07-9950-337022fd249b admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:35.987958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0200235d-69c1-4c07-9950-337022fd249b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:36.018682 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e074d-79cb-4bba-bd2f-17fe01c3f68f admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:36.192256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200235d-69c1-4c07-9950-337022fd249b admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:36.208189 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7908e-9321-4715-a3e1-e53f27d6545f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:36.208881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7908e-9321-4715-a3e1-e53f27d6545f admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:36.209160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7908e-9321-4715-a3e1-e53f27d6545f admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:36.209431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7908e-9321-4715-a3e1-e53f27d6545f admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:36.210177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7908e-9321-4715-a3e1-e53f27d6545f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:36.212254 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7908e-9321-4715-a3e1-e53f27d6545f admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:36.229597 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca6279-0648-4212-bea3-bdbba22bd7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:36.231455 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca6279-0648-4212-bea3-bdbba22bd7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:36.233176 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca6279-0648-4212-bea3-bdbba22bd7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:36.236104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca6279-0648-4212-bea3-bdbba22bd7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:36.239453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca6279-0648-4212-bea3-bdbba22bd7b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:36.245036 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca6279-0648-4212-bea3-bdbba22bd7b7 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:36.328167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 853/1708] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:35 2022] POST /identity/v3/projects => generated 387 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:36.329250 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7908e-9321-4715-a3e1-e53f27d6545f admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:36.329555 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 856/1709] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:35 2022] POST /identity/v3/users => generated 287 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:36.336693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d3498-1216-41a1-8acf-cd80b0c949be None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:36.336892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d3498-1216-41a1-8acf-cd80b0c949be None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:36.337495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d3498-1216-41a1-8acf-cd80b0c949be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:36.350079 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-43f7908e-9321-4715-a3e1-e53f27d6545f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:36.407083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-9b0d3498-1216-41a1-8acf-cd80b0c949be None None] MFA Rules not processed for user `e4a0c3740593402c955abe8ce23640c4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:36.408757 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9b0d3498-1216-41a1-8acf-cd80b0c949be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:36.579340 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7908e-9321-4715-a3e1-e53f27d6545f admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:36.595496 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acaa3e-6bf4-4b5c-a960-98c02d186de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:36.597727 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acaa3e-6bf4-4b5c-a960-98c02d186de6 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:36.598223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acaa3e-6bf4-4b5c-a960-98c02d186de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:36.598745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acaa3e-6bf4-4b5c-a960-98c02d186de6 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:36.599622 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acaa3e-6bf4-4b5c-a960-98c02d186de6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:36.607186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acaa3e-6bf4-4b5c-a960-98c02d186de6 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:36.668643 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 854/1710] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:36 2022] POST /identity/v3/users => generated 290 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:36.672566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acaa3e-6bf4-4b5c-a960-98c02d186de6 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:36.712428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acaa3e-6bf4-4b5c-a960-98c02d186de6 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:36.746953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:36.752717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab116d-168d-456c-890c-3e6e62bac956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:36.754398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab116d-168d-456c-890c-3e6e62bac956 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:36.754695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab116d-168d-456c-890c-3e6e62bac956 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:36.754974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab116d-168d-456c-890c-3e6e62bac956 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:36.755654 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab116d-168d-456c-890c-3e6e62bac956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:36.771843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab116d-168d-456c-890c-3e6e62bac956 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:36.777832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 857/1711] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:36.780862 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d3498-1216-41a1-8acf-cd80b0c949be None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:36.786712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9b0d3498-1216-41a1-8acf-cd80b0c949be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:36.882038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d3498-1216-41a1-8acf-cd80b0c949be None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:36.887150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 855/1712] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:36 2022] POST /identity/v3/users => generated 300 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:36.897127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab116d-168d-456c-890c-3e6e62bac956 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:36.899010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af69ad5-97b0-40a2-aee0-79a70df0d626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:36.899657 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af69ad5-97b0-40a2-aee0-79a70df0d626 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:36.899943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af69ad5-97b0-40a2-aee0-79a70df0d626 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:36.900221 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af69ad5-97b0-40a2-aee0-79a70df0d626 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:36.900933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af69ad5-97b0-40a2-aee0-79a70df0d626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:36.902678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af69ad5-97b0-40a2-aee0-79a70df0d626 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:36.928063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 858/1713] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:36.929054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af69ad5-97b0-40a2-aee0-79a70df0d626 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:36.938687 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7af69ad5-97b0-40a2-aee0-79a70df0d626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:36.946412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab116d-168d-456c-890c-3e6e62bac956 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:36.954729 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13349bd9-874d-4e86-a6fa-b4e76e41ecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:36.956074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13349bd9-874d-4e86-a6fa-b4e76e41ecd3 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:36.956492 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13349bd9-874d-4e86-a6fa-b4e76e41ecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:36.956766 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13349bd9-874d-4e86-a6fa-b4e76e41ecd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:36.958074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13349bd9-874d-4e86-a6fa-b4e76e41ecd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:36.961503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13349bd9-874d-4e86-a6fa-b4e76e41ecd3 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:36.980406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af69ad5-97b0-40a2-aee0-79a70df0d626 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:36.994053 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 856/1714] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:36.995102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13349bd9-874d-4e86-a6fa-b4e76e41ecd3 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:36.996182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:36.997273 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:36.999267 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:37.000286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84 admin admin] PATH_INFO: `/v3/projects/e33491a16e0f4c449b39f08a3b5de47d` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:37.001062 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-13349bd9-874d-4e86-a6fa-b4e76e41ecd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:37.004222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33491a16e0f4c449b39f08a3b5de47d)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:37.015901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:37.023446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:DELETE=5,keystone:SELECT=87,keystone:INSERT=8 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:37.141569 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33491a16e0f4c449b39f08a3b5de47d', 'request_id': 'req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:37.153833 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33491a16e0f4c449b39f08a3b5de47d', 'request_id': 'req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:37.167524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33491a16e0f4c449b39f08a3b5de47d', 'request_id': 'req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:37.200612 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84 admin admin] The token cache is being invalidate because project e33491a16e0f4c449b39f08a3b5de47d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:08:37.203110 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:37.206050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:37.210801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 859/1715] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:08:36 2022] DELETE /identity/v3/projects/e33491a16e0f4c449b39f08a3b5de47d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:37.213331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:37.217660 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:37.248291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13349bd9-874d-4e86-a6fa-b4e76e41ecd3 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:37.371091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede9d27-ccd0-4b1f-ba44-33bf968c8c84 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:37.383674 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008fd41-2c40-4b76-bdf4-f692bdc2b526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:37.385785 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008fd41-2c40-4b76-bdf4-f692bdc2b526 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:37.386077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008fd41-2c40-4b76-bdf4-f692bdc2b526 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:37.386739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008fd41-2c40-4b76-bdf4-f692bdc2b526 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:37.387563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008fd41-2c40-4b76-bdf4-f692bdc2b526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:37.389218 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008fd41-2c40-4b76-bdf4-f692bdc2b526 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:37.404620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 860/1716] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:37.405567 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008fd41-2c40-4b76-bdf4-f692bdc2b526 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:37.410326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6008fd41-2c40-4b76-bdf4-f692bdc2b526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:37.429891 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95827b9-4782-43b9-b0c3-7955f06e3f07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:37.430859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95827b9-4782-43b9-b0c3-7955f06e3f07 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:37.431310 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95827b9-4782-43b9-b0c3-7955f06e3f07 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:37.431797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95827b9-4782-43b9-b0c3-7955f06e3f07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:37.432751 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008fd41-2c40-4b76-bdf4-f692bdc2b526 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:37.435863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a95827b9-4782-43b9-b0c3-7955f06e3f07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:37.439743 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00ffeb-1271-4dee-a60d-d674705bb2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:37.440358 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00ffeb-1271-4dee-a60d-d674705bb2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:37.440689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00ffeb-1271-4dee-a60d-d674705bb2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:37.440963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00ffeb-1271-4dee-a60d-d674705bb2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:37.441635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00ffeb-1271-4dee-a60d-d674705bb2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:37.443415 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00ffeb-1271-4dee-a60d-d674705bb2a9 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:37.456731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 861/1717] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:37.457697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00ffeb-1271-4dee-a60d-d674705bb2a9 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:37.463325 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6c00ffeb-1271-4dee-a60d-d674705bb2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:37.493796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00ffeb-1271-4dee-a60d-d674705bb2a9 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:37.500531 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3af60-afb0-40ac-ae17-d60b055f2a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:37.501231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3af60-afb0-40ac-ae17-d60b055f2a28 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:37.501519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3af60-afb0-40ac-ae17-d60b055f2a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:37.501795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3af60-afb0-40ac-ae17-d60b055f2a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:37.502516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3af60-afb0-40ac-ae17-d60b055f2a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:37.504575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3af60-afb0-40ac-ae17-d60b055f2a28 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:37.524294 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 862/1718] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:37.526096 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c76e7-672f-4795-ac3e-d77a380ddecd None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:37.526564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c76e7-672f-4795-ac3e-d77a380ddecd None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:37.526858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c76e7-672f-4795-ac3e-d77a380ddecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:37.556305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-202c76e7-672f-4795-ac3e-d77a380ddecd None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:37.557599 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-202c76e7-672f-4795-ac3e-d77a380ddecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:37.564342 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95827b9-4782-43b9-b0c3-7955f06e3f07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:37.566952 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95827b9-4782-43b9-b0c3-7955f06e3f07 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:37.581320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 857/1719] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:37.582467 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95827b9-4782-43b9-b0c3-7955f06e3f07 service nova] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:37.598325 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95827b9-4782-43b9-b0c3-7955f06e3f07 service nova] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:37.601877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 863/1720] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:37.603932 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c76e7-672f-4795-ac3e-d77a380ddecd None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:37.605155 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972d93a-1ca2-4d8c-82bc-2018c134a8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:37.606598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972d93a-1ca2-4d8c-82bc-2018c134a8df admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:37.607004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972d93a-1ca2-4d8c-82bc-2018c134a8df admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:37.607373 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972d93a-1ca2-4d8c-82bc-2018c134a8df admin admin] PATH_INFO: `/v3/projects/c3ba742231994ab594e97920e3116108/users/2491bcc634d546858dcb969dca554dee/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:37.628634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972d93a-1ca2-4d8c-82bc-2018c134a8df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ba742231994ab594e97920e3116108, user_id=2491bcc634d546858dcb969dca554dee, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:37.633702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972d93a-1ca2-4d8c-82bc-2018c134a8df admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:37.637515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c76e7-672f-4795-ac3e-d77a380ddecd None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:37.659049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa344d4-4a47-47b1-ab44-55a958df3068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:37.660159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa344d4-4a47-47b1-ab44-55a958df3068 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:37.662358 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa344d4-4a47-47b1-ab44-55a958df3068 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:37.662960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa344d4-4a47-47b1-ab44-55a958df3068 admin admin] PATH_INFO: `/v3/projects/14908a1989104e1cb87109a202dcacaf/users/0d3e4b80a2df4853b55a99e82d1321b0/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:37.683756 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 858/1721] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:37 2022] PUT /identity/v3/projects/c3ba742231994ab594e97920e3116108/users/2491bcc634d546858dcb969dca554dee/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:37.685766 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972d93a-1ca2-4d8c-82bc-2018c134a8df admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:37.747061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:37.791755 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa344d4-4a47-47b1-ab44-55a958df3068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14908a1989104e1cb87109a202dcacaf, user_id=0d3e4b80a2df4853b55a99e82d1321b0, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:37.814913 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa344d4-4a47-47b1-ab44-55a958df3068 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:37.873672 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 864/1722] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:37 2022] PUT /identity/v3/projects/14908a1989104e1cb87109a202dcacaf/users/0d3e4b80a2df4853b55a99e82d1321b0/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:37.876527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d170c4-7708-4665-99f3-8dd1b79ba7bb None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:37.877983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d170c4-7708-4665-99f3-8dd1b79ba7bb None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:37.878386 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d170c4-7708-4665-99f3-8dd1b79ba7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:37.891888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972d93a-1ca2-4d8c-82bc-2018c134a8df admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:37.938191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-04d170c4-7708-4665-99f3-8dd1b79ba7bb None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:37.950092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-04d170c4-7708-4665-99f3-8dd1b79ba7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:37.993102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:38.124463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea5266-0001-4e61-a9f4-6a20334bcd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:38.127444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea5266-0001-4e61-a9f4-6a20334bcd65 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:38.131419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea5266-0001-4e61-a9f4-6a20334bcd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:38.131999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea5266-0001-4e61-a9f4-6a20334bcd65 admin admin] PATH_INFO: `/v3/projects/6b55c0a5fcc144fea0e3acfc0c426428/users/afff682f4fa2465abcf00cf53083a500/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:38.177498 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea5266-0001-4e61-a9f4-6a20334bcd65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b55c0a5fcc144fea0e3acfc0c426428, user_id=afff682f4fa2465abcf00cf53083a500, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:38.181655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 865/1723] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:38.181655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d170c4-7708-4665-99f3-8dd1b79ba7bb None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:38.184184 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea5266-0001-4e61-a9f4-6a20334bcd65 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:38.224804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d170c4-7708-4665-99f3-8dd1b79ba7bb None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:38.239925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 859/1724] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:37 2022] PUT /identity/v3/projects/6b55c0a5fcc144fea0e3acfc0c426428/users/afff682f4fa2465abcf00cf53083a500/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:38.242884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175631ed-f374-4a91-aefe-e1bab72d2523 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:38.246401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175631ed-f374-4a91-aefe-e1bab72d2523 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:38.248177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175631ed-f374-4a91-aefe-e1bab72d2523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:38.446723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-175631ed-f374-4a91-aefe-e1bab72d2523 None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:38.448943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-175631ed-f374-4a91-aefe-e1bab72d2523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:38.459671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde31a01-b63b-4e78-a459-c97e82c15dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:38.460569 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde31a01-b63b-4e78-a459-c97e82c15dcc admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:38.462006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde31a01-b63b-4e78-a459-c97e82c15dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:38.463157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde31a01-b63b-4e78-a459-c97e82c15dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:38.466447 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde31a01-b63b-4e78-a459-c97e82c15dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:38.472570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde31a01-b63b-4e78-a459-c97e82c15dcc admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:38.559822 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 866/1725] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:38.561409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb421d-9297-4c72-85da-e4028b810c2f None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:38.561710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb421d-9297-4c72-85da-e4028b810c2f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:38.561989 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb421d-9297-4c72-85da-e4028b810c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:38.633188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 860/1726] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Sep 7 13:08:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:38.638265 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175631ed-f374-4a91-aefe-e1bab72d2523 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:38.668433 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175631ed-f374-4a91-aefe-e1bab72d2523 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:38.670294 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-faeb421d-9297-4c72-85da-e4028b810c2f None None] MFA Rules not processed for user `0d3e4b80a2df4853b55a99e82d1321b0`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:38.671777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-faeb421d-9297-4c72-85da-e4028b810c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:38.679022 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d643a00-44b1-456e-9171-b1915d1ab56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:38.681503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643a00-44b1-456e-9171-b1915d1ab56d admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:38.681503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643a00-44b1-456e-9171-b1915d1ab56d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:38.681822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643a00-44b1-456e-9171-b1915d1ab56d admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:38.682990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d643a00-44b1-456e-9171-b1915d1ab56d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:08:38.683366 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d643a00-44b1-456e-9171-b1915d1ab56d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:38.685335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d643a00-44b1-456e-9171-b1915d1ab56d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:38.742175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 861/1727] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:08:38.742175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80206a5c-2e97-4269-9699-db730d162dba None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:38.742175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80206a5c-2e97-4269-9699-db730d162dba None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:38.742175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80206a5c-2e97-4269-9699-db730d162dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:38.763027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:38.825423 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-80206a5c-2e97-4269-9699-db730d162dba None None] MFA Rules not processed for user `afff682f4fa2465abcf00cf53083a500`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:38.828404 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-80206a5c-2e97-4269-9699-db730d162dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:38.902871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 867/1728] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:38.909950 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb421d-9297-4c72-85da-e4028b810c2f None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:38.937912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb421d-9297-4c72-85da-e4028b810c2f None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:38.958476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64342f-6a1f-4b15-b690-15ccd504d7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:38.959509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64342f-6a1f-4b15-b690-15ccd504d7c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:38.959802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64342f-6a1f-4b15-b690-15ccd504d7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:38.960082 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64342f-6a1f-4b15-b690-15ccd504d7c5 admin admin] PATH_INFO: `/v3/projects/c3ba742231994ab594e97920e3116108/users/2491bcc634d546858dcb969dca554dee/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:38.962258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64342f-6a1f-4b15-b690-15ccd504d7c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ba742231994ab594e97920e3116108, user_id=2491bcc634d546858dcb969dca554dee, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:38.965880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64342f-6a1f-4b15-b690-15ccd504d7c5 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:39.002608 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 868/1729] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:38 2022] PUT /identity/v3/projects/c3ba742231994ab594e97920e3116108/users/2491bcc634d546858dcb969dca554dee/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:39.004155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64342f-6a1f-4b15-b690-15ccd504d7c5 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:39.007059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 862/1730] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:39.008851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80206a5c-2e97-4269-9699-db730d162dba None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:39.017108 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-80206a5c-2e97-4269-9699-db730d162dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:39.091099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:39.140589 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80206a5c-2e97-4269-9699-db730d162dba None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:39.175956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64342f-6a1f-4b15-b690-15ccd504d7c5 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:39.185914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3eccb7-fedc-4aa5-acab-f56b48ca5830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:39.187012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3eccb7-fedc-4aa5-acab-f56b48ca5830 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:39.187811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3eccb7-fedc-4aa5-acab-f56b48ca5830 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:39.189321 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3eccb7-fedc-4aa5-acab-f56b48ca5830 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:39.189972 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3eccb7-fedc-4aa5-acab-f56b48ca5830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:39.194395 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3eccb7-fedc-4aa5-acab-f56b48ca5830 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:39.272852 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 869/1731] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:39 2022] POST /identity/v3/projects => generated 365 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:39.274500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3eccb7-fedc-4aa5-acab-f56b48ca5830 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:39.277665 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5f3eccb7-fedc-4aa5-acab-f56b48ca5830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:39.278664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a30f1-0786-42f0-87ee-fb47aa52a62c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:39.281019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a30f1-0786-42f0-87ee-fb47aa52a62c service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:39.282158 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a30f1-0786-42f0-87ee-fb47aa52a62c service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:39.282730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a30f1-0786-42f0-87ee-fb47aa52a62c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:39.340744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:39.387291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a30f1-0786-42f0-87ee-fb47aa52a62c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:39.390204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a30f1-0786-42f0-87ee-fb47aa52a62c service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:39.420866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 863/1732] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:39.420866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a30f1-0786-42f0-87ee-fb47aa52a62c service nova] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:39.451722 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a30f1-0786-42f0-87ee-fb47aa52a62c service nova] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:39.578354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3eccb7-fedc-4aa5-acab-f56b48ca5830 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:39.585499 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274717c-ab75-4de4-8f10-056174bf9956 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:39.586788 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274717c-ab75-4de4-8f10-056174bf9956 service swift] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:39.587476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274717c-ab75-4de4-8f10-056174bf9956 service swift] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:39.587824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274717c-ab75-4de4-8f10-056174bf9956 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:39.633477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bee94e-ed5c-4ac9-9d7f-fcf99beba768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:39.634495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bee94e-ed5c-4ac9-9d7f-fcf99beba768 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:39.634954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bee94e-ed5c-4ac9-9d7f-fcf99beba768 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:39.635392 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bee94e-ed5c-4ac9-9d7f-fcf99beba768 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:39.640511 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bee94e-ed5c-4ac9-9d7f-fcf99beba768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:39.649616 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bee94e-ed5c-4ac9-9d7f-fcf99beba768 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:39.733759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274717c-ab75-4de4-8f10-056174bf9956 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:39.737398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274717c-ab75-4de4-8f10-056174bf9956 service swift] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:39.758982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 864/1733] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:39 2022] POST /identity/v3/projects => generated 377 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:39.758982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd48d1-9286-4789-b9ed-55259ec53a1c None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:39.758982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd48d1-9286-4789-b9ed-55259ec53a1c None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:39.758982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd48d1-9286-4789-b9ed-55259ec53a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:39.808981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 870/1734] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:08:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:08:39.808981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274717c-ab75-4de4-8f10-056174bf9956 service swift] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:39.890593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274717c-ab75-4de4-8f10-056174bf9956 service swift] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:39.965255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:39.975656 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-c1dd48d1-9286-4789-b9ed-55259ec53a1c None None] MFA Rules not processed for user `2491bcc634d546858dcb969dca554dee`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:39.975656 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c1dd48d1-9286-4789-b9ed-55259ec53a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:40.059136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b887ce7-2ec4-4bc0-ae0d-30e781e83bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:40.060336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b887ce7-2ec4-4bc0-ae0d-30e781e83bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:40.060670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b887ce7-2ec4-4bc0-ae0d-30e781e83bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:40.061125 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b887ce7-2ec4-4bc0-ae0d-30e781e83bb8 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:40.062531 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b887ce7-2ec4-4bc0-ae0d-30e781e83bb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:40.068022 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b887ce7-2ec4-4bc0-ae0d-30e781e83bb8 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:40.139671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 871/1735] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:39 2022] POST /identity/v3/users => generated 283 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:40.141304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b887ce7-2ec4-4bc0-ae0d-30e781e83bb8 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:40.203771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b887ce7-2ec4-4bc0-ae0d-30e781e83bb8 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:40.238371 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7060f68-db07-406d-973d-7598aa65e78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:40.242895 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060f68-db07-406d-973d-7598aa65e78a admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:40.243251 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060f68-db07-406d-973d-7598aa65e78a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:40.243617 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060f68-db07-406d-973d-7598aa65e78a admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:40.249589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7060f68-db07-406d-973d-7598aa65e78a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:40.257074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7060f68-db07-406d-973d-7598aa65e78a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:40.342440 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 865/1736] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 587 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:40.349276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd48d1-9286-4789-b9ed-55259ec53a1c None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:40.396137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 872/1737] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:40 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:40.397841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7060f68-db07-406d-973d-7598aa65e78a admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:40.413954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd48d1-9286-4789-b9ed-55259ec53a1c None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:40.435141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76616a50-d899-474f-af30-d390ed0492df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:40.436297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616a50-d899-474f-af30-d390ed0492df admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:40.436735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616a50-d899-474f-af30-d390ed0492df admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:40.438301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616a50-d899-474f-af30-d390ed0492df admin admin] PATH_INFO: `/v3/users/0d3e4b80a2df4853b55a99e82d1321b0` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:40.446251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76616a50-d899-474f-af30-d390ed0492df admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3e4b80a2df4853b55a99e82d1321b0)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:40.446423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7060f68-db07-406d-973d-7598aa65e78a admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:40.481065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76616a50-d899-474f-af30-d390ed0492df admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:40.490949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd05f9-9e71-491c-9ce0-3df6a614b6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:40.492086 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd05f9-9e71-491c-9ce0-3df6a614b6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:40.492545 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd05f9-9e71-491c-9ce0-3df6a614b6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:40.493038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd05f9-9e71-491c-9ce0-3df6a614b6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:40.494278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd05f9-9e71-491c-9ce0-3df6a614b6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:40.504810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd05f9-9e71-491c-9ce0-3df6a614b6d8 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:40.552429 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 873/1738] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:40.552687 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11889834-2b33-4cfe-9f09-e4fdfbf4e6d5 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:40.552996 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11889834-2b33-4cfe-9f09-e4fdfbf4e6d5 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:40.553168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11889834-2b33-4cfe-9f09-e4fdfbf4e6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:40.638989 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:40.653491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-11889834-2b33-4cfe-9f09-e4fdfbf4e6d5 None None] MFA Rules not processed for user `a48139e448064f27bb93baea83ae6697`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:40.654778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-11889834-2b33-4cfe-9f09-e4fdfbf4e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:40.709443 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-76616a50-d899-474f-af30-d390ed0492df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3e4b80a2df4853b55a99e82d1321b0'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:40.716144 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-76616a50-d899-474f-af30-d390ed0492df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3e4b80a2df4853b55a99e82d1321b0'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:40.747384 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-76616a50-d899-474f-af30-d390ed0492df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3e4b80a2df4853b55a99e82d1321b0'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:40.749478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-76616a50-d899-474f-af30-d390ed0492df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3e4b80a2df4853b55a99e82d1321b0'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:40.787864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-76616a50-d899-474f-af30-d390ed0492df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3e4b80a2df4853b55a99e82d1321b0'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:40.891027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 866/1739] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:40 2022] DELETE /identity/v3/users/0d3e4b80a2df4853b55a99e82d1321b0 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:40.892389 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76616a50-d899-474f-af30-d390ed0492df admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:40.914382 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-76616a50-d899-474f-af30-d390ed0492df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:40.923807 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 874/1740] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:40.929524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11889834-2b33-4cfe-9f09-e4fdfbf4e6d5 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:40.932306 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-11889834-2b33-4cfe-9f09-e4fdfbf4e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:40.996588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11889834-2b33-4cfe-9f09-e4fdfbf4e6d5 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:41.257902 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33696cbc-23b7-4b58-b108-a253f5ca64d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:41.258848 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33696cbc-23b7-4b58-b108-a253f5ca64d0 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:41.259229 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33696cbc-23b7-4b58-b108-a253f5ca64d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:41.259666 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33696cbc-23b7-4b58-b108-a253f5ca64d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:41.261238 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33696cbc-23b7-4b58-b108-a253f5ca64d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:41.265961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33696cbc-23b7-4b58-b108-a253f5ca64d0 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:41.297715 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76616a50-d899-474f-af30-d390ed0492df admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:41.306689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 875/1741] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:41.308669 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33696cbc-23b7-4b58-b108-a253f5ca64d0 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:41.310980 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-33696cbc-23b7-4b58-b108-a253f5ca64d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:41.313204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b695b-a2ec-4a1f-9fc7-e132eec64978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:41.313868 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b695b-a2ec-4a1f-9fc7-e132eec64978 service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:41.314145 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b695b-a2ec-4a1f-9fc7-e132eec64978 service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:41.314407 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b695b-a2ec-4a1f-9fc7-e132eec64978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:41.322042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f05b695b-a2ec-4a1f-9fc7-e132eec64978 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:41.333020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33696cbc-23b7-4b58-b108-a253f5ca64d0 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:41.341777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c9827-bd76-4444-9a75-a3b81a5312c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:41.342883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c9827-bd76-4444-9a75-a3b81a5312c3 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:41.344298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c9827-bd76-4444-9a75-a3b81a5312c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:41.345104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c9827-bd76-4444-9a75-a3b81a5312c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:41.346773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c9827-bd76-4444-9a75-a3b81a5312c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:41.349837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c9827-bd76-4444-9a75-a3b81a5312c3 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:41.386956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 876/1742] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:41.388854 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696ffcd-055b-4c97-9681-a1b370f15039 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:41.389421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696ffcd-055b-4c97-9681-a1b370f15039 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:41.409152 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696ffcd-055b-4c97-9681-a1b370f15039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:41.460257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-b696ffcd-055b-4c97-9681-a1b370f15039 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:41.462367 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b696ffcd-055b-4c97-9681-a1b370f15039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:41.474866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 877/1743] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:41.478403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296afedf-d21c-423e-b689-6facb6282f90 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:41.479603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296afedf-d21c-423e-b689-6facb6282f90 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:41.480817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296afedf-d21c-423e-b689-6facb6282f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:41.513800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:41.555978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-296afedf-d21c-423e-b689-6facb6282f90 None None] MFA Rules not processed for user `a48139e448064f27bb93baea83ae6697`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:41.561279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-296afedf-d21c-423e-b689-6facb6282f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:41.567916 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b695b-a2ec-4a1f-9fc7-e132eec64978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:41.572488 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b695b-a2ec-4a1f-9fc7-e132eec64978 service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:41.645162 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 867/1744] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:41.646153 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b695b-a2ec-4a1f-9fc7-e132eec64978 service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:41.680943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b695b-a2ec-4a1f-9fc7-e132eec64978 service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:41.696759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04936d0-a4b9-448d-bcd5-2e97dc81da2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:41.697406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04936d0-a4b9-448d-bcd5-2e97dc81da2c admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:41.697686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04936d0-a4b9-448d-bcd5-2e97dc81da2c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:41.697956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04936d0-a4b9-448d-bcd5-2e97dc81da2c admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:41.698636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04936d0-a4b9-448d-bcd5-2e97dc81da2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:41.701304 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04936d0-a4b9-448d-bcd5-2e97dc81da2c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:41.743435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 868/1745] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:41.744148 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04936d0-a4b9-448d-bcd5-2e97dc81da2c admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:41.778238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04936d0-a4b9-448d-bcd5-2e97dc81da2c admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:41.799714 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad6ef8-bf36-4c5f-8295-8a279a085ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:41.800491 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad6ef8-bf36-4c5f-8295-8a279a085ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:41.800780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad6ef8-bf36-4c5f-8295-8a279a085ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:41.801061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad6ef8-bf36-4c5f-8295-8a279a085ab6 admin admin] PATH_INFO: `/v3/projects/1abf6b96c08a4dbeb8ce90bacb91d4cc/users/06da1d21e4334271aebaa74b432bf762/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:41.873643 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad6ef8-bf36-4c5f-8295-8a279a085ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1abf6b96c08a4dbeb8ce90bacb91d4cc, user_id=06da1d21e4334271aebaa74b432bf762, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:41.878851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad6ef8-bf36-4c5f-8295-8a279a085ab6 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:41.915986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 869/1746] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:41 2022] PUT /identity/v3/projects/1abf6b96c08a4dbeb8ce90bacb91d4cc/users/06da1d21e4334271aebaa74b432bf762/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:41.917441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad6ef8-bf36-4c5f-8295-8a279a085ab6 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:41.943978 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-54ad6ef8-bf36-4c5f-8295-8a279a085ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:42.021475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 878/1747] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 545 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:42.023705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296afedf-d21c-423e-b689-6facb6282f90 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:42.068644 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:42.070043 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296afedf-d21c-423e-b689-6facb6282f90 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:42.211213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad6ef8-bf36-4c5f-8295-8a279a085ab6 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:42.233606 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b6062-f1ed-4c93-b892-ea4b0f3f4b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:42.235675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b6062-f1ed-4c93-b892-ea4b0f3f4b28 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:42.235675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b6062-f1ed-4c93-b892-ea4b0f3f4b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:42.236354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b6062-f1ed-4c93-b892-ea4b0f3f4b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:42.246151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77f20-4b88-4ee3-ab87-806633de570e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:42.246920 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77f20-4b88-4ee3-ab87-806633de570e admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:42.247339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77f20-4b88-4ee3-ab87-806633de570e admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:42.247714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77f20-4b88-4ee3-ab87-806633de570e admin admin] PATH_INFO: `/v3/projects/9017056e6a9e4bbf921c7f13f9a1c0e9/users/1a936c3c28934407b36453891d8d993d/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:42.290677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e77f20-4b88-4ee3-ab87-806633de570e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9017056e6a9e4bbf921c7f13f9a1c0e9, user_id=1a936c3c28934407b36453891d8d993d, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:42.295552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e77f20-4b88-4ee3-ab87-806633de570e admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:42.355737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 879/1748] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:42 2022] PUT /identity/v3/projects/9017056e6a9e4bbf921c7f13f9a1c0e9/users/1a936c3c28934407b36453891d8d993d/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:42.366931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77f20-4b88-4ee3-ab87-806633de570e admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:42.366931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a2e77f20-4b88-4ee3-ab87-806633de570e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:42.451962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b6062-f1ed-4c93-b892-ea4b0f3f4b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:42.454156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b6062-f1ed-4c93-b892-ea4b0f3f4b28 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:42.485298 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 870/1749] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:42.487571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54168bc-e145-4962-a420-68343c170b26 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:42.488033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54168bc-e145-4962-a420-68343c170b26 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:42.488505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54168bc-e145-4962-a420-68343c170b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:42.608221 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-e54168bc-e145-4962-a420-68343c170b26 None None] MFA Rules not processed for user `06da1d21e4334271aebaa74b432bf762`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:42.611366 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-e54168bc-e145-4962-a420-68343c170b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:42.671541 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77f20-4b88-4ee3-ab87-806633de570e admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:42.717693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de42b4-93d4-4961-9789-8fbe9847c2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:42.719023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de42b4-93d4-4961-9789-8fbe9847c2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:42.719496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de42b4-93d4-4961-9789-8fbe9847c2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:42.719991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de42b4-93d4-4961-9789-8fbe9847c2e0 admin admin] PATH_INFO: `/v3/users/01f9842a079c4f759d16aa3b3826a774` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:42.725868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de42b4-93d4-4961-9789-8fbe9847c2e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f9842a079c4f759d16aa3b3826a774)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:42.728167 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de42b4-93d4-4961-9789-8fbe9847c2e0 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:42.906080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:42.955513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-60de42b4-93d4-4961-9789-8fbe9847c2e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f9842a079c4f759d16aa3b3826a774'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:42.957619 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-60de42b4-93d4-4961-9789-8fbe9847c2e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f9842a079c4f759d16aa3b3826a774'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:42.992290 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-60de42b4-93d4-4961-9789-8fbe9847c2e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f9842a079c4f759d16aa3b3826a774'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:43.048811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-60de42b4-93d4-4961-9789-8fbe9847c2e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f9842a079c4f759d16aa3b3826a774'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:43.076716 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 871/1750] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 591 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:43.079202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a3f32-6245-4ab4-b6a2-2d3338caa356 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:43.082852 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a3f32-6245-4ab4-b6a2-2d3338caa356 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:43.084818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a3f32-6245-4ab4-b6a2-2d3338caa356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:43.092570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-60de42b4-93d4-4961-9789-8fbe9847c2e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f9842a079c4f759d16aa3b3826a774'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:43.132353 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 880/1751] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:42 2022] DELETE /identity/v3/users/01f9842a079c4f759d16aa3b3826a774 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:43.134281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de42b4-93d4-4961-9789-8fbe9847c2e0 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:43.139333 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-60de42b4-93d4-4961-9789-8fbe9847c2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:43.188188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-4c7a3f32-6245-4ab4-b6a2-2d3338caa356 None None] MFA Rules not processed for user `eefd1293a22848e3b595e54be0455d10`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:43.196354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4c7a3f32-6245-4ab4-b6a2-2d3338caa356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:43.437840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 872/1752] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Sep 7 13:08:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:43.439352 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7400e0b-7618-4f96-b474-208ba48ed7e0 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:43.439666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7400e0b-7618-4f96-b474-208ba48ed7e0 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:43.439954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7400e0b-7618-4f96-b474-208ba48ed7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:43.462091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de42b4-93d4-4961-9789-8fbe9847c2e0 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:43.495153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465143a-1bf4-4c7a-a264-dffb2318b7be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:43.495896 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465143a-1bf4-4c7a-a264-dffb2318b7be service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:43.496329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465143a-1bf4-4c7a-a264-dffb2318b7be service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:43.496645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465143a-1bf4-4c7a-a264-dffb2318b7be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:43.506403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8465143a-1bf4-4c7a-a264-dffb2318b7be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:43.528607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:43.544516 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-d7400e0b-7618-4f96-b474-208ba48ed7e0 None None] MFA Rules not processed for user `1a936c3c28934407b36453891d8d993d`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:43.556132 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d7400e0b-7618-4f96-b474-208ba48ed7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:43.779242 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465143a-1bf4-4c7a-a264-dffb2318b7be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:43.792179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465143a-1bf4-4c7a-a264-dffb2318b7be service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:43.870100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 881/1753] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:43.872415 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465143a-1bf4-4c7a-a264-dffb2318b7be service nova] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:43.881035 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8465143a-1bf4-4c7a-a264-dffb2318b7be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:43.930554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 873/1754] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:43.942935 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139fecc-f87a-4647-90de-c6081d9a46ba None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:43.944818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139fecc-f87a-4647-90de-c6081d9a46ba None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:43.945731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139fecc-f87a-4647-90de-c6081d9a46ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:44.058847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-d139fecc-f87a-4647-90de-c6081d9a46ba None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:44.064085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d139fecc-f87a-4647-90de-c6081d9a46ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:44.149774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:44.210026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 874/1755] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:44.211536 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139fecc-f87a-4647-90de-c6081d9a46ba None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:44.214975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d139fecc-f87a-4647-90de-c6081d9a46ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:44.239088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465143a-1bf4-4c7a-a264-dffb2318b7be service nova] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:44.242814 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139fecc-f87a-4647-90de-c6081d9a46ba None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:44.248239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728dbb1-55f5-4da7-86e1-45e850eaf220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:44.251252 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728dbb1-55f5-4da7-86e1-45e850eaf220 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:44.251823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728dbb1-55f5-4da7-86e1-45e850eaf220 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:44.252169 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728dbb1-55f5-4da7-86e1-45e850eaf220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:44.262574 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e18b3-5dd2-4b81-a11d-6c022ae29893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:44.264412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e18b3-5dd2-4b81-a11d-6c022ae29893 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:44.264702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e18b3-5dd2-4b81-a11d-6c022ae29893 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:44.275054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e18b3-5dd2-4b81-a11d-6c022ae29893 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:44.280620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e18b3-5dd2-4b81-a11d-6c022ae29893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:44.286017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e18b3-5dd2-4b81-a11d-6c022ae29893 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:44.296717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728dbb1-55f5-4da7-86e1-45e850eaf220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:44.302496 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728dbb1-55f5-4da7-86e1-45e850eaf220 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:44.338881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 875/1756] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:44.340814 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728dbb1-55f5-4da7-86e1-45e850eaf220 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:44.343985 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2728dbb1-55f5-4da7-86e1-45e850eaf220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:44.393231 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728dbb1-55f5-4da7-86e1-45e850eaf220 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:44.402907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a646c-9d03-47d8-81bc-ec893ec59ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:44.403803 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a646c-9d03-47d8-81bc-ec893ec59ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:44.404177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a646c-9d03-47d8-81bc-ec893ec59ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:44.404652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a646c-9d03-47d8-81bc-ec893ec59ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:44.405948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a646c-9d03-47d8-81bc-ec893ec59ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:44.408167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a646c-9d03-47d8-81bc-ec893ec59ff2 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:44.456412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 882/1757] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:43 2022] POST /identity/v3/projects => generated 365 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:44.461583 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e18b3-5dd2-4b81-a11d-6c022ae29893 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:44.473118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 876/1758] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:44 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:44.474881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a646c-9d03-47d8-81bc-ec893ec59ff2 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:44.494591 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b10a646c-9d03-47d8-81bc-ec893ec59ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:44.663379 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a646c-9d03-47d8-81bc-ec893ec59ff2 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:44.676854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:44.681417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:44.681899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:44.682259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48 admin admin] PATH_INFO: `/v3/projects/14908a1989104e1cb87109a202dcacaf` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:44.686303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14908a1989104e1cb87109a202dcacaf)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:44.690350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:44.701953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e18b3-5dd2-4b81-a11d-6c022ae29893 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:44.741822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:44.839097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017e796-d5b0-439e-95f5-4eeeae628f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:44.841304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017e796-d5b0-439e-95f5-4eeeae628f64 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:44.842960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017e796-d5b0-439e-95f5-4eeeae628f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:44.843757 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017e796-d5b0-439e-95f5-4eeeae628f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:44.891675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14908a1989104e1cb87109a202dcacaf', 'request_id': 'req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:44.908837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017e796-d5b0-439e-95f5-4eeeae628f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:44.911813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017e796-d5b0-439e-95f5-4eeeae628f64 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:44.912155 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14908a1989104e1cb87109a202dcacaf', 'request_id': 'req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:44.926775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14908a1989104e1cb87109a202dcacaf', 'request_id': 'req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:44.939187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 883/1759] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:44.942059 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af564a-942f-4ede-b5ce-b13d3153be77 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:44.942800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af564a-942f-4ede-b5ce-b13d3153be77 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:44.943473 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af564a-942f-4ede-b5ce-b13d3153be77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:44.966570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48 admin admin] The token cache is being invalidate because project 14908a1989104e1cb87109a202dcacaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:08:44.968023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:44.969345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:44.972946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 877/1760] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:08:44 2022] DELETE /identity/v3/projects/14908a1989104e1cb87109a202dcacaf => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:44.974294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:44.977290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:45.009569 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-88af564a-942f-4ede-b5ce-b13d3153be77 None None] MFA Rules not processed for user `e4a0c3740593402c955abe8ce23640c4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:45.025800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-88af564a-942f-4ede-b5ce-b13d3153be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:45.203326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff8db5-c173-4db2-aafd-f2d4515bbc48 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:45.237538 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b71c8-81e4-4793-aa73-adf7a857e73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:45.241095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b71c8-81e4-4793-aa73-adf7a857e73d admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:45.241909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b71c8-81e4-4793-aa73-adf7a857e73d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:45.241909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b71c8-81e4-4793-aa73-adf7a857e73d admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:45.247464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b71c8-81e4-4793-aa73-adf7a857e73d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:45.254354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b71c8-81e4-4793-aa73-adf7a857e73d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:45.260076 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 884/1761] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:45.261571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af564a-942f-4ede-b5ce-b13d3153be77 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:45.297453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-88af564a-942f-4ede-b5ce-b13d3153be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:45.345380 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 878/1762] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:44 2022] POST /identity/v3/users => generated 289 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:45.346941 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d352f3-732b-4ae7-9035-837689d0c192 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:45.347238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d352f3-732b-4ae7-9035-837689d0c192 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:45.347504 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d352f3-732b-4ae7-9035-837689d0c192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:45.384588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af564a-942f-4ede-b5ce-b13d3153be77 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:45.396972 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a023dd-fb41-479e-961f-a8ed293df0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:45.398388 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a023dd-fb41-479e-961f-a8ed293df0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:45.399360 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a023dd-fb41-479e-961f-a8ed293df0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:45.400023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a023dd-fb41-479e-961f-a8ed293df0e4 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:45.401884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a023dd-fb41-479e-961f-a8ed293df0e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:45.407157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a023dd-fb41-479e-961f-a8ed293df0e4 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:45.412614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-c4d352f3-732b-4ae7-9035-837689d0c192 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:45.424908 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c4d352f3-732b-4ae7-9035-837689d0c192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:45.476996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 879/1763] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:45.478338 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d352f3-732b-4ae7-9035-837689d0c192 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:45.507378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 885/1764] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:45 2022] POST /identity/v3/users => generated 295 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:45.510994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d352f3-732b-4ae7-9035-837689d0c192 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:45.513281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e574d9-7fd3-4dd1-93b2-3ba2a5226ed2 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:45.516968 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e574d9-7fd3-4dd1-93b2-3ba2a5226ed2 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:45.518073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e574d9-7fd3-4dd1-93b2-3ba2a5226ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:45.532863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbcd4f-23d0-4bbd-9024-c5d40e930572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:45.533520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbcd4f-23d0-4bbd-9024-c5d40e930572 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:45.533889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbcd4f-23d0-4bbd-9024-c5d40e930572 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:45.534161 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbcd4f-23d0-4bbd-9024-c5d40e930572 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:45.534961 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edbcd4f-23d0-4bbd-9024-c5d40e930572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:45.548983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edbcd4f-23d0-4bbd-9024-c5d40e930572 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:45.580487 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 880/1765] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:45.585084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbcd4f-23d0-4bbd-9024-c5d40e930572 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:45.604807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbcd4f-23d0-4bbd-9024-c5d40e930572 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:45.615540 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-a2e574d9-7fd3-4dd1-93b2-3ba2a5226ed2 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:45.618616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a2e574d9-7fd3-4dd1-93b2-3ba2a5226ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:45.621333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b42be0-66ff-47cb-b7cb-b7239820a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:45.624513 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b42be0-66ff-47cb-b7cb-b7239820a92a admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:45.625088 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b42be0-66ff-47cb-b7cb-b7239820a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:45.625251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b42be0-66ff-47cb-b7cb-b7239820a92a admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:45.627916 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b42be0-66ff-47cb-b7cb-b7239820a92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:45.631524 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b42be0-66ff-47cb-b7cb-b7239820a92a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:45.672418 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 881/1766] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:45.672670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 886/1767] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:45.674334 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b42be0-66ff-47cb-b7cb-b7239820a92a admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:45.675036 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e574d9-7fd3-4dd1-93b2-3ba2a5226ed2 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:45.714065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b42be0-66ff-47cb-b7cb-b7239820a92a admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:45.733194 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ffb5e-1bdd-4440-8e1f-242c80a6a832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:45.738093 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e574d9-7fd3-4dd1-93b2-3ba2a5226ed2 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:45.743028 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ffb5e-1bdd-4440-8e1f-242c80a6a832 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:45.743409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ffb5e-1bdd-4440-8e1f-242c80a6a832 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:45.743696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ffb5e-1bdd-4440-8e1f-242c80a6a832 admin admin] PATH_INFO: `/v3/projects/4ecf5d2ba9fb48fdb0f68c53b532c94e/users/94ef861658bb4e579478dee69d52d07f/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:45.782403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2ed39-9c76-422f-b83d-c07d1aa646b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:45.786345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ffb5e-1bdd-4440-8e1f-242c80a6a832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ecf5d2ba9fb48fdb0f68c53b532c94e, user_id=94ef861658bb4e579478dee69d52d07f, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:45.788589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ed39-9c76-422f-b83d-c07d1aa646b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:45.790130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ed39-9c76-422f-b83d-c07d1aa646b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:45.790527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ffb5e-1bdd-4440-8e1f-242c80a6a832 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:45.791462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ed39-9c76-422f-b83d-c07d1aa646b4 admin admin] PATH_INFO: `/v3/projects/57c100ecd14a4bc8987b945d773c0278/users/ffc93e3e71914b299d63be484569da9d/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:45.816403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:45.817878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 882/1768] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:45 2022] PUT /identity/v3/projects/4ecf5d2ba9fb48fdb0f68c53b532c94e/users/94ef861658bb4e579478dee69d52d07f/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:45.834853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ffb5e-1bdd-4440-8e1f-242c80a6a832 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:45.835036 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2ed39-9c76-422f-b83d-c07d1aa646b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c100ecd14a4bc8987b945d773c0278, user_id=ffc93e3e71914b299d63be484569da9d, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:45.839523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2ed39-9c76-422f-b83d-c07d1aa646b4 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:45.878261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 887/1769] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:45 2022] PUT /identity/v3/projects/57c100ecd14a4bc8987b945d773c0278/users/ffc93e3e71914b299d63be484569da9d/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:45.881015 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2ed39-9c76-422f-b83d-c07d1aa646b4 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:46.053516 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:46.121195 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2ed39-9c76-422f-b83d-c07d1aa646b4 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:46.149747 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb719d80-6447-45d3-8a22-b882d7e32a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:46.150999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb719d80-6447-45d3-8a22-b882d7e32a8f admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:46.156478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb719d80-6447-45d3-8a22-b882d7e32a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:46.159317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb719d80-6447-45d3-8a22-b882d7e32a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:46.172926 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb719d80-6447-45d3-8a22-b882d7e32a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:46.191198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb719d80-6447-45d3-8a22-b882d7e32a8f admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:46.253748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ffb5e-1bdd-4440-8e1f-242c80a6a832 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:46.302241 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 888/1770] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:46.304094 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb719d80-6447-45d3-8a22-b882d7e32a8f admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:46.323132 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7276220-6afc-493e-bdf8-cafa5d1dda47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:46.327858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7276220-6afc-493e-bdf8-cafa5d1dda47 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:46.327858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7276220-6afc-493e-bdf8-cafa5d1dda47 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:46.327858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7276220-6afc-493e-bdf8-cafa5d1dda47 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:46.335821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7276220-6afc-493e-bdf8-cafa5d1dda47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:08:46.340421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7276220-6afc-493e-bdf8-cafa5d1dda47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:46.358938 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7276220-6afc-493e-bdf8-cafa5d1dda47 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:46.361348 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb719d80-6447-45d3-8a22-b882d7e32a8f admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:46.380733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3351f59-c274-4dd5-bb23-a88a5d99d6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:46.381767 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3351f59-c274-4dd5-bb23-a88a5d99d6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:46.382346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3351f59-c274-4dd5-bb23-a88a5d99d6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:46.384692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3351f59-c274-4dd5-bb23-a88a5d99d6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:46.386106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3351f59-c274-4dd5-bb23-a88a5d99d6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:46.396474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3351f59-c274-4dd5-bb23-a88a5d99d6c6 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:46.455812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 889/1771] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:46.457394 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3351f59-c274-4dd5-bb23-a88a5d99d6c6 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:46.488231 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 883/1772] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 654 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:08:46.490010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7276220-6afc-493e-bdf8-cafa5d1dda47 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:46.513855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3351f59-c274-4dd5-bb23-a88a5d99d6c6 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:46.529051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422b87b-b2aa-4ab0-b1b9-41e1e25ce2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:46.530867 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422b87b-b2aa-4ab0-b1b9-41e1e25ce2a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:46.531347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422b87b-b2aa-4ab0-b1b9-41e1e25ce2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:46.531828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422b87b-b2aa-4ab0-b1b9-41e1e25ce2a4 admin admin] PATH_INFO: `/v3/projects/4ecf5d2ba9fb48fdb0f68c53b532c94e/users/94ef861658bb4e579478dee69d52d07f/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:46.535363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422b87b-b2aa-4ab0-b1b9-41e1e25ce2a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ecf5d2ba9fb48fdb0f68c53b532c94e, user_id=94ef861658bb4e579478dee69d52d07f, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:46.542951 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422b87b-b2aa-4ab0-b1b9-41e1e25ce2a4 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:46.575480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 890/1773] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:46 2022] PUT /identity/v3/projects/4ecf5d2ba9fb48fdb0f68c53b532c94e/users/94ef861658bb4e579478dee69d52d07f/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:46.589376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7276220-6afc-493e-bdf8-cafa5d1dda47 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:46.595793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422b87b-b2aa-4ab0-b1b9-41e1e25ce2a4 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:46.900064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c4f76-10b3-47f9-8f2f-15219bb0affc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:46.905574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c4f76-10b3-47f9-8f2f-15219bb0affc admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:46.906120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c4f76-10b3-47f9-8f2f-15219bb0affc admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:46.909681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c4f76-10b3-47f9-8f2f-15219bb0affc admin admin] PATH_INFO: `/v3/projects/57c100ecd14a4bc8987b945d773c0278/users/ffc93e3e71914b299d63be484569da9d/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:46.927750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c4f76-10b3-47f9-8f2f-15219bb0affc admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c100ecd14a4bc8987b945d773c0278, user_id=ffc93e3e71914b299d63be484569da9d, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:46.952019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c4f76-10b3-47f9-8f2f-15219bb0affc admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:46.956532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422b87b-b2aa-4ab0-b1b9-41e1e25ce2a4 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:46.977262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437a12a-9a0c-4460-b331-9afd64fa0b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:46.979291 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437a12a-9a0c-4460-b331-9afd64fa0b1e admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:46.979580 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437a12a-9a0c-4460-b331-9afd64fa0b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:46.981724 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437a12a-9a0c-4460-b331-9afd64fa0b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:46.983509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437a12a-9a0c-4460-b331-9afd64fa0b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:46.989952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437a12a-9a0c-4460-b331-9afd64fa0b1e admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:47.037428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 884/1774] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:46 2022] PUT /identity/v3/projects/57c100ecd14a4bc8987b945d773c0278/users/ffc93e3e71914b299d63be484569da9d/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:47.064877 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bbcc3-1565-49b0-9b93-f511561e0a90 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:47.065747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bbcc3-1565-49b0-9b93-f511561e0a90 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:47.066006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bbcc3-1565-49b0-9b93-f511561e0a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:47.079682 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 891/1775] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:46 2022] POST /identity/v3/projects => generated 403 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:47.082962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b6093-52a7-4dc9-ad8b-078370f642c7 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:47.088673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b6093-52a7-4dc9-ad8b-078370f642c7 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:47.089039 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b6093-52a7-4dc9-ad8b-078370f642c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:47.217761 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-f15b6093-52a7-4dc9-ad8b-078370f642c7 None None] MFA Rules not processed for user `ffc93e3e71914b299d63be484569da9d`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:47.220693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-358bbcc3-1565-49b0-9b93-f511561e0a90 None None] MFA Rules not processed for user `94ef861658bb4e579478dee69d52d07f`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:47.222596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f15b6093-52a7-4dc9-ad8b-078370f642c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:47.226482 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-358bbcc3-1565-49b0-9b93-f511561e0a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:47.436586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:47.638780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 885/1776] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 594 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:47.638780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bbcc3-1565-49b0-9b93-f511561e0a90 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:47.639280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 892/1777] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 556 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:47.646546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea49cc0-b056-4160-9df1-b1225e989353 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:47.647495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea49cc0-b056-4160-9df1-b1225e989353 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:47.648883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea49cc0-b056-4160-9df1-b1225e989353 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:47.656800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 893/1778] 10.222.0.30 () {54 vars in 912 bytes} [Wed Sep 7 13:08:47 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:08:47.666244 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa621e-5a21-46c2-9557-8bd581c0acf4 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:47.666952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa621e-5a21-46c2-9557-8bd581c0acf4 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:47.668829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa621e-5a21-46c2-9557-8bd581c0acf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:47.752613 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-e8aa621e-5a21-46c2-9557-8bd581c0acf4 None None] MFA Rules not processed for user `eefd1293a22848e3b595e54be0455d10`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:47.758432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e8aa621e-5a21-46c2-9557-8bd581c0acf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:47.917341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 894/1779] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Sep 7 13:08:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:47.919353 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa621e-5a21-46c2-9557-8bd581c0acf4 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:47.921532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:47.922778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e8aa621e-5a21-46c2-9557-8bd581c0acf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:47.979479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bbcc3-1565-49b0-9b93-f511561e0a90 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:48.000985 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f19245-2c47-43e9-8bcb-dd793c07b27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:48.003653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19245-2c47-43e9-8bcb-dd793c07b27b admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:48.007344 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19245-2c47-43e9-8bcb-dd793c07b27b admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:48.008267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19245-2c47-43e9-8bcb-dd793c07b27b admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:48.013085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f19245-2c47-43e9-8bcb-dd793c07b27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:48.023699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f19245-2c47-43e9-8bcb-dd793c07b27b admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:48.121849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 886/1780] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:47 2022] POST /identity/v3/users => generated 302 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:48.122914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f19245-2c47-43e9-8bcb-dd793c07b27b admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:48.133261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f5f19245-2c47-43e9-8bcb-dd793c07b27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:48.227793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa621e-5a21-46c2-9557-8bd581c0acf4 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:48.242875 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040eb46-c730-47fb-94ed-37e2baa915b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:48.246307 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040eb46-c730-47fb-94ed-37e2baa915b3 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:48.246307 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040eb46-c730-47fb-94ed-37e2baa915b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:48.248522 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040eb46-c730-47fb-94ed-37e2baa915b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:48.283997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040eb46-c730-47fb-94ed-37e2baa915b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:48.285974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040eb46-c730-47fb-94ed-37e2baa915b3 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:48.311430 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f19245-2c47-43e9-8bcb-dd793c07b27b admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:48.317397 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830bff4d-4dcd-43f2-a4f1-4150544fe7ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:48.317976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bff4d-4dcd-43f2-a4f1-4150544fe7ef service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:48.319983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bff4d-4dcd-43f2-a4f1-4150544fe7ef service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:48.319983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bff4d-4dcd-43f2-a4f1-4150544fe7ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:48.326631 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 895/1781] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:48.329260 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040eb46-c730-47fb-94ed-37e2baa915b3 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:48.338348 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a040eb46-c730-47fb-94ed-37e2baa915b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:48.372043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830bff4d-4dcd-43f2-a4f1-4150544fe7ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:48.376004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040eb46-c730-47fb-94ed-37e2baa915b3 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:48.383382 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830bff4d-4dcd-43f2-a4f1-4150544fe7ef service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:48.386369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f50f5-4d46-4353-b1e2-10e2c92f3de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:48.389023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f50f5-4d46-4353-b1e2-10e2c92f3de3 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:48.389280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f50f5-4d46-4353-b1e2-10e2c92f3de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:48.389511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f50f5-4d46-4353-b1e2-10e2c92f3de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:48.435621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 887/1782] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:48.437629 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93232d1-6f56-4d74-a12a-23c78f252bbc None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:48.438930 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f50f5-4d46-4353-b1e2-10e2c92f3de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:48.440453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f50f5-4d46-4353-b1e2-10e2c92f3de3 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:48.441045 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93232d1-6f56-4d74-a12a-23c78f252bbc None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:48.442790 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93232d1-6f56-4d74-a12a-23c78f252bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:48.474456 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 896/1783] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:48.476985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f50f5-4d46-4353-b1e2-10e2c92f3de3 service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:48.506645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f50f5-4d46-4353-b1e2-10e2c92f3de3 service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:48.517307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-c93232d1-6f56-4d74-a12a-23c78f252bbc None None] MFA Rules not processed for user `a48139e448064f27bb93baea83ae6697`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:48.522152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c93232d1-6f56-4d74-a12a-23c78f252bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:48.528595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718f376-d391-4fca-be72-ae74de8bfcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:48.529246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718f376-d391-4fca-be72-ae74de8bfcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:48.529505 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718f376-d391-4fca-be72-ae74de8bfcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:48.529827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718f376-d391-4fca-be72-ae74de8bfcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:48.530433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718f376-d391-4fca-be72-ae74de8bfcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:48.541519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718f376-d391-4fca-be72-ae74de8bfcf3 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:48.598003 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 897/1784] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:48.602889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718f376-d391-4fca-be72-ae74de8bfcf3 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:48.615613 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9718f376-d391-4fca-be72-ae74de8bfcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:48.672754 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718f376-d391-4fca-be72-ae74de8bfcf3 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:48.701632 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939187d4-18e4-4e49-8f6f-a8beb375c1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:48.702330 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939187d4-18e4-4e49-8f6f-a8beb375c1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:48.702619 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939187d4-18e4-4e49-8f6f-a8beb375c1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:48.702899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939187d4-18e4-4e49-8f6f-a8beb375c1c9 admin admin] PATH_INFO: `/v3/projects/748c76235e974c6fafe15dbf92829002` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:48.715869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939187d4-18e4-4e49-8f6f-a8beb375c1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=748c76235e974c6fafe15dbf92829002)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:48.718063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939187d4-18e4-4e49-8f6f-a8beb375c1c9 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:48.800768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 888/1785] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:48.801451 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93232d1-6f56-4d74-a12a-23c78f252bbc None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:48.820136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-939187d4-18e4-4e49-8f6f-a8beb375c1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748c76235e974c6fafe15dbf92829002', 'request_id': 'req-939187d4-18e4-4e49-8f6f-a8beb375c1c9'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:48.832027 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:48.851610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-939187d4-18e4-4e49-8f6f-a8beb375c1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748c76235e974c6fafe15dbf92829002', 'request_id': 'req-939187d4-18e4-4e49-8f6f-a8beb375c1c9'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:48.864233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-939187d4-18e4-4e49-8f6f-a8beb375c1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748c76235e974c6fafe15dbf92829002', 'request_id': 'req-939187d4-18e4-4e49-8f6f-a8beb375c1c9'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:48.884134 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93232d1-6f56-4d74-a12a-23c78f252bbc None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:48.898504 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-939187d4-18e4-4e49-8f6f-a8beb375c1c9 admin admin] The token cache is being invalidate because project 748c76235e974c6fafe15dbf92829002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:08:48.900018 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-939187d4-18e4-4e49-8f6f-a8beb375c1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:48.902560 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-939187d4-18e4-4e49-8f6f-a8beb375c1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:48.906176 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 898/1786] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:08:48 2022] DELETE /identity/v3/projects/748c76235e974c6fafe15dbf92829002 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:48.909319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939187d4-18e4-4e49-8f6f-a8beb375c1c9 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:48.920145 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-939187d4-18e4-4e49-8f6f-a8beb375c1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:49.077691 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790970b-9c3a-479a-b38e-573297b294d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:49.078403 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790970b-9c3a-479a-b38e-573297b294d6 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:49.078688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790970b-9c3a-479a-b38e-573297b294d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:49.078964 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790970b-9c3a-479a-b38e-573297b294d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:49.079865 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790970b-9c3a-479a-b38e-573297b294d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:49.081728 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790970b-9c3a-479a-b38e-573297b294d6 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:49.099139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 889/1787] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:49.099139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790970b-9c3a-479a-b38e-573297b294d6 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:49.109130 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a790970b-9c3a-479a-b38e-573297b294d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:49.127888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790970b-9c3a-479a-b38e-573297b294d6 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:49.137531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40f0e5-79bd-4ac9-802e-c1d4b1dd22e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:49.138311 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40f0e5-79bd-4ac9-802e-c1d4b1dd22e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:49.139046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40f0e5-79bd-4ac9-802e-c1d4b1dd22e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:49.139398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40f0e5-79bd-4ac9-802e-c1d4b1dd22e4 admin admin] PATH_INFO: `/v3/users/2491bcc634d546858dcb969dca554dee` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:49.144951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40f0e5-79bd-4ac9-802e-c1d4b1dd22e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2491bcc634d546858dcb969dca554dee)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:49.148255 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40f0e5-79bd-4ac9-802e-c1d4b1dd22e4 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:49.182365 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939187d4-18e4-4e49-8f6f-a8beb375c1c9 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:49.192173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c8092-3c0c-44d5-b8c4-60ee32a474d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:49.193162 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c8092-3c0c-44d5-b8c4-60ee32a474d3 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:49.193300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c8092-3c0c-44d5-b8c4-60ee32a474d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:49.193839 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c8092-3c0c-44d5-b8c4-60ee32a474d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:49.208877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-eb2c8092-3c0c-44d5-b8c4-60ee32a474d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:49.213788 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:49.336965 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3f40f0e5-79bd-4ac9-802e-c1d4b1dd22e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2491bcc634d546858dcb969dca554dee'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:49.338226 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3f40f0e5-79bd-4ac9-802e-c1d4b1dd22e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2491bcc634d546858dcb969dca554dee'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:49.364686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3f40f0e5-79bd-4ac9-802e-c1d4b1dd22e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2491bcc634d546858dcb969dca554dee'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:49.367237 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3f40f0e5-79bd-4ac9-802e-c1d4b1dd22e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2491bcc634d546858dcb969dca554dee'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:49.411785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3f40f0e5-79bd-4ac9-802e-c1d4b1dd22e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2491bcc634d546858dcb969dca554dee'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:49.469644 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c8092-3c0c-44d5-b8c4-60ee32a474d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:49.471242 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c8092-3c0c-44d5-b8c4-60ee32a474d3 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:49.501106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 899/1788] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:49.502086 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c8092-3c0c-44d5-b8c4-60ee32a474d3 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:49.514346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-eb2c8092-3c0c-44d5-b8c4-60ee32a474d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:49.517756 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 890/1789] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:49 2022] DELETE /identity/v3/users/2491bcc634d546858dcb969dca554dee => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:49.580582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c8092-3c0c-44d5-b8c4-60ee32a474d3 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:49.830865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6cb2a-83d0-4342-adb9-14cb9b2d7222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:49.832607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6cb2a-83d0-4342-adb9-14cb9b2d7222 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:49.832607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6cb2a-83d0-4342-adb9-14cb9b2d7222 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:49.832607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6cb2a-83d0-4342-adb9-14cb9b2d7222 admin admin] PATH_INFO: `/v3/projects/6663d6a216c5469db6b864144abff3cf/users/8060debe543547b4baf3822de9306865/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:49.897358 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6cb2a-83d0-4342-adb9-14cb9b2d7222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6663d6a216c5469db6b864144abff3cf, user_id=8060debe543547b4baf3822de9306865, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:49.903011 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6cb2a-83d0-4342-adb9-14cb9b2d7222 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:49.938401 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 900/1790] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:49 2022] PUT /identity/v3/projects/6663d6a216c5469db6b864144abff3cf/users/8060debe543547b4baf3822de9306865/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:49.953835 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41debcc0-493a-42fe-be71-93b91ff523ae None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:49.954267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41debcc0-493a-42fe-be71-93b91ff523ae None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:49.954885 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41debcc0-493a-42fe-be71-93b91ff523ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:50.070907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-41debcc0-493a-42fe-be71-93b91ff523ae None None] MFA Rules not processed for user `8060debe543547b4baf3822de9306865`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:50.073346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-41debcc0-493a-42fe-be71-93b91ff523ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:50.450832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6cb2a-83d0-4342-adb9-14cb9b2d7222 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:50.462118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-11e6cb2a-83d0-4342-adb9-14cb9b2d7222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:50.462357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 891/1791] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:49 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:50.534189 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:50.647654 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41debcc0-493a-42fe-be71-93b91ff523ae None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:50.651314 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-41debcc0-493a-42fe-be71-93b91ff523ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:50.744983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6cb2a-83d0-4342-adb9-14cb9b2d7222 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:50.760278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420834d2-cb4c-47e8-8fc2-dec90d67e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:50.764863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420834d2-cb4c-47e8-8fc2-dec90d67e116 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:50.765946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420834d2-cb4c-47e8-8fc2-dec90d67e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:50.766232 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420834d2-cb4c-47e8-8fc2-dec90d67e116 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:50.767033 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420834d2-cb4c-47e8-8fc2-dec90d67e116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:50.774625 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420834d2-cb4c-47e8-8fc2-dec90d67e116 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:50.870357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 901/1792] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:50 2022] POST /identity/v3/projects => generated 403 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:50.873855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420834d2-cb4c-47e8-8fc2-dec90d67e116 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:50.878787 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-420834d2-cb4c-47e8-8fc2-dec90d67e116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:50.915158 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41debcc0-493a-42fe-be71-93b91ff523ae None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:51.083174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:51.178279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420834d2-cb4c-47e8-8fc2-dec90d67e116 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:51.202517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e2feb-063b-4bf4-ac64-411da936f810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:51.206328 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e2feb-063b-4bf4-ac64-411da936f810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:51.206774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e2feb-063b-4bf4-ac64-411da936f810 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:51.207226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e2feb-063b-4bf4-ac64-411da936f810 admin admin] PATH_INFO: `/v3/projects/c3ba742231994ab594e97920e3116108` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:51.214042 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e2feb-063b-4bf4-ac64-411da936f810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3ba742231994ab594e97920e3116108)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:51.217670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e2feb-063b-4bf4-ac64-411da936f810 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:51.244455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11a2ee-9b59-46e7-bb6e-17e8cec75eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:51.248910 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11a2ee-9b59-46e7-bb6e-17e8cec75eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:51.248910 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11a2ee-9b59-46e7-bb6e-17e8cec75eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:51.249833 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11a2ee-9b59-46e7-bb6e-17e8cec75eb8 admin admin] PATH_INFO: `/v3/users/06da1d21e4334271aebaa74b432bf762` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:51.258069 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11a2ee-9b59-46e7-bb6e-17e8cec75eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06da1d21e4334271aebaa74b432bf762)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:51.265040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11a2ee-9b59-46e7-bb6e-17e8cec75eb8 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:51.416648 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ae11a2ee-9b59-46e7-bb6e-17e8cec75eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06da1d21e4334271aebaa74b432bf762'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:51.418504 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ae11a2ee-9b59-46e7-bb6e-17e8cec75eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06da1d21e4334271aebaa74b432bf762'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:51.438178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ae11a2ee-9b59-46e7-bb6e-17e8cec75eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06da1d21e4334271aebaa74b432bf762'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:51.439200 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ae11a2ee-9b59-46e7-bb6e-17e8cec75eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06da1d21e4334271aebaa74b432bf762'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:51.454672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ae11a2ee-9b59-46e7-bb6e-17e8cec75eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06da1d21e4334271aebaa74b432bf762'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:51.502763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-df6e2feb-063b-4bf4-ac64-411da936f810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3ba742231994ab594e97920e3116108', 'request_id': 'req-df6e2feb-063b-4bf4-ac64-411da936f810'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:51.528364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-df6e2feb-063b-4bf4-ac64-411da936f810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3ba742231994ab594e97920e3116108', 'request_id': 'req-df6e2feb-063b-4bf4-ac64-411da936f810'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:51.539495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-df6e2feb-063b-4bf4-ac64-411da936f810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3ba742231994ab594e97920e3116108', 'request_id': 'req-df6e2feb-063b-4bf4-ac64-411da936f810'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:51.545035 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 892/1793] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:50 2022] DELETE /identity/v3/users/06da1d21e4334271aebaa74b432bf762 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:08:51.546068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11a2ee-9b59-46e7-bb6e-17e8cec75eb8 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:51.554060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ae11a2ee-9b59-46e7-bb6e-17e8cec75eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:51.570268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-df6e2feb-063b-4bf4-ac64-411da936f810 admin admin] The token cache is being invalidate because project c3ba742231994ab594e97920e3116108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:08:51.572548 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-df6e2feb-063b-4bf4-ac64-411da936f810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:51.575678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-df6e2feb-063b-4bf4-ac64-411da936f810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:51.583788 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 902/1794] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:08:50 2022] DELETE /identity/v3/projects/c3ba742231994ab594e97920e3116108 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:51.584586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24548608-c6d4-416c-873e-ff57d505924f None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:51.587173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24548608-c6d4-416c-873e-ff57d505924f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:51.587571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24548608-c6d4-416c-873e-ff57d505924f None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:51.592588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 903/1795] 10.222.0.30 () {54 vars in 921 bytes} [Wed Sep 7 13:08:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:08:51.598437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905687fb-429a-44f9-8c9c-f640753a8e06 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:51.598798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905687fb-429a-44f9-8c9c-f640753a8e06 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:51.599154 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905687fb-429a-44f9-8c9c-f640753a8e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:51.664851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-905687fb-429a-44f9-8c9c-f640753a8e06 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:51.669810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-905687fb-429a-44f9-8c9c-f640753a8e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:51.763731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:51.861572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 904/1796] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:51.866024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e012e-02ad-4a1e-94ee-7363f6568917 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:51.866024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e012e-02ad-4a1e-94ee-7363f6568917 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:51.866024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e012e-02ad-4a1e-94ee-7363f6568917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:51.909014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11a2ee-9b59-46e7-bb6e-17e8cec75eb8 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:51.918726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-358e012e-02ad-4a1e-94ee-7363f6568917 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:51.920936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-358e012e-02ad-4a1e-94ee-7363f6568917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:51.929178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30319224-7523-44ac-938a-351ed1f6d6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:51.931006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30319224-7523-44ac-938a-351ed1f6d6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:51.932712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30319224-7523-44ac-938a-351ed1f6d6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:51.933946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30319224-7523-44ac-938a-351ed1f6d6d6 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:51.936231 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30319224-7523-44ac-938a-351ed1f6d6d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:51.938746 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 905/1797] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:51.942525 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30319224-7523-44ac-938a-351ed1f6d6d6 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:51.943513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5098ec-1053-4ce7-bc45-92ece56a0cec None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:51.945340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5098ec-1053-4ce7-bc45-92ece56a0cec None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:51.946607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5098ec-1053-4ce7-bc45-92ece56a0cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:52.016227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-0c5098ec-1053-4ce7-bc45-92ece56a0cec None None] MFA Rules not processed for user `fbe8fa8ab8094aa69933398280810692`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:52.017943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0c5098ec-1053-4ce7-bc45-92ece56a0cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:52.046716 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 893/1798] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:51 2022] POST /identity/v3/users => generated 308 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:52.048754 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30319224-7523-44ac-938a-351ed1f6d6d6 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:52.053618 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-30319224-7523-44ac-938a-351ed1f6d6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:52.202610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:52.263609 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30319224-7523-44ac-938a-351ed1f6d6d6 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:52.280295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 906/1799] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Sep 7 13:08:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:52.288820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0d47c-1278-4421-a97b-6aa164de8149 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:52.294558 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e746a85-abe2-4104-a7d5-b77a43a25205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:52.295219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e746a85-abe2-4104-a7d5-b77a43a25205 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:52.295500 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e746a85-abe2-4104-a7d5-b77a43a25205 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:52.295776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e746a85-abe2-4104-a7d5-b77a43a25205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:52.303307 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0d47c-1278-4421-a97b-6aa164de8149 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:52.303935 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0d47c-1278-4421-a97b-6aa164de8149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:52.335104 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e746a85-abe2-4104-a7d5-b77a43a25205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:52.337340 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e746a85-abe2-4104-a7d5-b77a43a25205 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:52.357015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 894/1800] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:52.357930 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e746a85-abe2-4104-a7d5-b77a43a25205 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:52.373604 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4e746a85-abe2-4104-a7d5-b77a43a25205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:52.390828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-f4f0d47c-1278-4421-a97b-6aa164de8149 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:52.392813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f4f0d47c-1278-4421-a97b-6aa164de8149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:52.419772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 907/1801] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:52.424596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0d47c-1278-4421-a97b-6aa164de8149 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:52.444118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0d47c-1278-4421-a97b-6aa164de8149 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:52.454750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e746a85-abe2-4104-a7d5-b77a43a25205 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:52.463885 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ea745-f34a-4b3b-807f-f0a8172ee904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:52.467004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ea745-f34a-4b3b-807f-f0a8172ee904 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:52.467880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ea745-f34a-4b3b-807f-f0a8172ee904 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:52.469190 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ea745-f34a-4b3b-807f-f0a8172ee904 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:52.472804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ea745-f34a-4b3b-807f-f0a8172ee904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:08:52.474351 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ea745-f34a-4b3b-807f-f0a8172ee904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:52.477139 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ea745-f34a-4b3b-807f-f0a8172ee904 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:52.477665 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5b614-f170-4a5a-9fdc-cda510834dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:52.479149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5b614-f170-4a5a-9fdc-cda510834dbf admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:52.483647 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5b614-f170-4a5a-9fdc-cda510834dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:52.485094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5b614-f170-4a5a-9fdc-cda510834dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:52.486693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5b614-f170-4a5a-9fdc-cda510834dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:52.490984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5b614-f170-4a5a-9fdc-cda510834dbf admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:52.524198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 908/1802] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:08:52.526854 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ea745-f34a-4b3b-807f-f0a8172ee904 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:52.538469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 895/1803] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:52.542486 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5b614-f170-4a5a-9fdc-cda510834dbf admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:52.590760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ea745-f34a-4b3b-807f-f0a8172ee904 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:52.595063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5b614-f170-4a5a-9fdc-cda510834dbf admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:52.602778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa073e-eeca-4b8e-9928-fff573979b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:52.603532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa073e-eeca-4b8e-9928-fff573979b41 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:52.603722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa073e-eeca-4b8e-9928-fff573979b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:52.605360 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa073e-eeca-4b8e-9928-fff573979b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:52.606117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa073e-eeca-4b8e-9928-fff573979b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:52.608694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49d95e-3a03-4cea-9eb1-9bfc725d203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:52.609389 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49d95e-3a03-4cea-9eb1-9bfc725d203f admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:52.609671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49d95e-3a03-4cea-9eb1-9bfc725d203f admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:52.609948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49d95e-3a03-4cea-9eb1-9bfc725d203f admin admin] PATH_INFO: `/v3/projects/8d362cd12e1443c8b520e231ed04ee6c/users/fa6af9af232e44a7b5e732b635270c25/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:52.612648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa073e-eeca-4b8e-9928-fff573979b41 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:52.651765 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49d95e-3a03-4cea-9eb1-9bfc725d203f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d362cd12e1443c8b520e231ed04ee6c, user_id=fa6af9af232e44a7b5e732b635270c25, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:52.656843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49d95e-3a03-4cea-9eb1-9bfc725d203f admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:52.703407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 909/1804] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:52 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:52.704551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa073e-eeca-4b8e-9928-fff573979b41 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:52.712124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-61aa073e-eeca-4b8e-9928-fff573979b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:52.715050 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 896/1805] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:52 2022] PUT /identity/v3/projects/8d362cd12e1443c8b520e231ed04ee6c/users/fa6af9af232e44a7b5e732b635270c25/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:52.715880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49d95e-3a03-4cea-9eb1-9bfc725d203f admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:52.995121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49d95e-3a03-4cea-9eb1-9bfc725d203f admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:53.014891 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de880b-eafc-41df-b184-f940f54d1e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:53.016039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de880b-eafc-41df-b184-f940f54d1e18 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:53.020182 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de880b-eafc-41df-b184-f940f54d1e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:53.021001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de880b-eafc-41df-b184-f940f54d1e18 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:53.022902 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de880b-eafc-41df-b184-f940f54d1e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:53.025563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa073e-eeca-4b8e-9928-fff573979b41 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:53.028217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de880b-eafc-41df-b184-f940f54d1e18 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:53.041985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:53.131259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 897/1806] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:52 2022] POST /identity/v3/users => generated 293 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:53.133668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de880b-eafc-41df-b184-f940f54d1e18 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:53.177667 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de880b-eafc-41df-b184-f940f54d1e18 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:53.191944 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ff1c6-3e69-4105-9251-78a583f873d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:53.202018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ff1c6-3e69-4105-9251-78a583f873d4 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:53.202711 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ff1c6-3e69-4105-9251-78a583f873d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:53.204507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ff1c6-3e69-4105-9251-78a583f873d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:53.207059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ff1c6-3e69-4105-9251-78a583f873d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:53.211803 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ff1c6-3e69-4105-9251-78a583f873d4 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:53.238449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 898/1807] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:53.248098 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ff1c6-3e69-4105-9251-78a583f873d4 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:53.264194 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec00bc-931f-4785-b781-0fa40fe69c3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:53.266728 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec00bc-931f-4785-b781-0fa40fe69c3c service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:53.268547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec00bc-931f-4785-b781-0fa40fe69c3c service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:53.268924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec00bc-931f-4785-b781-0fa40fe69c3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:53.289332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ff1c6-3e69-4105-9251-78a583f873d4 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:53.298699 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec00bc-931f-4785-b781-0fa40fe69c3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:53.302126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec00bc-931f-4785-b781-0fa40fe69c3c service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:53.304564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665faf5b-2298-4b67-9fb0-74a1170a2946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:53.305325 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665faf5b-2298-4b67-9fb0-74a1170a2946 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:53.305715 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665faf5b-2298-4b67-9fb0-74a1170a2946 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:53.305873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665faf5b-2298-4b67-9fb0-74a1170a2946 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:53.306550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665faf5b-2298-4b67-9fb0-74a1170a2946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:53.308239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665faf5b-2298-4b67-9fb0-74a1170a2946 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:53.332837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 910/1808] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:53.333730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec00bc-931f-4785-b781-0fa40fe69c3c service nova] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:53.344822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 899/1809] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:53.345821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665faf5b-2298-4b67-9fb0-74a1170a2946 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:53.368830 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665faf5b-2298-4b67-9fb0-74a1170a2946 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:53.370906 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec00bc-931f-4785-b781-0fa40fe69c3c service nova] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:53.379244 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace288a-f695-48ea-9bd2-0e3fe1d4c361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:53.380871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace288a-f695-48ea-9bd2-0e3fe1d4c361 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:53.381237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace288a-f695-48ea-9bd2-0e3fe1d4c361 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:53.381445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace288a-f695-48ea-9bd2-0e3fe1d4c361 admin admin] PATH_INFO: `/v3/projects/8d362cd12e1443c8b520e231ed04ee6c/users/fa6af9af232e44a7b5e732b635270c25/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:53.385095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace288a-f695-48ea-9bd2-0e3fe1d4c361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d362cd12e1443c8b520e231ed04ee6c, user_id=fa6af9af232e44a7b5e732b635270c25, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:53.388448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02457d-1451-4534-be51-fab684d3dd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:53.390018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02457d-1451-4534-be51-fab684d3dd4c admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:53.390391 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02457d-1451-4534-be51-fab684d3dd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:53.390716 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02457d-1451-4534-be51-fab684d3dd4c admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:53.393462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02457d-1451-4534-be51-fab684d3dd4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:53.396155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace288a-f695-48ea-9bd2-0e3fe1d4c361 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:53.397734 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02457d-1451-4534-be51-fab684d3dd4c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:53.432511 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 900/1810] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:53.433696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02457d-1451-4534-be51-fab684d3dd4c admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:53.443921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 911/1811] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:53 2022] PUT /identity/v3/projects/8d362cd12e1443c8b520e231ed04ee6c/users/fa6af9af232e44a7b5e732b635270c25/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:53.445602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc25d4-284c-498c-bd80-e4a7fe773a20 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:53.445899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc25d4-284c-498c-bd80-e4a7fe773a20 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:53.446194 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc25d4-284c-498c-bd80-e4a7fe773a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:53.475243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02457d-1451-4534-be51-fab684d3dd4c admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:53.670219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-41cc25d4-284c-498c-bd80-e4a7fe773a20 None None] MFA Rules not processed for user `fa6af9af232e44a7b5e732b635270c25`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:53.674301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-41cc25d4-284c-498c-bd80-e4a7fe773a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:54.028982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5430d73-7f5a-488d-94a5-5ccc84892193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:54.048087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5430d73-7f5a-488d-94a5-5ccc84892193 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:54.050297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5430d73-7f5a-488d-94a5-5ccc84892193 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:54.052062 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5430d73-7f5a-488d-94a5-5ccc84892193 admin admin] PATH_INFO: `/v3/projects/2ef19e4982934bc48e625fa9791f557f/users/d2457b03df534edfbe4694cb6dbb844d/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:54.089408 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:54.151405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5430d73-7f5a-488d-94a5-5ccc84892193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef19e4982934bc48e625fa9791f557f, user_id=d2457b03df534edfbe4694cb6dbb844d, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:54.177053 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5430d73-7f5a-488d-94a5-5ccc84892193 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:54.228653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 901/1812] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:53 2022] PUT /identity/v3/projects/2ef19e4982934bc48e625fa9791f557f/users/d2457b03df534edfbe4694cb6dbb844d/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:54.243093 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5430d73-7f5a-488d-94a5-5ccc84892193 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:54.256207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f5430d73-7f5a-488d-94a5-5ccc84892193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:54.347115 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 912/1813] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:53 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 902 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:54.353669 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d25e97-09f0-4057-b87e-2106ba061875 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:54.354156 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d25e97-09f0-4057-b87e-2106ba061875 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:54.354736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d25e97-09f0-4057-b87e-2106ba061875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:54.493698 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-45d25e97-09f0-4057-b87e-2106ba061875 None None] MFA Rules not processed for user `d2457b03df534edfbe4694cb6dbb844d`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:54.502524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-45d25e97-09f0-4057-b87e-2106ba061875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:54.505461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5430d73-7f5a-488d-94a5-5ccc84892193 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:54.521981 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:54.524846 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:54.525650 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:54.526250 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55 admin admin] PATH_INFO: `/v3/projects/1abf6b96c08a4dbeb8ce90bacb91d4cc` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:54.528969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1abf6b96c08a4dbeb8ce90bacb91d4cc)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:54.531432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:54.667017 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1abf6b96c08a4dbeb8ce90bacb91d4cc', 'request_id': 'req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:54.695969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1abf6b96c08a4dbeb8ce90bacb91d4cc', 'request_id': 'req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:54.716650 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1abf6b96c08a4dbeb8ce90bacb91d4cc', 'request_id': 'req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:54.784520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55 admin admin] The token cache is being invalidate because project 1abf6b96c08a4dbeb8ce90bacb91d4cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:08:54.785610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:54.789371 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:54.803300 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 902/1814] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:08:54 2022] DELETE /identity/v3/projects/1abf6b96c08a4dbeb8ce90bacb91d4cc => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:54.805430 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:54.819772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:54.840391 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 913/1815] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:54.845161 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d25e97-09f0-4057-b87e-2106ba061875 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:54.867806 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:54.898252 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d25e97-09f0-4057-b87e-2106ba061875 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:55.081901 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458b5d7-68a9-4b63-9d7d-7207bdba8f55 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:55.102356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b6a9b-ff0d-4e07-a54f-8a9489cd788a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:55.105000 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b6a9b-ff0d-4e07-a54f-8a9489cd788a service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:55.105897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b6a9b-ff0d-4e07-a54f-8a9489cd788a service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:55.108708 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b6a9b-ff0d-4e07-a54f-8a9489cd788a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:55.115835 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-388b6a9b-ff0d-4e07-a54f-8a9489cd788a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:55.156213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc250993-8035-4c88-866d-f6b1b6fd0555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:55.157505 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc250993-8035-4c88-866d-f6b1b6fd0555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:55.158882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc250993-8035-4c88-866d-f6b1b6fd0555 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:55.158882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc250993-8035-4c88-866d-f6b1b6fd0555 admin admin] PATH_INFO: `/v3/users/94ef861658bb4e579478dee69d52d07f` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:55.161638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc250993-8035-4c88-866d-f6b1b6fd0555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ef861658bb4e579478dee69d52d07f)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:55.167456 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc250993-8035-4c88-866d-f6b1b6fd0555 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:55.244657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:55.405656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-dc250993-8035-4c88-866d-f6b1b6fd0555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ef861658bb4e579478dee69d52d07f'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:55.407184 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-dc250993-8035-4c88-866d-f6b1b6fd0555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ef861658bb4e579478dee69d52d07f'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:55.431264 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b6a9b-ff0d-4e07-a54f-8a9489cd788a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:55.438931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b6a9b-ff0d-4e07-a54f-8a9489cd788a service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:55.465583 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-dc250993-8035-4c88-866d-f6b1b6fd0555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ef861658bb4e579478dee69d52d07f'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:55.484685 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 903/1816] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:54 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:55.484685 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b6a9b-ff0d-4e07-a54f-8a9489cd788a service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:55.484685 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-388b6a9b-ff0d-4e07-a54f-8a9489cd788a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:55.537431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b6a9b-ff0d-4e07-a54f-8a9489cd788a service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:55.574919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-dc250993-8035-4c88-866d-f6b1b6fd0555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ef861658bb4e579478dee69d52d07f'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:55.575693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1d098-2785-4a24-b274-db4fc7e5a1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:55.578986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1d098-2785-4a24-b274-db4fc7e5a1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:55.579508 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1d098-2785-4a24-b274-db4fc7e5a1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:55.579967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1d098-2785-4a24-b274-db4fc7e5a1e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:55.581108 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1d098-2785-4a24-b274-db4fc7e5a1e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:55.585096 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1d098-2785-4a24-b274-db4fc7e5a1e4 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:55.633602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-dc250993-8035-4c88-866d-f6b1b6fd0555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ef861658bb4e579478dee69d52d07f'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:55.688658 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 914/1817] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:54 2022] DELETE /identity/v3/users/94ef861658bb4e579478dee69d52d07f => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:55.749649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 904/1818] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:55 2022] POST /identity/v3/projects => generated 387 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:55.753535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc250993-8035-4c88-866d-f6b1b6fd0555 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:55.757631 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-dc250993-8035-4c88-866d-f6b1b6fd0555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:56.102084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1d098-2785-4a24-b274-db4fc7e5a1e4 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:56.110480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a0c1d098-2785-4a24-b274-db4fc7e5a1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:56.167896 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc250993-8035-4c88-866d-f6b1b6fd0555 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:56.327672 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:56.438355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1d098-2785-4a24-b274-db4fc7e5a1e4 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:56.452759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148727e-c137-4b53-8178-418c173a8d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:56.454308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148727e-c137-4b53-8178-418c173a8d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:56.455540 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148727e-c137-4b53-8178-418c173a8d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:56.456267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148727e-c137-4b53-8178-418c173a8d56 admin admin] PATH_INFO: `/v3/users/8060debe543547b4baf3822de9306865` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:56.457592 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dbc4d-10a4-4548-b37a-0c9d260024c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:56.458410 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dbc4d-10a4-4548-b37a-0c9d260024c3 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:56.458695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dbc4d-10a4-4548-b37a-0c9d260024c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:56.458971 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dbc4d-10a4-4548-b37a-0c9d260024c3 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:56.459814 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148727e-c137-4b53-8178-418c173a8d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8060debe543547b4baf3822de9306865)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:56.465444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148727e-c137-4b53-8178-418c173a8d56 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:56.472091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686dbc4d-10a4-4548-b37a-0c9d260024c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:56.474478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686dbc4d-10a4-4548-b37a-0c9d260024c3 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:56.623244 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 915/1819] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:55 2022] POST /identity/v3/users => generated 300 bytes in 871 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:08:56.624359 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dbc4d-10a4-4548-b37a-0c9d260024c3 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:56.637787 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-686dbc4d-10a4-4548-b37a-0c9d260024c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:56.677027 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dbc4d-10a4-4548-b37a-0c9d260024c3 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:56.680512 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4148727e-c137-4b53-8178-418c173a8d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8060debe543547b4baf3822de9306865'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:56.686374 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4148727e-c137-4b53-8178-418c173a8d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8060debe543547b4baf3822de9306865'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:56.695422 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b816c-f2aa-4283-8f79-89adb7c16d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:56.697113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b816c-f2aa-4283-8f79-89adb7c16d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:56.698317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b816c-f2aa-4283-8f79-89adb7c16d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:56.698869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b816c-f2aa-4283-8f79-89adb7c16d2d admin admin] PATH_INFO: `/v3/users/afff682f4fa2465abcf00cf53083a500` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:56.701089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b816c-f2aa-4283-8f79-89adb7c16d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=afff682f4fa2465abcf00cf53083a500)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:56.704108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b816c-f2aa-4283-8f79-89adb7c16d2d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:56.706097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4148727e-c137-4b53-8178-418c173a8d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8060debe543547b4baf3822de9306865'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:56.707207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4148727e-c137-4b53-8178-418c173a8d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8060debe543547b4baf3822de9306865'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:56.741579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4148727e-c137-4b53-8178-418c173a8d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8060debe543547b4baf3822de9306865'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:56.834909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 905/1820] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:56 2022] DELETE /identity/v3/users/8060debe543547b4baf3822de9306865 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:56.835720 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148727e-c137-4b53-8178-418c173a8d56 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:56.842082 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4148727e-c137-4b53-8178-418c173a8d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:56.905841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7d0b816c-f2aa-4283-8f79-89adb7c16d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afff682f4fa2465abcf00cf53083a500'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:56.907515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7d0b816c-f2aa-4283-8f79-89adb7c16d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afff682f4fa2465abcf00cf53083a500'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:56.922807 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7d0b816c-f2aa-4283-8f79-89adb7c16d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afff682f4fa2465abcf00cf53083a500'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:56.953038 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:56.976510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7d0b816c-f2aa-4283-8f79-89adb7c16d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afff682f4fa2465abcf00cf53083a500'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:56.999432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7d0b816c-f2aa-4283-8f79-89adb7c16d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afff682f4fa2465abcf00cf53083a500'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:57.031243 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 916/1821] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:56 2022] DELETE /identity/v3/users/afff682f4fa2465abcf00cf53083a500 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:57.044650 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1b6de-0553-4cc3-b7f5-26632161d964 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:57.044650 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1b6de-0553-4cc3-b7f5-26632161d964 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:57.044650 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1b6de-0553-4cc3-b7f5-26632161d964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:57.112208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-a7d1b6de-0553-4cc3-b7f5-26632161d964 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:57.116876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a7d1b6de-0553-4cc3-b7f5-26632161d964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:57.139845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148727e-c137-4b53-8178-418c173a8d56 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:57.463727 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c837d-8519-43e1-8996-0662eefded29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:57.468267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c837d-8519-43e1-8996-0662eefded29 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:57.469299 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c837d-8519-43e1-8996-0662eefded29 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:57.472560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c837d-8519-43e1-8996-0662eefded29 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:57.474344 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c837d-8519-43e1-8996-0662eefded29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:57.480799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c837d-8519-43e1-8996-0662eefded29 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:57.483703 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 917/1822] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:57.486937 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea1e0a-0001-478b-ac73-dcb739416ae9 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:57.487437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea1e0a-0001-478b-ac73-dcb739416ae9 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:57.488247 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea1e0a-0001-478b-ac73-dcb739416ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:57.531144 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 906/1823] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 696 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:57.540176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c837d-8519-43e1-8996-0662eefded29 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:57.547726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-624c837d-8519-43e1-8996-0662eefded29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:57.588357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c837d-8519-43e1-8996-0662eefded29 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:57.588667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-acea1e0a-0001-478b-ac73-dcb739416ae9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:57.590203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-acea1e0a-0001-478b-ac73-dcb739416ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:57.613872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b84c93-46a6-4ee6-9698-8a5a01aa27a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:57.618119 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b84c93-46a6-4ee6-9698-8a5a01aa27a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:57.619063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b84c93-46a6-4ee6-9698-8a5a01aa27a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:57.620667 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b84c93-46a6-4ee6-9698-8a5a01aa27a7 admin admin] PATH_INFO: `/v3/projects/760a532c95544d60b9cd7aa0da9d4c0e/users/ae8028a6c8b54b44b47c568319724c98/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:57.636026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 918/1824] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:57.653435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea1e0a-0001-478b-ac73-dcb739416ae9 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:57.657790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-acea1e0a-0001-478b-ac73-dcb739416ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:57.691311 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b84c93-46a6-4ee6-9698-8a5a01aa27a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760a532c95544d60b9cd7aa0da9d4c0e, user_id=ae8028a6c8b54b44b47c568319724c98, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:57.703563 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b84c93-46a6-4ee6-9698-8a5a01aa27a7 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:57.752484 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 907/1825] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:57 2022] PUT /identity/v3/projects/760a532c95544d60b9cd7aa0da9d4c0e/users/ae8028a6c8b54b44b47c568319724c98/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:08:57.757662 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b84c93-46a6-4ee6-9698-8a5a01aa27a7 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:57.787198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:57.885691 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea1e0a-0001-478b-ac73-dcb739416ae9 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:57.976554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b84c93-46a6-4ee6-9698-8a5a01aa27a7 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:57.990922 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbbadc-cc1d-4fdd-bec1-afb17efdb21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:57.991934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbbadc-cc1d-4fdd-bec1-afb17efdb21f admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:57.992232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbbadc-cc1d-4fdd-bec1-afb17efdb21f admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:57.992683 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbbadc-cc1d-4fdd-bec1-afb17efdb21f admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:57.993503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbbadc-cc1d-4fdd-bec1-afb17efdb21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:57.995411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbbadc-cc1d-4fdd-bec1-afb17efdb21f admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:58.022120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 908/1826] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:08:58.023077 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbbadc-cc1d-4fdd-bec1-afb17efdb21f admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:58.024962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2efbbadc-cc1d-4fdd-bec1-afb17efdb21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:58.034363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ca22d-9992-4260-8a9e-d15cb9825e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:58.035431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ca22d-9992-4260-8a9e-d15cb9825e20 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:58.035898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ca22d-9992-4260-8a9e-d15cb9825e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:58.037071 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ca22d-9992-4260-8a9e-d15cb9825e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:58.047760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbbadc-cc1d-4fdd-bec1-afb17efdb21f admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:58.052306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a78e7-41f7-400c-9c10-32067bc332ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:58.053080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a78e7-41f7-400c-9c10-32067bc332ff service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:58.053424 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a78e7-41f7-400c-9c10-32067bc332ff service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:58.053773 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a78e7-41f7-400c-9c10-32067bc332ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:58.091257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a78e7-41f7-400c-9c10-32067bc332ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:58.095361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ca22d-9992-4260-8a9e-d15cb9825e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:58.096713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a78e7-41f7-400c-9c10-32067bc332ff service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:58.100019 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ca22d-9992-4260-8a9e-d15cb9825e20 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:58.136771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 919/1827] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:58.138642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ca22d-9992-4260-8a9e-d15cb9825e20 service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:58.141202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 909/1828] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:58.161841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ca22d-9992-4260-8a9e-d15cb9825e20 service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:58.180797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f69229-34f3-43b3-9390-fe4970bb2c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:58.182116 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69229-34f3-43b3-9390-fe4970bb2c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:58.182873 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69229-34f3-43b3-9390-fe4970bb2c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:58.183383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69229-34f3-43b3-9390-fe4970bb2c1a admin admin] PATH_INFO: `/v3/projects/760a532c95544d60b9cd7aa0da9d4c0e/users/ae8028a6c8b54b44b47c568319724c98/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:58.189961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f69229-34f3-43b3-9390-fe4970bb2c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=760a532c95544d60b9cd7aa0da9d4c0e, user_id=ae8028a6c8b54b44b47c568319724c98, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:58.205312 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f69229-34f3-43b3-9390-fe4970bb2c1a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:58.248340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 920/1829] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:58 2022] PUT /identity/v3/projects/760a532c95544d60b9cd7aa0da9d4c0e/users/ae8028a6c8b54b44b47c568319724c98/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:58.258266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a302b8-4b5b-4fff-9141-ca2b43a7486e None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:58.259095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a302b8-4b5b-4fff-9141-ca2b43a7486e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:58.259789 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a302b8-4b5b-4fff-9141-ca2b43a7486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:58.395415 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-54a302b8-4b5b-4fff-9141-ca2b43a7486e None None] MFA Rules not processed for user `ae8028a6c8b54b44b47c568319724c98`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:58.397528 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-54a302b8-4b5b-4fff-9141-ca2b43a7486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:58.452212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:58.614894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 910/1830] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:58.636791 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f69229-34f3-43b3-9390-fe4970bb2c1a admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:58.639850 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-62f69229-34f3-43b3-9390-fe4970bb2c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:58.728738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f69229-34f3-43b3-9390-fe4970bb2c1a admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:58.734162 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99e6c5-030d-4bfc-ab93-7fc63e191560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:58.734763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99e6c5-030d-4bfc-ab93-7fc63e191560 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:58.735050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99e6c5-030d-4bfc-ab93-7fc63e191560 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:58.736028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99e6c5-030d-4bfc-ab93-7fc63e191560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:58.750805 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99e6c5-030d-4bfc-ab93-7fc63e191560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:58.753090 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99e6c5-030d-4bfc-ab93-7fc63e191560 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:58.791513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 921/1831] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:58.931468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a302b8-4b5b-4fff-9141-ca2b43a7486e None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:59.004295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99e6c5-030d-4bfc-ab93-7fc63e191560 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:59.005916 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-db99e6c5-030d-4bfc-ab93-7fc63e191560 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:59.053318 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a302b8-4b5b-4fff-9141-ca2b43a7486e None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:59.062888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280ca86-3d7f-4684-8808-b1f3ad54e075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:59.063579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280ca86-3d7f-4684-8808-b1f3ad54e075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:59.063928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280ca86-3d7f-4684-8808-b1f3ad54e075 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:59.066321 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280ca86-3d7f-4684-8808-b1f3ad54e075 admin admin] PATH_INFO: `/v3/users/d2457b03df534edfbe4694cb6dbb844d` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:59.069318 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280ca86-3d7f-4684-8808-b1f3ad54e075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2457b03df534edfbe4694cb6dbb844d)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:59.072227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280ca86-3d7f-4684-8808-b1f3ad54e075 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:59.177024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99e6c5-030d-4bfc-ab93-7fc63e191560 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:59.188970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272306f-2044-403c-a829-0755e410a8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:59.191505 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272306f-2044-403c-a829-0755e410a8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:59.192681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272306f-2044-403c-a829-0755e410a8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:59.193363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272306f-2044-403c-a829-0755e410a8d1 admin admin] PATH_INFO: `/v3/projects/4ecf5d2ba9fb48fdb0f68c53b532c94e` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:59.196913 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272306f-2044-403c-a829-0755e410a8d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ecf5d2ba9fb48fdb0f68c53b532c94e)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:59.201441 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272306f-2044-403c-a829-0755e410a8d1 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:59.209969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8280ca86-3d7f-4684-8808-b1f3ad54e075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2457b03df534edfbe4694cb6dbb844d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:59.211367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8280ca86-3d7f-4684-8808-b1f3ad54e075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2457b03df534edfbe4694cb6dbb844d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:59.230133 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8280ca86-3d7f-4684-8808-b1f3ad54e075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2457b03df534edfbe4694cb6dbb844d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:59.231808 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8280ca86-3d7f-4684-8808-b1f3ad54e075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2457b03df534edfbe4694cb6dbb844d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:59.246922 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:59.254643 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8280ca86-3d7f-4684-8808-b1f3ad54e075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2457b03df534edfbe4694cb6dbb844d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:59.299763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 911/1832] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:58 2022] DELETE /identity/v3/users/d2457b03df534edfbe4694cb6dbb844d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:59.304530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2103cb0-187b-45cc-be72-a8b46ebb735e None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:59.305001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2103cb0-187b-45cc-be72-a8b46ebb735e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:59.306561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2103cb0-187b-45cc-be72-a8b46ebb735e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:59.340509 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-f2103cb0-187b-45cc-be72-a8b46ebb735e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:59.341832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f2103cb0-187b-45cc-be72-a8b46ebb735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:59.345918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1272306f-2044-403c-a829-0755e410a8d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ecf5d2ba9fb48fdb0f68c53b532c94e', 'request_id': 'req-1272306f-2044-403c-a829-0755e410a8d1'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:59.359709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1272306f-2044-403c-a829-0755e410a8d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ecf5d2ba9fb48fdb0f68c53b532c94e', 'request_id': 'req-1272306f-2044-403c-a829-0755e410a8d1'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:59.372730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1272306f-2044-403c-a829-0755e410a8d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ecf5d2ba9fb48fdb0f68c53b532c94e', 'request_id': 'req-1272306f-2044-403c-a829-0755e410a8d1'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:59.405506 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1272306f-2044-403c-a829-0755e410a8d1 admin admin] The token cache is being invalidate because project 4ecf5d2ba9fb48fdb0f68c53b532c94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:08:59.405854 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1272306f-2044-403c-a829-0755e410a8d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:59.406571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1272306f-2044-403c-a829-0755e410a8d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:59.412670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 922/1833] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:08:59 2022] DELETE /identity/v3/projects/4ecf5d2ba9fb48fdb0f68c53b532c94e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:59.418823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272306f-2044-403c-a829-0755e410a8d1 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:59.420778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:59.422120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1272306f-2044-403c-a829-0755e410a8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:59.529935 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 912/1834] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:59.533136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd4b54-9c63-4141-8d9b-928055bf20c3 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:59.533617 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd4b54-9c63-4141-8d9b-928055bf20c3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:59.534098 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd4b54-9c63-4141-8d9b-928055bf20c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:59.550695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272306f-2044-403c-a829-0755e410a8d1 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:59.562186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97f7d2-4c76-41af-a9d4-0d85b6034a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:59.563024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97f7d2-4c76-41af-a9d4-0d85b6034a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:59.563486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97f7d2-4c76-41af-a9d4-0d85b6034a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:59.563953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97f7d2-4c76-41af-a9d4-0d85b6034a35 admin admin] PATH_INFO: `/v3/projects/6b55c0a5fcc144fea0e3acfc0c426428` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:59.565941 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-1bdd4b54-9c63-4141-8d9b-928055bf20c3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:59.566461 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97f7d2-4c76-41af-a9d4-0d85b6034a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b55c0a5fcc144fea0e3acfc0c426428)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:59.567521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-1bdd4b54-9c63-4141-8d9b-928055bf20c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:59.572321 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97f7d2-4c76-41af-a9d4-0d85b6034a35 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:59.578875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 913/1835] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:59.579984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd4b54-9c63-4141-8d9b-928055bf20c3 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:59.599617 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-1bdd4b54-9c63-4141-8d9b-928055bf20c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:59.694174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd4b54-9c63-4141-8d9b-928055bf20c3 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:59.699445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cd97f7d2-4c76-41af-a9d4-0d85b6034a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b55c0a5fcc144fea0e3acfc0c426428', 'request_id': 'req-cd97f7d2-4c76-41af-a9d4-0d85b6034a35'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:59.715146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cd97f7d2-4c76-41af-a9d4-0d85b6034a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b55c0a5fcc144fea0e3acfc0c426428', 'request_id': 'req-cd97f7d2-4c76-41af-a9d4-0d85b6034a35'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:59.729881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cd97f7d2-4c76-41af-a9d4-0d85b6034a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b55c0a5fcc144fea0e3acfc0c426428', 'request_id': 'req-cd97f7d2-4c76-41af-a9d4-0d85b6034a35'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:59.764620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cd97f7d2-4c76-41af-a9d4-0d85b6034a35 admin admin] The token cache is being invalidate because project 6b55c0a5fcc144fea0e3acfc0c426428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:08:59.765134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cd97f7d2-4c76-41af-a9d4-0d85b6034a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:59.765947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cd97f7d2-4c76-41af-a9d4-0d85b6034a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:59.768129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ec5e3-43a5-4fd8-92c3-5e9c6a7ede0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:59.768812 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ec5e3-43a5-4fd8-92c3-5e9c6a7ede0a service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:59.769146 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ec5e3-43a5-4fd8-92c3-5e9c6a7ede0a service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:59.769423 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ec5e3-43a5-4fd8-92c3-5e9c6a7ede0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:59.769858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 923/1836] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:08:59 2022] DELETE /identity/v3/projects/6b55c0a5fcc144fea0e3acfc0c426428 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:59.771609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e66c2e-d436-4e2f-9dc7-73473bb1b312 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:59.771903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e66c2e-d436-4e2f-9dc7-73473bb1b312 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:59.772156 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e66c2e-d436-4e2f-9dc7-73473bb1b312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:59.774845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0d3ec5e3-43a5-4fd8-92c3-5e9c6a7ede0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:59.801940 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-e5e66c2e-d436-4e2f-9dc7-73473bb1b312 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:59.803496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e5e66c2e-d436-4e2f-9dc7-73473bb1b312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:59.890723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ec5e3-43a5-4fd8-92c3-5e9c6a7ede0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:59.892665 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:59.896014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ec5e3-43a5-4fd8-92c3-5e9c6a7ede0a service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:59.929452 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 914/1837] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:59.931097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ec5e3-43a5-4fd8-92c3-5e9c6a7ede0a service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:59.937174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0d3ec5e3-43a5-4fd8-92c3-5e9c6a7ede0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:59.964447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ec5e3-43a5-4fd8-92c3-5e9c6a7ede0a service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:59.966150 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 924/1838] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:59.971862 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e66c2e-d436-4e2f-9dc7-73473bb1b312 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:59.991674 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e66c2e-d436-4e2f-9dc7-73473bb1b312 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:00.000363 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b62f6-ab27-4986-9b38-ef0c9ac5032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:00.001168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b62f6-ab27-4986-9b38-ef0c9ac5032d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:00.001468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b62f6-ab27-4986-9b38-ef0c9ac5032d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:00.001726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b62f6-ab27-4986-9b38-ef0c9ac5032d admin admin] PATH_INFO: `/v3/users/1a936c3c28934407b36453891d8d993d` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:00.005649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e89a1b-cc20-4f55-b57c-ce75993108ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:00.006304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e89a1b-cc20-4f55-b57c-ce75993108ab admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:00.006586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e89a1b-cc20-4f55-b57c-ce75993108ab admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:00.006861 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e89a1b-cc20-4f55-b57c-ce75993108ab admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:00.007395 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b62f6-ab27-4986-9b38-ef0c9ac5032d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a936c3c28934407b36453891d8d993d)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:00.007557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e89a1b-cc20-4f55-b57c-ce75993108ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:00.007841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e89a1b-cc20-4f55-b57c-ce75993108ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:00.010626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e89a1b-cc20-4f55-b57c-ce75993108ab admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:00.018284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b62f6-ab27-4986-9b38-ef0c9ac5032d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:00.053890 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 925/1839] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:09:00.054619 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e89a1b-cc20-4f55-b57c-ce75993108ab admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:00.076810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e89a1b-cc20-4f55-b57c-ce75993108ab admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:00.092844 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770792d-c4c5-4859-8df3-5be8fb71ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:00.093558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770792d-c4c5-4859-8df3-5be8fb71ec67 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:00.093971 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770792d-c4c5-4859-8df3-5be8fb71ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:00.094255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770792d-c4c5-4859-8df3-5be8fb71ec67 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:00.095089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770792d-c4c5-4859-8df3-5be8fb71ec67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:00.095890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:00.100232 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770792d-c4c5-4859-8df3-5be8fb71ec67 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:00.129222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-378b62f6-ab27-4986-9b38-ef0c9ac5032d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a936c3c28934407b36453891d8d993d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:00.131703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-378b62f6-ab27-4986-9b38-ef0c9ac5032d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a936c3c28934407b36453891d8d993d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:00.162365 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-378b62f6-ab27-4986-9b38-ef0c9ac5032d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a936c3c28934407b36453891d8d993d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:00.166091 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-378b62f6-ab27-4986-9b38-ef0c9ac5032d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a936c3c28934407b36453891d8d993d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:00.189642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-378b62f6-ab27-4986-9b38-ef0c9ac5032d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a936c3c28934407b36453891d8d993d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:00.197984 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 926/1840] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:00 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:09:00.202728 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770792d-c4c5-4859-8df3-5be8fb71ec67 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:00.208581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1770792d-c4c5-4859-8df3-5be8fb71ec67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:00.283659 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 915/1841] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:59 2022] DELETE /identity/v3/users/1a936c3c28934407b36453891d8d993d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:00.441995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770792d-c4c5-4859-8df3-5be8fb71ec67 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:00.462422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b62f6-ab27-4986-9b38-ef0c9ac5032d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:00.466016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-378b62f6-ab27-4986-9b38-ef0c9ac5032d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:00.688074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fd986-7a17-4dbe-9f1b-fdd6ca6e72ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:00.690111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fd986-7a17-4dbe-9f1b-fdd6ca6e72ee admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:00.690568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fd986-7a17-4dbe-9f1b-fdd6ca6e72ee admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:00.691934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fd986-7a17-4dbe-9f1b-fdd6ca6e72ee admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:00.692934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fd986-7a17-4dbe-9f1b-fdd6ca6e72ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:00.696727 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b62f6-ab27-4986-9b38-ef0c9ac5032d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:00.700336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fd986-7a17-4dbe-9f1b-fdd6ca6e72ee admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:00.735726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046ff3b-44a2-4937-a18b-095e717d7142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:00.747202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046ff3b-44a2-4937-a18b-095e717d7142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:00.751068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046ff3b-44a2-4937-a18b-095e717d7142 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:00.752099 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046ff3b-44a2-4937-a18b-095e717d7142 admin admin] PATH_INFO: `/v3/users/8ec856149d154f3d91feb0a010006d3a` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:00.757793 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046ff3b-44a2-4937-a18b-095e717d7142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec856149d154f3d91feb0a010006d3a)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:00.762451 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046ff3b-44a2-4937-a18b-095e717d7142 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:00.765373 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 927/1842] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:00 2022] POST /identity/v3/users => generated 290 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:00.768273 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fd986-7a17-4dbe-9f1b-fdd6ca6e72ee admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:00.787794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fd986-7a17-4dbe-9f1b-fdd6ca6e72ee admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:00.805453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9d2a6-630e-4233-b560-9bce3c81cc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:00.810135 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9d2a6-630e-4233-b560-9bce3c81cc95 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:00.810671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9d2a6-630e-4233-b560-9bce3c81cc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:00.811063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9d2a6-630e-4233-b560-9bce3c81cc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:00.812163 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9d2a6-630e-4233-b560-9bce3c81cc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:00.815302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9d2a6-630e-4233-b560-9bce3c81cc95 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:00.843231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 928/1843] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:00.854787 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9d2a6-630e-4233-b560-9bce3c81cc95 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:00.888393 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9d2a6-630e-4233-b560-9bce3c81cc95 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:00.894994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b046ff3b-44a2-4937-a18b-095e717d7142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec856149d154f3d91feb0a010006d3a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:00.897550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b046ff3b-44a2-4937-a18b-095e717d7142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec856149d154f3d91feb0a010006d3a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:00.906933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aec390-b359-4e83-bfa6-95c2180b52df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:00.907982 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aec390-b359-4e83-bfa6-95c2180b52df admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:00.908487 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aec390-b359-4e83-bfa6-95c2180b52df admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:00.908960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aec390-b359-4e83-bfa6-95c2180b52df admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:00.910070 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aec390-b359-4e83-bfa6-95c2180b52df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:00.913720 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aec390-b359-4e83-bfa6-95c2180b52df admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:00.922850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b046ff3b-44a2-4937-a18b-095e717d7142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec856149d154f3d91feb0a010006d3a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:00.924202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b046ff3b-44a2-4937-a18b-095e717d7142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec856149d154f3d91feb0a010006d3a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:00.951631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b046ff3b-44a2-4937-a18b-095e717d7142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec856149d154f3d91feb0a010006d3a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:00.953792 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 929/1844] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:00.959519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aec390-b359-4e83-bfa6-95c2180b52df admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:00.964332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-41aec390-b359-4e83-bfa6-95c2180b52df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:00.990501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aec390-b359-4e83-bfa6-95c2180b52df admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:00.999515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f81ba9-4670-4f15-ac02-16987a57f857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:01.001428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f81ba9-4670-4f15-ac02-16987a57f857 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:01.002014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f81ba9-4670-4f15-ac02-16987a57f857 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:01.002451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f81ba9-4670-4f15-ac02-16987a57f857 admin admin] PATH_INFO: `/v3/projects/acab7512990b45719c8cfb97f66d14f6/users/a73a9a71cec6494caa70be0293cc10a4/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:01.005694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 916/1845] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:00 2022] DELETE /identity/v3/users/8ec856149d154f3d91feb0a010006d3a => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:01.007106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046ff3b-44a2-4937-a18b-095e717d7142 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:01.010261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b046ff3b-44a2-4937-a18b-095e717d7142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:01.033856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:01.043943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f81ba9-4670-4f15-ac02-16987a57f857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acab7512990b45719c8cfb97f66d14f6, user_id=a73a9a71cec6494caa70be0293cc10a4, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:01.049359 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f81ba9-4670-4f15-ac02-16987a57f857 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:01.082783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 930/1846] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:00 2022] PUT /identity/v3/projects/acab7512990b45719c8cfb97f66d14f6/users/a73a9a71cec6494caa70be0293cc10a4/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:01.085908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d9acb-8613-4105-937d-4027b5a12b71 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:01.087033 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d9acb-8613-4105-937d-4027b5a12b71 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:01.087756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d9acb-8613-4105-937d-4027b5a12b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:01.115866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:01.157694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-3e9d9acb-8613-4105-937d-4027b5a12b71 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:01.160794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-3e9d9acb-8613-4105-937d-4027b5a12b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:01.261595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046ff3b-44a2-4937-a18b-095e717d7142 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:01.288394 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 931/1847] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:01.291276 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a5a0a-10ba-4d5e-ac6d-4b0e17a12d3b None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:01.291651 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a5a0a-10ba-4d5e-ac6d-4b0e17a12d3b None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:01.291825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a5a0a-10ba-4d5e-ac6d-4b0e17a12d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:01.330257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-784a5a0a-10ba-4d5e-ac6d-4b0e17a12d3b None None] MFA Rules not processed for user `a73a9a71cec6494caa70be0293cc10a4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:01.332558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-784a5a0a-10ba-4d5e-ac6d-4b0e17a12d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:01.452865 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:01.454459 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:01.454459 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:01.454947 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9 admin admin] PATH_INFO: `/v3/projects/6663d6a216c5469db6b864144abff3cf` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:01.467848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6663d6a216c5469db6b864144abff3cf)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:01.471822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:01.507940 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 932/1848] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:01.512508 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a5a0a-10ba-4d5e-ac6d-4b0e17a12d3b None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:01.515495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-784a5a0a-10ba-4d5e-ac6d-4b0e17a12d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:01.552439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a5a0a-10ba-4d5e-ac6d-4b0e17a12d3b None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:01.567199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f168246-9503-4921-a1df-eb38253e1310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:01.570837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f168246-9503-4921-a1df-eb38253e1310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:01.571344 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f168246-9503-4921-a1df-eb38253e1310 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:01.572414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f168246-9503-4921-a1df-eb38253e1310 admin admin] PATH_INFO: `/v3/projects/2ef19e4982934bc48e625fa9791f557f` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:01.580136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f168246-9503-4921-a1df-eb38253e1310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef19e4982934bc48e625fa9791f557f)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:01.584351 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f168246-9503-4921-a1df-eb38253e1310 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:01.645183 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6663d6a216c5469db6b864144abff3cf', 'request_id': 'req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:01.671454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6663d6a216c5469db6b864144abff3cf', 'request_id': 'req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:01.688858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6663d6a216c5469db6b864144abff3cf', 'request_id': 'req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:01.736763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9 admin admin] The token cache is being invalidate because project 6663d6a216c5469db6b864144abff3cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:01.737775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:01.744930 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:01.753245 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 917/1849] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:01 2022] DELETE /identity/v3/projects/6663d6a216c5469db6b864144abff3cf => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:01.753245 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:01.773391 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:01.781739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1f168246-9503-4921-a1df-eb38253e1310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef19e4982934bc48e625fa9791f557f', 'request_id': 'req-1f168246-9503-4921-a1df-eb38253e1310'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:01.803826 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1f168246-9503-4921-a1df-eb38253e1310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef19e4982934bc48e625fa9791f557f', 'request_id': 'req-1f168246-9503-4921-a1df-eb38253e1310'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:01.818618 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1f168246-9503-4921-a1df-eb38253e1310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef19e4982934bc48e625fa9791f557f', 'request_id': 'req-1f168246-9503-4921-a1df-eb38253e1310'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:01.867005 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1f168246-9503-4921-a1df-eb38253e1310 admin admin] The token cache is being invalidate because project 2ef19e4982934bc48e625fa9791f557f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:01.867549 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1f168246-9503-4921-a1df-eb38253e1310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:01.868851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1f168246-9503-4921-a1df-eb38253e1310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:01.888099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 933/1850] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:01 2022] DELETE /identity/v3/projects/2ef19e4982934bc48e625fa9791f557f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:01.890475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f168246-9503-4921-a1df-eb38253e1310 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:01.894627 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1f168246-9503-4921-a1df-eb38253e1310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:01.907205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:01.966718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c762b-147e-4eca-95ee-8dd9d93f04d9 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:02.015237 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:02.085658 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f168246-9503-4921-a1df-eb38253e1310 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:02.113553 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60ce95-1f44-4f23-bff0-a26f462d188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:02.115636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60ce95-1f44-4f23-bff0-a26f462d188d admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:02.116414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60ce95-1f44-4f23-bff0-a26f462d188d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:02.118138 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60ce95-1f44-4f23-bff0-a26f462d188d admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:02.119040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60ce95-1f44-4f23-bff0-a26f462d188d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:02.124469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60ce95-1f44-4f23-bff0-a26f462d188d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:02.173018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b0f40-2a48-407a-a1a2-10db4a99ca51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:02.175190 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b0f40-2a48-407a-a1a2-10db4a99ca51 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:02.175658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b0f40-2a48-407a-a1a2-10db4a99ca51 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:02.176175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b0f40-2a48-407a-a1a2-10db4a99ca51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:02.181969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6f9b0f40-2a48-407a-a1a2-10db4a99ca51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:02.199204 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 934/1851] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:01 2022] POST /identity/v3/projects => generated 377 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:02.202053 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60ce95-1f44-4f23-bff0-a26f462d188d admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:02.205334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-3b60ce95-1f44-4f23-bff0-a26f462d188d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:02.234384 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b0f40-2a48-407a-a1a2-10db4a99ca51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:02.239463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b0f40-2a48-407a-a1a2-10db4a99ca51 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:02.267873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 918/1852] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:02.271725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b0f40-2a48-407a-a1a2-10db4a99ca51 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:02.278621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6f9b0f40-2a48-407a-a1a2-10db4a99ca51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:02.333473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b0f40-2a48-407a-a1a2-10db4a99ca51 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:02.506737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60ce95-1f44-4f23-bff0-a26f462d188d admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:02.537232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbb30d-0f3e-46a3-b7a4-d7537fbd4526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:02.542281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58c1ab-79e4-43a6-bb34-25005502ecf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:02.543667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58c1ab-79e4-43a6-bb34-25005502ecf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:02.545489 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58c1ab-79e4-43a6-bb34-25005502ecf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:02.546497 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58c1ab-79e4-43a6-bb34-25005502ecf8 admin admin] PATH_INFO: `/v3/users/fa6af9af232e44a7b5e732b635270c25` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:02.548062 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbb30d-0f3e-46a3-b7a4-d7537fbd4526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:02.548829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbb30d-0f3e-46a3-b7a4-d7537fbd4526 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:02.551335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbb30d-0f3e-46a3-b7a4-d7537fbd4526 admin admin] PATH_INFO: `/v3/users/ae8028a6c8b54b44b47c568319724c98` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:02.553888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58c1ab-79e4-43a6-bb34-25005502ecf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6af9af232e44a7b5e732b635270c25)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:02.556706 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bbb30d-0f3e-46a3-b7a4-d7537fbd4526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8028a6c8b54b44b47c568319724c98)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:02.559879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58c1ab-79e4-43a6-bb34-25005502ecf8 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:02.562675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bbb30d-0f3e-46a3-b7a4-d7537fbd4526 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:02.649452 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-75bbb30d-0f3e-46a3-b7a4-d7537fbd4526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8028a6c8b54b44b47c568319724c98'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:02.663558 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-75bbb30d-0f3e-46a3-b7a4-d7537fbd4526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8028a6c8b54b44b47c568319724c98'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:02.682529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9d58c1ab-79e4-43a6-bb34-25005502ecf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6af9af232e44a7b5e732b635270c25'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:02.684742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9d58c1ab-79e4-43a6-bb34-25005502ecf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6af9af232e44a7b5e732b635270c25'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:02.695940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-75bbb30d-0f3e-46a3-b7a4-d7537fbd4526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8028a6c8b54b44b47c568319724c98'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:02.697589 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-75bbb30d-0f3e-46a3-b7a4-d7537fbd4526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8028a6c8b54b44b47c568319724c98'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:02.706682 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9d58c1ab-79e4-43a6-bb34-25005502ecf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6af9af232e44a7b5e732b635270c25'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:02.741537 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-75bbb30d-0f3e-46a3-b7a4-d7537fbd4526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8028a6c8b54b44b47c568319724c98'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:02.766754 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9d58c1ab-79e4-43a6-bb34-25005502ecf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6af9af232e44a7b5e732b635270c25'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:02.783339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9d58c1ab-79e4-43a6-bb34-25005502ecf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6af9af232e44a7b5e732b635270c25'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:02.791871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 919/1853] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:02 2022] DELETE /identity/v3/users/ae8028a6c8b54b44b47c568319724c98 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:02.793397 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbb30d-0f3e-46a3-b7a4-d7537fbd4526 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:02.798147 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-75bbb30d-0f3e-46a3-b7a4-d7537fbd4526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:02.802837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 935/1854] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:02 2022] DELETE /identity/v3/users/fa6af9af232e44a7b5e732b635270c25 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:02.921984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:02.990830 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbb30d-0f3e-46a3-b7a4-d7537fbd4526 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:03.229724 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58c1ab-79e4-43a6-bb34-25005502ecf8 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:03.233315 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9d58c1ab-79e4-43a6-bb34-25005502ecf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:03.246874 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d71671-07fe-4076-a233-8dfa5965b149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:03.246874 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d71671-07fe-4076-a233-8dfa5965b149 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:03.246874 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d71671-07fe-4076-a233-8dfa5965b149 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:03.250671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d71671-07fe-4076-a233-8dfa5965b149 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:03.250671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d71671-07fe-4076-a233-8dfa5965b149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:03.253444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d71671-07fe-4076-a233-8dfa5965b149 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:03.290900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58c1ab-79e4-43a6-bb34-25005502ecf8 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:03.292206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 920/1855] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:02 2022] POST /identity/v3/users => generated 295 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:03.299226 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d71671-07fe-4076-a233-8dfa5965b149 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:03.305316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533fa16-6df0-4f91-8fd5-4b506ace76a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:03.316120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d71671-07fe-4076-a233-8dfa5965b149 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:03.320842 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533fa16-6df0-4f91-8fd5-4b506ace76a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:03.322793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533fa16-6df0-4f91-8fd5-4b506ace76a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:03.323323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533fa16-6df0-4f91-8fd5-4b506ace76a6 admin admin] PATH_INFO: `/v3/projects/9017056e6a9e4bbf921c7f13f9a1c0e9` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:03.323641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a8916-695f-43a3-82b3-35a33b07e1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:03.324501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a8916-695f-43a3-82b3-35a33b07e1eb admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:03.325419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a8916-695f-43a3-82b3-35a33b07e1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:03.325419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a8916-695f-43a3-82b3-35a33b07e1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:03.326215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a8916-695f-43a3-82b3-35a33b07e1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:03.328447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a8916-695f-43a3-82b3-35a33b07e1eb admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:03.333869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533fa16-6df0-4f91-8fd5-4b506ace76a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9017056e6a9e4bbf921c7f13f9a1c0e9)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:03.338595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533fa16-6df0-4f91-8fd5-4b506ace76a6 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:03.343374 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:03.348843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 921/1856] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:03.350337 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a8916-695f-43a3-82b3-35a33b07e1eb admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:03.363915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a8916-695f-43a3-82b3-35a33b07e1eb admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:03.375028 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc30693-80a3-46a3-adce-4d513d2baf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:03.375810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc30693-80a3-46a3-adce-4d513d2baf73 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:03.376197 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc30693-80a3-46a3-adce-4d513d2baf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:03.376570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc30693-80a3-46a3-adce-4d513d2baf73 admin admin] PATH_INFO: `/v3/projects/287d490927704c5e8fc703a1303b2c6f/users/4a8a7a8f31ad45128d2990de135b89b5/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:03.406118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc30693-80a3-46a3-adce-4d513d2baf73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=287d490927704c5e8fc703a1303b2c6f, user_id=4a8a7a8f31ad45128d2990de135b89b5, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:03.409913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc30693-80a3-46a3-adce-4d513d2baf73 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:03.449244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 922/1857] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:03 2022] PUT /identity/v3/projects/287d490927704c5e8fc703a1303b2c6f/users/4a8a7a8f31ad45128d2990de135b89b5/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:03.461816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc30693-80a3-46a3-adce-4d513d2baf73 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:03.528337 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b533fa16-6df0-4f91-8fd5-4b506ace76a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9017056e6a9e4bbf921c7f13f9a1c0e9', 'request_id': 'req-b533fa16-6df0-4f91-8fd5-4b506ace76a6'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:03.549845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b533fa16-6df0-4f91-8fd5-4b506ace76a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9017056e6a9e4bbf921c7f13f9a1c0e9', 'request_id': 'req-b533fa16-6df0-4f91-8fd5-4b506ace76a6'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:03.609091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b533fa16-6df0-4f91-8fd5-4b506ace76a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9017056e6a9e4bbf921c7f13f9a1c0e9', 'request_id': 'req-b533fa16-6df0-4f91-8fd5-4b506ace76a6'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:03.670843 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b533fa16-6df0-4f91-8fd5-4b506ace76a6 admin admin] The token cache is being invalidate because project 9017056e6a9e4bbf921c7f13f9a1c0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:03.672783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b533fa16-6df0-4f91-8fd5-4b506ace76a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:03.674256 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b533fa16-6df0-4f91-8fd5-4b506ace76a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:03.678099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 936/1858] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:03 2022] DELETE /identity/v3/projects/9017056e6a9e4bbf921c7f13f9a1c0e9 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:03.686111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533fa16-6df0-4f91-8fd5-4b506ace76a6 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:03.693034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b533fa16-6df0-4f91-8fd5-4b506ace76a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:03.783010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc30693-80a3-46a3-adce-4d513d2baf73 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:03.940633 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533fa16-6df0-4f91-8fd5-4b506ace76a6 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:03.962135 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17fe9e-f018-4382-9eec-8ce79c0d9aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:03.962944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17fe9e-f018-4382-9eec-8ce79c0d9aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:03.963231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17fe9e-f018-4382-9eec-8ce79c0d9aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:03.966809 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17fe9e-f018-4382-9eec-8ce79c0d9aa2 admin admin] PATH_INFO: `/v3/users/ffc93e3e71914b299d63be484569da9d` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:03.973572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17fe9e-f018-4382-9eec-8ce79c0d9aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc93e3e71914b299d63be484569da9d)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:03.976191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17fe9e-f018-4382-9eec-8ce79c0d9aa2 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:04.015725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:04.058596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae2a03-de5d-4135-8e85-40a56e9b202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:04.061515 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae2a03-de5d-4135-8e85-40a56e9b202a admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:04.062839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae2a03-de5d-4135-8e85-40a56e9b202a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:04.063673 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae2a03-de5d-4135-8e85-40a56e9b202a admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:04.065719 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae2a03-de5d-4135-8e85-40a56e9b202a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:04.070061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae2a03-de5d-4135-8e85-40a56e9b202a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:04.120105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 923/1859] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 663 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:04.126427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae2a03-de5d-4135-8e85-40a56e9b202a admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:04.130523 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ceae2a03-de5d-4135-8e85-40a56e9b202a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:04.162215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae2a03-de5d-4135-8e85-40a56e9b202a admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:04.170102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba183b-cce0-4bcf-ac90-205746e04edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:04.171387 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba183b-cce0-4bcf-ac90-205746e04edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:04.171907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba183b-cce0-4bcf-ac90-205746e04edb admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:04.172035 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5c17fe9e-f018-4382-9eec-8ce79c0d9aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc93e3e71914b299d63be484569da9d'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:04.172537 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba183b-cce0-4bcf-ac90-205746e04edb admin admin] PATH_INFO: `/v3/projects/760a532c95544d60b9cd7aa0da9d4c0e` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:04.174977 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5c17fe9e-f018-4382-9eec-8ce79c0d9aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc93e3e71914b299d63be484569da9d'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:04.175347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba183b-cce0-4bcf-ac90-205746e04edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=760a532c95544d60b9cd7aa0da9d4c0e)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:04.178156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba183b-cce0-4bcf-ac90-205746e04edb admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:04.197925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5c17fe9e-f018-4382-9eec-8ce79c0d9aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc93e3e71914b299d63be484569da9d'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:04.253731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5c17fe9e-f018-4382-9eec-8ce79c0d9aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc93e3e71914b299d63be484569da9d'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:04.280089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5c17fe9e-f018-4382-9eec-8ce79c0d9aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc93e3e71914b299d63be484569da9d'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:04.295465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 937/1860] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:03 2022] DELETE /identity/v3/users/ffc93e3e71914b299d63be484569da9d => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:09:04.310641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17fe9e-f018-4382-9eec-8ce79c0d9aa2 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:04.313559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5c17fe9e-f018-4382-9eec-8ce79c0d9aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:04.313763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-44ba183b-cce0-4bcf-ac90-205746e04edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760a532c95544d60b9cd7aa0da9d4c0e', 'request_id': 'req-44ba183b-cce0-4bcf-ac90-205746e04edb'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:04.332666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-44ba183b-cce0-4bcf-ac90-205746e04edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760a532c95544d60b9cd7aa0da9d4c0e', 'request_id': 'req-44ba183b-cce0-4bcf-ac90-205746e04edb'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:04.344579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:04.348204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-44ba183b-cce0-4bcf-ac90-205746e04edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760a532c95544d60b9cd7aa0da9d4c0e', 'request_id': 'req-44ba183b-cce0-4bcf-ac90-205746e04edb'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:04.371280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-44ba183b-cce0-4bcf-ac90-205746e04edb admin admin] The token cache is being invalidate because project 760a532c95544d60b9cd7aa0da9d4c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:04.371810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-44ba183b-cce0-4bcf-ac90-205746e04edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:04.372724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-44ba183b-cce0-4bcf-ac90-205746e04edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:04.375394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 924/1861] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:04 2022] DELETE /identity/v3/projects/760a532c95544d60b9cd7aa0da9d4c0e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:04.376419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba183b-cce0-4bcf-ac90-205746e04edb admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:04.379654 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-44ba183b-cce0-4bcf-ac90-205746e04edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:04.534083 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba183b-cce0-4bcf-ac90-205746e04edb admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:04.535713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17fe9e-f018-4382-9eec-8ce79c0d9aa2 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:04.553112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e0386-8cf2-45a1-885f-25f333ac3224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:04.553460 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a5dbf-9831-4eb2-8af9-6d1088668290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:04.554206 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a5dbf-9831-4eb2-8af9-6d1088668290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:04.554647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a5dbf-9831-4eb2-8af9-6d1088668290 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:04.555343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e0386-8cf2-45a1-885f-25f333ac3224 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:04.555799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e0386-8cf2-45a1-885f-25f333ac3224 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:04.559295 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e0386-8cf2-45a1-885f-25f333ac3224 admin admin] PATH_INFO: `/v3/projects/287d490927704c5e8fc703a1303b2c6f/users/4a8a7a8f31ad45128d2990de135b89b5/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:04.560476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a5dbf-9831-4eb2-8af9-6d1088668290 admin admin] PATH_INFO: `/v3/projects/8d362cd12e1443c8b520e231ed04ee6c` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:04.566624 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e0386-8cf2-45a1-885f-25f333ac3224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=287d490927704c5e8fc703a1303b2c6f, user_id=4a8a7a8f31ad45128d2990de135b89b5, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:04.566905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a5dbf-9831-4eb2-8af9-6d1088668290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d362cd12e1443c8b520e231ed04ee6c)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:04.575027 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a5dbf-9831-4eb2-8af9-6d1088668290 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:04.579417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e0386-8cf2-45a1-885f-25f333ac3224 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:04.617896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 925/1862] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:04 2022] PUT /identity/v3/projects/287d490927704c5e8fc703a1303b2c6f/users/4a8a7a8f31ad45128d2990de135b89b5/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:04.617896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710674f5-9ee2-4977-b19b-9ed414923989 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:04.617896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710674f5-9ee2-4977-b19b-9ed414923989 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:04.617896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710674f5-9ee2-4977-b19b-9ed414923989 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:04.633202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 926/1863] 10.222.0.30 () {54 vars in 921 bytes} [Wed Sep 7 13:09:04 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:09:04.654210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7e3f8-36f7-4b0c-905c-fe3f8bf92b51 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:04.654210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7e3f8-36f7-4b0c-905c-fe3f8bf92b51 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:04.654210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7e3f8-36f7-4b0c-905c-fe3f8bf92b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:04.693189 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-3dc7e3f8-36f7-4b0c-905c-fe3f8bf92b51 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:04.696734 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3dc7e3f8-36f7-4b0c-905c-fe3f8bf92b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:04.726293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b09a5dbf-9831-4eb2-8af9-6d1088668290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d362cd12e1443c8b520e231ed04ee6c', 'request_id': 'req-b09a5dbf-9831-4eb2-8af9-6d1088668290'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:04.747326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b09a5dbf-9831-4eb2-8af9-6d1088668290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d362cd12e1443c8b520e231ed04ee6c', 'request_id': 'req-b09a5dbf-9831-4eb2-8af9-6d1088668290'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:04.767765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b09a5dbf-9831-4eb2-8af9-6d1088668290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d362cd12e1443c8b520e231ed04ee6c', 'request_id': 'req-b09a5dbf-9831-4eb2-8af9-6d1088668290'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:04.795656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b09a5dbf-9831-4eb2-8af9-6d1088668290 admin admin] The token cache is being invalidate because project 8d362cd12e1443c8b520e231ed04ee6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:04.795823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b09a5dbf-9831-4eb2-8af9-6d1088668290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:04.797862 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b09a5dbf-9831-4eb2-8af9-6d1088668290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:04.801379 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 938/1864] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:04 2022] DELETE /identity/v3/projects/8d362cd12e1443c8b520e231ed04ee6c => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:04.803308 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870d025-bef5-4de2-b1eb-be0601a82e33 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:04.803903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870d025-bef5-4de2-b1eb-be0601a82e33 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:04.804447 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870d025-bef5-4de2-b1eb-be0601a82e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:04.852266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:04.908133 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 927/1865] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:04.909782 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba304b11-ea0c-406d-8759-b14a26edbf3b None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:04.910122 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba304b11-ea0c-406d-8759-b14a26edbf3b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:04.910402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba304b11-ea0c-406d-8759-b14a26edbf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:04.947325 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-9870d025-bef5-4de2-b1eb-be0601a82e33 None None] MFA Rules not processed for user `4a8a7a8f31ad45128d2990de135b89b5`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:04.948577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9870d025-bef5-4de2-b1eb-be0601a82e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:04.953952 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ba304b11-ea0c-406d-8759-b14a26edbf3b None None] MFA Rules not processed for user `fbe8fa8ab8094aa69933398280810692`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:04.955251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ba304b11-ea0c-406d-8759-b14a26edbf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:05.115679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 928/1866] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Sep 7 13:09:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:05.117355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5f207-6e43-4b9d-a25b-b8182dcc963a None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:05.117940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5f207-6e43-4b9d-a25b-b8182dcc963a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:05.118380 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5f207-6e43-4b9d-a25b-b8182dcc963a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:05.148021 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 939/1867] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:05.150723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-59f5f207-6e43-4b9d-a25b-b8182dcc963a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:05.152806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-59f5f207-6e43-4b9d-a25b-b8182dcc963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:05.160625 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621a551-9878-4016-a85f-9615bf818a58 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:05.161227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621a551-9878-4016-a85f-9615bf818a58 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:05.162108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621a551-9878-4016-a85f-9615bf818a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:05.171071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 929/1868] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:05.171071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5f207-6e43-4b9d-a25b-b8182dcc963a None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:05.171071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-59f5f207-6e43-4b9d-a25b-b8182dcc963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:05.183118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5f207-6e43-4b9d-a25b-b8182dcc963a None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:05.189068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af98983-303c-4a82-bd57-be95514feb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:05.189858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af98983-303c-4a82-bd57-be95514feb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:05.190422 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af98983-303c-4a82-bd57-be95514feb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:05.190711 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af98983-303c-4a82-bd57-be95514feb86 admin admin] PATH_INFO: `/v3/projects/57c100ecd14a4bc8987b945d773c0278` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:05.191973 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af98983-303c-4a82-bd57-be95514feb86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c100ecd14a4bc8987b945d773c0278)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:05.194084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af98983-303c-4a82-bd57-be95514feb86 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:05.239706 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-e621a551-9878-4016-a85f-9615bf818a58 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:05.242102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e621a551-9878-4016-a85f-9615bf818a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:05.276060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 940/1869] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:05.276060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621a551-9878-4016-a85f-9615bf818a58 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:05.278737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e621a551-9878-4016-a85f-9615bf818a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:05.305301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621a551-9878-4016-a85f-9615bf818a58 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:05.309060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3af98983-303c-4a82-bd57-be95514feb86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c100ecd14a4bc8987b945d773c0278', 'request_id': 'req-3af98983-303c-4a82-bd57-be95514feb86'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:05.324549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3af98983-303c-4a82-bd57-be95514feb86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c100ecd14a4bc8987b945d773c0278', 'request_id': 'req-3af98983-303c-4a82-bd57-be95514feb86'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:05.333778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:05.338256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3af98983-303c-4a82-bd57-be95514feb86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c100ecd14a4bc8987b945d773c0278', 'request_id': 'req-3af98983-303c-4a82-bd57-be95514feb86'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:05.370033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3af98983-303c-4a82-bd57-be95514feb86 admin admin] The token cache is being invalidate because project 57c100ecd14a4bc8987b945d773c0278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:05.371493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3af98983-303c-4a82-bd57-be95514feb86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:05.372727 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3af98983-303c-4a82-bd57-be95514feb86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:05.379873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 930/1870] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:05 2022] DELETE /identity/v3/projects/57c100ecd14a4bc8987b945d773c0278 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:05.379873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af98983-303c-4a82-bd57-be95514feb86 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:05.383606 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3af98983-303c-4a82-bd57-be95514feb86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:05.444194 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31151f41-7714-4889-9b26-498442ef7775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:05.445080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31151f41-7714-4889-9b26-498442ef7775 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:05.445369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31151f41-7714-4889-9b26-498442ef7775 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:05.445652 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31151f41-7714-4889-9b26-498442ef7775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:05.447918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-31151f41-7714-4889-9b26-498442ef7775 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:05.463647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31151f41-7714-4889-9b26-498442ef7775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:05.465513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31151f41-7714-4889-9b26-498442ef7775 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:05.481736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 941/1871] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:05.490265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38284-7dec-4a78-93d2-ef92fcbfab3a None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:05.490802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38284-7dec-4a78-93d2-ef92fcbfab3a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:05.491258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38284-7dec-4a78-93d2-ef92fcbfab3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:05.517329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af98983-303c-4a82-bd57-be95514feb86 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:05.522725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5b303-e757-4e46-917a-31a01a1662fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:05.523518 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5b303-e757-4e46-917a-31a01a1662fe service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:05.523802 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5b303-e757-4e46-917a-31a01a1662fe service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:05.524075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5b303-e757-4e46-917a-31a01a1662fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:05.526658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4eb5b303-e757-4e46-917a-31a01a1662fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:05.541913 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-5cc38284-7dec-4a78-93d2-ef92fcbfab3a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:05.543503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5cc38284-7dec-4a78-93d2-ef92fcbfab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:05.571932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:05.683097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 942/1872] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:05.684713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38284-7dec-4a78-93d2-ef92fcbfab3a None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:05.687376 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5cc38284-7dec-4a78-93d2-ef92fcbfab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:05.707959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38284-7dec-4a78-93d2-ef92fcbfab3a None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:05.717743 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5b303-e757-4e46-917a-31a01a1662fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:05.720139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5b303-e757-4e46-917a-31a01a1662fe service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:05.737522 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60e013-e868-4dea-8f94-cd37916ef75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:05.738635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60e013-e868-4dea-8f94-cd37916ef75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:05.739003 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60e013-e868-4dea-8f94-cd37916ef75a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:05.743455 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60e013-e868-4dea-8f94-cd37916ef75a admin admin] PATH_INFO: `/v3/projects/c3e6fec42449479ba4d4e990bba3cf45` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:05.747858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60e013-e868-4dea-8f94-cd37916ef75a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e6fec42449479ba4d4e990bba3cf45)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:05.753130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60e013-e868-4dea-8f94-cd37916ef75a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:05.754211 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 931/1873] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:05.755311 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5b303-e757-4e46-917a-31a01a1662fe service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:05.760601 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4eb5b303-e757-4e46-917a-31a01a1662fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:05.838237 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5b303-e757-4e46-917a-31a01a1662fe service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:05.872532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5e60e013-e868-4dea-8f94-cd37916ef75a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e6fec42449479ba4d4e990bba3cf45', 'request_id': 'req-5e60e013-e868-4dea-8f94-cd37916ef75a'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:05.910474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5e60e013-e868-4dea-8f94-cd37916ef75a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e6fec42449479ba4d4e990bba3cf45', 'request_id': 'req-5e60e013-e868-4dea-8f94-cd37916ef75a'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:05.934302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5e60e013-e868-4dea-8f94-cd37916ef75a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e6fec42449479ba4d4e990bba3cf45', 'request_id': 'req-5e60e013-e868-4dea-8f94-cd37916ef75a'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:05.967175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a345b9a-fe6c-4534-a762-6a2571e51259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:05.969402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5e60e013-e868-4dea-8f94-cd37916ef75a admin admin] The token cache is being invalidate because project c3e6fec42449479ba4d4e990bba3cf45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:05.969402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5e60e013-e868-4dea-8f94-cd37916ef75a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:05.972193 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a345b9a-fe6c-4534-a762-6a2571e51259 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:05.973421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a345b9a-fe6c-4534-a762-6a2571e51259 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:05.973828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5e60e013-e868-4dea-8f94-cd37916ef75a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:05.976159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a345b9a-fe6c-4534-a762-6a2571e51259 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:05.978136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a345b9a-fe6c-4534-a762-6a2571e51259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:05.979129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 943/1874] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:05 2022] DELETE /identity/v3/projects/c3e6fec42449479ba4d4e990bba3cf45 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:05.982284 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41409e38-bc9c-47d9-be70-99fdcaf3d0a0 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:05.982616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41409e38-bc9c-47d9-be70-99fdcaf3d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:05.983133 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41409e38-bc9c-47d9-be70-99fdcaf3d0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:05.984707 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a345b9a-fe6c-4534-a762-6a2571e51259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:05.988205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a345b9a-fe6c-4534-a762-6a2571e51259 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:06.014808 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 932/1875] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:09:06.014808 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a345b9a-fe6c-4534-a762-6a2571e51259 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:06.017833 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0a345b9a-fe6c-4534-a762-6a2571e51259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:06.039130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-41409e38-bc9c-47d9-be70-99fdcaf3d0a0 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:06.040827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-41409e38-bc9c-47d9-be70-99fdcaf3d0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:06.051462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a345b9a-fe6c-4534-a762-6a2571e51259 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:06.060979 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37ee20-4e01-4f3d-b059-ab6a44f186cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:06.063118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37ee20-4e01-4f3d-b059-ab6a44f186cf admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:06.063613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37ee20-4e01-4f3d-b059-ab6a44f186cf admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:06.064141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37ee20-4e01-4f3d-b059-ab6a44f186cf admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:06.065480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37ee20-4e01-4f3d-b059-ab6a44f186cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:06.065986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37ee20-4e01-4f3d-b059-ab6a44f186cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:06.070416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37ee20-4e01-4f3d-b059-ab6a44f186cf admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:06.086952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 944/1876] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:06.087998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41409e38-bc9c-47d9-be70-99fdcaf3d0a0 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:06.093957 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-41409e38-bc9c-47d9-be70-99fdcaf3d0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:06.107629 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 933/1877] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:09:06.110999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37ee20-4e01-4f3d-b059-ab6a44f186cf admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:06.114210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7c37ee20-4e01-4f3d-b059-ab6a44f186cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:06.128650 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41409e38-bc9c-47d9-be70-99fdcaf3d0a0 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:06.147401 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a6b41-aad0-415d-a9d0-2c9225ce6e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:06.148336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a6b41-aad0-415d-a9d0-2c9225ce6e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:06.148678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a6b41-aad0-415d-a9d0-2c9225ce6e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:06.149048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a6b41-aad0-415d-a9d0-2c9225ce6e8f admin admin] PATH_INFO: `/v3/users/19e414bcb3974a7ba7c22c65647d6008` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:06.153587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a6b41-aad0-415d-a9d0-2c9225ce6e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e414bcb3974a7ba7c22c65647d6008)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:06.157391 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37ee20-4e01-4f3d-b059-ab6a44f186cf admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:06.161480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a6b41-aad0-415d-a9d0-2c9225ce6e8f admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:06.171631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676eb26a-9877-49a3-a4a0-4eff29191567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:06.172966 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eb26a-9877-49a3-a4a0-4eff29191567 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:06.176041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eb26a-9877-49a3-a4a0-4eff29191567 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:06.176675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eb26a-9877-49a3-a4a0-4eff29191567 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:06.178913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676eb26a-9877-49a3-a4a0-4eff29191567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:06.187086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676eb26a-9877-49a3-a4a0-4eff29191567 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:06.197184 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:06.287913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 934/1878] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:06 2022] POST /identity/v3/projects => generated 393 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:06.287913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbd914-df59-42d8-92c9-8b9c330e65d1 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:06.288306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbd914-df59-42d8-92c9-8b9c330e65d1 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:06.289017 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbd914-df59-42d8-92c9-8b9c330e65d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:06.299006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e28a6b41-aad0-415d-a9d0-2c9225ce6e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e414bcb3974a7ba7c22c65647d6008'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:06.302297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e28a6b41-aad0-415d-a9d0-2c9225ce6e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e414bcb3974a7ba7c22c65647d6008'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:06.328731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e28a6b41-aad0-415d-a9d0-2c9225ce6e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e414bcb3974a7ba7c22c65647d6008'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:06.337302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-f6fbd914-df59-42d8-92c9-8b9c330e65d1 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:06.338988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f6fbd914-df59-42d8-92c9-8b9c330e65d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:06.378733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e28a6b41-aad0-415d-a9d0-2c9225ce6e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e414bcb3974a7ba7c22c65647d6008'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:06.404457 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e28a6b41-aad0-415d-a9d0-2c9225ce6e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e414bcb3974a7ba7c22c65647d6008'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:06.425837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 945/1879] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:06 2022] DELETE /identity/v3/users/19e414bcb3974a7ba7c22c65647d6008 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:06.427883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a6b41-aad0-415d-a9d0-2c9225ce6e8f admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:06.432255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e28a6b41-aad0-415d-a9d0-2c9225ce6e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:06.573015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 935/1880] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:06.576509 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbd914-df59-42d8-92c9-8b9c330e65d1 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:06.578993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f6fbd914-df59-42d8-92c9-8b9c330e65d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:06.613489 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbd914-df59-42d8-92c9-8b9c330e65d1 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:06.695833 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a6b41-aad0-415d-a9d0-2c9225ce6e8f admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:06.708581 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:06.710248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9fc19-132f-4b17-80a4-2e26f7dc8fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:06.710911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9fc19-132f-4b17-80a4-2e26f7dc8fbe admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:06.712444 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9fc19-132f-4b17-80a4-2e26f7dc8fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:06.712959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9fc19-132f-4b17-80a4-2e26f7dc8fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:06.714657 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9fc19-132f-4b17-80a4-2e26f7dc8fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:06.720454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9fc19-132f-4b17-80a4-2e26f7dc8fbe admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:06.802694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 946/1881] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:06 2022] POST /identity/v3/projects => generated 369 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:06.804584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9fc19-132f-4b17-80a4-2e26f7dc8fbe admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:06.819528 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63181f7-33ce-4b72-b107-8741537288cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:06.820473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63181f7-33ce-4b72-b107-8741537288cf admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:06.820881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63181f7-33ce-4b72-b107-8741537288cf admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:06.821865 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63181f7-33ce-4b72-b107-8741537288cf admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:06.823796 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63181f7-33ce-4b72-b107-8741537288cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:06.828495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63181f7-33ce-4b72-b107-8741537288cf admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:06.894901 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 936/1882] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:06 2022] POST /identity/v3/users => generated 297 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:06.895818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63181f7-33ce-4b72-b107-8741537288cf admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:06.920191 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63181f7-33ce-4b72-b107-8741537288cf admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:07.013660 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9fc19-132f-4b17-80a4-2e26f7dc8fbe admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:07.020026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dc067-d8bd-4a2a-9587-5c605aa17b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:07.020809 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dc067-d8bd-4a2a-9587-5c605aa17b38 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:07.021213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dc067-d8bd-4a2a-9587-5c605aa17b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:07.021488 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dc067-d8bd-4a2a-9587-5c605aa17b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:07.022339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dc067-d8bd-4a2a-9587-5c605aa17b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:07.022648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dc067-d8bd-4a2a-9587-5c605aa17b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:07.024317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dc067-d8bd-4a2a-9587-5c605aa17b38 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:07.024978 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fbbd2-f0f2-485f-b737-f9e018335a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:07.026796 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fbbd2-f0f2-485f-b737-f9e018335a54 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:07.027099 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fbbd2-f0f2-485f-b737-f9e018335a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:07.027499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fbbd2-f0f2-485f-b737-f9e018335a54 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:07.028275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fbbd2-f0f2-485f-b737-f9e018335a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:07.030352 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fbbd2-f0f2-485f-b737-f9e018335a54 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:07.040493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 947/1883] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:09:07.041421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dc067-d8bd-4a2a-9587-5c605aa17b38 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:07.054081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dc067-d8bd-4a2a-9587-5c605aa17b38 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:07.059636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6c1dc-96ad-4fe6-8c43-78a5902ca39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:07.060117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6c1dc-96ad-4fe6-8c43-78a5902ca39c admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:07.060499 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6c1dc-96ad-4fe6-8c43-78a5902ca39c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:07.060778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6c1dc-96ad-4fe6-8c43-78a5902ca39c admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:07.061447 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6c1dc-96ad-4fe6-8c43-78a5902ca39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:07.063850 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6c1dc-96ad-4fe6-8c43-78a5902ca39c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:07.070259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 937/1884] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:06 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:07.071638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fbbd2-f0f2-485f-b737-f9e018335a54 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:07.076756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:07.078945 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 948/1885] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:07.080210 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6c1dc-96ad-4fe6-8c43-78a5902ca39c admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:07.086943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fbbd2-f0f2-485f-b737-f9e018335a54 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:07.093557 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67311c-cd63-426d-96f7-40cf5b050cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:07.094377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67311c-cd63-426d-96f7-40cf5b050cfe admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:07.094662 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67311c-cd63-426d-96f7-40cf5b050cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:07.094984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67311c-cd63-426d-96f7-40cf5b050cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:07.095646 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67311c-cd63-426d-96f7-40cf5b050cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:07.096194 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6c1dc-96ad-4fe6-8c43-78a5902ca39c admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:07.097741 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67311c-cd63-426d-96f7-40cf5b050cfe admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:07.106276 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234014a-179d-4d5f-b3e5-08d76b38f716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:07.107231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234014a-179d-4d5f-b3e5-08d76b38f716 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:07.107600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234014a-179d-4d5f-b3e5-08d76b38f716 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:07.108006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234014a-179d-4d5f-b3e5-08d76b38f716 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:07.108933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234014a-179d-4d5f-b3e5-08d76b38f716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:07.111413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234014a-179d-4d5f-b3e5-08d76b38f716 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:07.128546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 949/1886] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:07.130370 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234014a-179d-4d5f-b3e5-08d76b38f716 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:07.148878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 938/1887] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:07 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:07.150903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234014a-179d-4d5f-b3e5-08d76b38f716 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:07.151505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67311c-cd63-426d-96f7-40cf5b050cfe admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:07.306517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a674ef-bdac-4f59-8c2a-465d24511d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:07.307852 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a674ef-bdac-4f59-8c2a-465d24511d88 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:07.308308 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a674ef-bdac-4f59-8c2a-465d24511d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:07.309881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a674ef-bdac-4f59-8c2a-465d24511d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:07.311100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a674ef-bdac-4f59-8c2a-465d24511d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:07.315156 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a674ef-bdac-4f59-8c2a-465d24511d88 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:07.335395 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67311c-cd63-426d-96f7-40cf5b050cfe admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:07.340452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 950/1888] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:07.340452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a674ef-bdac-4f59-8c2a-465d24511d88 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:07.357620 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baf628-eefa-4dff-932b-a1c8486fd692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:07.359964 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baf628-eefa-4dff-932b-a1c8486fd692 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:07.360139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baf628-eefa-4dff-932b-a1c8486fd692 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:07.360516 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baf628-eefa-4dff-932b-a1c8486fd692 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:07.361819 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5baf628-eefa-4dff-932b-a1c8486fd692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:07.365230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5baf628-eefa-4dff-932b-a1c8486fd692 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:07.370466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a674ef-bdac-4f59-8c2a-465d24511d88 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:07.377377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa4f32-216d-4ed6-bcea-219557bce228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:07.392088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa4f32-216d-4ed6-bcea-219557bce228 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:07.392778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa4f32-216d-4ed6-bcea-219557bce228 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:07.393973 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa4f32-216d-4ed6-bcea-219557bce228 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:07.395886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa4f32-216d-4ed6-bcea-219557bce228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:07.399252 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa4f32-216d-4ed6-bcea-219557bce228 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:07.400653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 939/1889] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:07.406328 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baf628-eefa-4dff-932b-a1c8486fd692 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:07.452857 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 951/1890] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:07 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:07.456680 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa4f32-216d-4ed6-bcea-219557bce228 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:07.466494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baf628-eefa-4dff-932b-a1c8486fd692 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:07.497750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2b6ab-aa0b-4911-835e-c96df09d420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:07.498450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2b6ab-aa0b-4911-835e-c96df09d420c admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:07.498716 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2b6ab-aa0b-4911-835e-c96df09d420c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:07.498988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2b6ab-aa0b-4911-835e-c96df09d420c admin admin] PATH_INFO: `/v3/projects/c5fae47d3abb4797b42b77d2dcb0b3ec/users/71d1f8e260644076b976122c0c6e4e06/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:07.505510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa4f32-216d-4ed6-bcea-219557bce228 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:07.522614 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7867f2-3be0-4ae8-9612-507570808752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:07.523309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7867f2-3be0-4ae8-9612-507570808752 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:07.523925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7867f2-3be0-4ae8-9612-507570808752 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:07.524408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7867f2-3be0-4ae8-9612-507570808752 admin admin] PATH_INFO: `/v3/projects/c5d9324f418e43b6b3a86bb1c6fd3620/users/dda2f7e9560341da89340ea9811d2341/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:07.538932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:07.549679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2b6ab-aa0b-4911-835e-c96df09d420c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5fae47d3abb4797b42b77d2dcb0b3ec, user_id=71d1f8e260644076b976122c0c6e4e06, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:07.557719 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2b6ab-aa0b-4911-835e-c96df09d420c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:07.583853 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7867f2-3be0-4ae8-9612-507570808752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d9324f418e43b6b3a86bb1c6fd3620, user_id=dda2f7e9560341da89340ea9811d2341, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:07.590515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7867f2-3be0-4ae8-9612-507570808752 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:07.601014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 940/1891] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:07 2022] PUT /identity/v3/projects/c5fae47d3abb4797b42b77d2dcb0b3ec/users/71d1f8e260644076b976122c0c6e4e06/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:07.605202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2b6ab-aa0b-4911-835e-c96df09d420c admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:07.630013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 952/1892] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:07 2022] PUT /identity/v3/projects/c5d9324f418e43b6b3a86bb1c6fd3620/users/dda2f7e9560341da89340ea9811d2341/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:07.631373 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7867f2-3be0-4ae8-9612-507570808752 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:07.651416 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8a7867f2-3be0-4ae8-9612-507570808752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:07.742849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2b6ab-aa0b-4911-835e-c96df09d420c admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:07.849145 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf620df-ebcf-48cf-a2e8-88866af35f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:07.850058 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf620df-ebcf-48cf-a2e8-88866af35f2c admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:07.850396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf620df-ebcf-48cf-a2e8-88866af35f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:07.850781 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf620df-ebcf-48cf-a2e8-88866af35f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:07.852726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf620df-ebcf-48cf-a2e8-88866af35f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:07.854546 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf620df-ebcf-48cf-a2e8-88866af35f2c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:07.869283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 941/1893] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:07.871621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb775bd-30ce-43ff-9fad-3e6c2bedf134 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:07.872020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb775bd-30ce-43ff-9fad-3e6c2bedf134 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:07.872699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb775bd-30ce-43ff-9fad-3e6c2bedf134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:07.876742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7867f2-3be0-4ae8-9612-507570808752 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:07.882752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b01b5-c163-44fb-9116-f41095f8e030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:07.883770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b01b5-c163-44fb-9116-f41095f8e030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:07.884192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b01b5-c163-44fb-9116-f41095f8e030 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:07.884693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b01b5-c163-44fb-9116-f41095f8e030 admin admin] PATH_INFO: `/v3/projects/fcc5d28ee6c64183a78a27b83bc32d57` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:07.886096 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b01b5-c163-44fb-9116-f41095f8e030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc5d28ee6c64183a78a27b83bc32d57)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:07.890534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b01b5-c163-44fb-9116-f41095f8e030 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:07.910222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-5fb775bd-30ce-43ff-9fad-3e6c2bedf134 None None] MFA Rules not processed for user `71d1f8e260644076b976122c0c6e4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:07.911490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5fb775bd-30ce-43ff-9fad-3e6c2bedf134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:07.958810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:07.960614 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5e3b01b5-c163-44fb-9116-f41095f8e030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc5d28ee6c64183a78a27b83bc32d57', 'request_id': 'req-5e3b01b5-c163-44fb-9116-f41095f8e030'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:07.972647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5e3b01b5-c163-44fb-9116-f41095f8e030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc5d28ee6c64183a78a27b83bc32d57', 'request_id': 'req-5e3b01b5-c163-44fb-9116-f41095f8e030'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:07.982414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5e3b01b5-c163-44fb-9116-f41095f8e030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc5d28ee6c64183a78a27b83bc32d57', 'request_id': 'req-5e3b01b5-c163-44fb-9116-f41095f8e030'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:08.003476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5e3b01b5-c163-44fb-9116-f41095f8e030 admin admin] The token cache is being invalidate because project fcc5d28ee6c64183a78a27b83bc32d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:08.003775 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5e3b01b5-c163-44fb-9116-f41095f8e030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:08.004904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5e3b01b5-c163-44fb-9116-f41095f8e030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:08.007187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 953/1894] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:07 2022] DELETE /identity/v3/projects/fcc5d28ee6c64183a78a27b83bc32d57 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:08.008081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b6bf6-89da-40b3-88bc-b997ba467891 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:08.008366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b6bf6-89da-40b3-88bc-b997ba467891 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:08.008700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b6bf6-89da-40b3-88bc-b997ba467891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:08.015610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 942/1895] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:08.015610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb775bd-30ce-43ff-9fad-3e6c2bedf134 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:08.025101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5fb775bd-30ce-43ff-9fad-3e6c2bedf134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:08.069465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-c35b6bf6-89da-40b3-88bc-b997ba467891 None None] MFA Rules not processed for user `dda2f7e9560341da89340ea9811d2341`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:08.070763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c35b6bf6-89da-40b3-88bc-b997ba467891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:08.092072 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:08.151433 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb775bd-30ce-43ff-9fad-3e6c2bedf134 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:08.211620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 954/1896] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:08.212646 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b6bf6-89da-40b3-88bc-b997ba467891 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:08.214807 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c35b6bf6-89da-40b3-88bc-b997ba467891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:08.242215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229e782-a5e0-4170-b150-51e8a85740fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:08.243722 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229e782-a5e0-4170-b150-51e8a85740fa service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:08.244884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229e782-a5e0-4170-b150-51e8a85740fa service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:08.246035 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229e782-a5e0-4170-b150-51e8a85740fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:08.248913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4229e782-a5e0-4170-b150-51e8a85740fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:08.314096 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b6bf6-89da-40b3-88bc-b997ba467891 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:08.320834 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b81b9-b32c-4d6c-88c4-3a4402a84d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:08.321471 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b81b9-b32c-4d6c-88c4-3a4402a84d83 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:08.321853 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b81b9-b32c-4d6c-88c4-3a4402a84d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:08.322013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b81b9-b32c-4d6c-88c4-3a4402a84d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:08.322692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b81b9-b32c-4d6c-88c4-3a4402a84d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:08.324863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b81b9-b32c-4d6c-88c4-3a4402a84d83 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:08.341278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 955/1897] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:08.342650 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352dc0-35fc-4b5f-ad6f-da445484ea1c None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:08.342940 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352dc0-35fc-4b5f-ad6f-da445484ea1c None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:08.343216 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352dc0-35fc-4b5f-ad6f-da445484ea1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:08.351832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229e782-a5e0-4170-b150-51e8a85740fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:08.354305 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229e782-a5e0-4170-b150-51e8a85740fa service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:08.366998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 943/1898] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:08.367797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229e782-a5e0-4170-b150-51e8a85740fa service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:08.369737 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4229e782-a5e0-4170-b150-51e8a85740fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:08.378455 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-d0352dc0-35fc-4b5f-ad6f-da445484ea1c None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:08.386301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d0352dc0-35fc-4b5f-ad6f-da445484ea1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:08.398545 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229e782-a5e0-4170-b150-51e8a85740fa service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:08.409442 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13686090-cdbc-4221-971f-ae96be8ee785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:08.410087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13686090-cdbc-4221-971f-ae96be8ee785 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:08.410641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13686090-cdbc-4221-971f-ae96be8ee785 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:08.410982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13686090-cdbc-4221-971f-ae96be8ee785 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:08.411591 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13686090-cdbc-4221-971f-ae96be8ee785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:08.413686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13686090-cdbc-4221-971f-ae96be8ee785 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:08.431578 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 956/1899] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:08.433970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352dc0-35fc-4b5f-ad6f-da445484ea1c None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:08.442214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d0352dc0-35fc-4b5f-ad6f-da445484ea1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:08.452350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 944/1900] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:08 2022] POST /identity/v3/projects => generated 391 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:08.453465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13686090-cdbc-4221-971f-ae96be8ee785 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:08.476760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352dc0-35fc-4b5f-ad6f-da445484ea1c None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:08.598404 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13686090-cdbc-4221-971f-ae96be8ee785 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:08.612708 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6133c-79dc-4390-8496-40562c67ba50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:08.614475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6133c-79dc-4390-8496-40562c67ba50 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:08.623358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6133c-79dc-4390-8496-40562c67ba50 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:08.624076 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6133c-79dc-4390-8496-40562c67ba50 admin admin] PATH_INFO: `/v3/projects/63f49ef585b848209e5731187c55882a/users/7d1d9878a2f3454a93263196b21d5f69/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:08.654725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:08.662138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6133c-79dc-4390-8496-40562c67ba50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f49ef585b848209e5731187c55882a, user_id=7d1d9878a2f3454a93263196b21d5f69, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:08.670459 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6133c-79dc-4390-8496-40562c67ba50 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:08.720151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 945/1901] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:08 2022] PUT /identity/v3/projects/63f49ef585b848209e5731187c55882a/users/7d1d9878a2f3454a93263196b21d5f69/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:08.720151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08e130-5358-4c4a-8eb4-18a4bed72ae3 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:08.720151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08e130-5358-4c4a-8eb4-18a4bed72ae3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:08.720151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08e130-5358-4c4a-8eb4-18a4bed72ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:08.720627 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:08.766823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bde72-f691-4554-9fb7-0dc64e6e09ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:08.767895 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bde72-f691-4554-9fb7-0dc64e6e09ec admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:08.768266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-4b08e130-5358-4c4a-8eb4-18a4bed72ae3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:08.773591 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4b08e130-5358-4c4a-8eb4-18a4bed72ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:08.773686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bde72-f691-4554-9fb7-0dc64e6e09ec admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:08.773854 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bde72-f691-4554-9fb7-0dc64e6e09ec admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:08.777146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bde72-f691-4554-9fb7-0dc64e6e09ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:08.780627 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bde72-f691-4554-9fb7-0dc64e6e09ec admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:08.918563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 957/1902] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:08 2022] POST /identity/v3/projects => generated 367 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:08.928862 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bde72-f691-4554-9fb7-0dc64e6e09ec admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:08.954048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 946/1903] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:08.955390 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1f677-0b49-455c-a13e-6dbf95df0b64 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:08.958270 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1f677-0b49-455c-a13e-6dbf95df0b64 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:08.958712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1f677-0b49-455c-a13e-6dbf95df0b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:09.006091 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-2cf1f677-0b49-455c-a13e-6dbf95df0b64 None None] MFA Rules not processed for user `7d1d9878a2f3454a93263196b21d5f69`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:09.008217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2cf1f677-0b49-455c-a13e-6dbf95df0b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:09.072339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bde72-f691-4554-9fb7-0dc64e6e09ec admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:09.079419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07075974-61a8-4a99-bba0-af244e13f7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:09.080341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075974-61a8-4a99-bba0-af244e13f7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:09.080715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075974-61a8-4a99-bba0-af244e13f7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:09.081051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075974-61a8-4a99-bba0-af244e13f7e5 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:09.082302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07075974-61a8-4a99-bba0-af244e13f7e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:09.085902 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07075974-61a8-4a99-bba0-af244e13f7e5 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:09.137248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 958/1904] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:08 2022] POST /identity/v3/users => generated 302 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:09.137248 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07075974-61a8-4a99-bba0-af244e13f7e5 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:09.148877 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 947/1905] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:09.148877 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1f677-0b49-455c-a13e-6dbf95df0b64 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:09.152668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07075974-61a8-4a99-bba0-af244e13f7e5 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:09.163013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306e32b-2768-4349-b238-8fb4d88c69f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:09.164181 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306e32b-2768-4349-b238-8fb4d88c69f4 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:09.164677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306e32b-2768-4349-b238-8fb4d88c69f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:09.166143 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306e32b-2768-4349-b238-8fb4d88c69f4 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:09.167843 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306e32b-2768-4349-b238-8fb4d88c69f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:09.171158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306e32b-2768-4349-b238-8fb4d88c69f4 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:09.184811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1f677-0b49-455c-a13e-6dbf95df0b64 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:09.212469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c461c-797f-4241-a877-45c9a259717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:09.212469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c461c-797f-4241-a877-45c9a259717d admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:09.212469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c461c-797f-4241-a877-45c9a259717d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:09.212469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c461c-797f-4241-a877-45c9a259717d admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:09.213431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c461c-797f-4241-a877-45c9a259717d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:09.213741 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c461c-797f-4241-a877-45c9a259717d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:09.217793 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c461c-797f-4241-a877-45c9a259717d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:09.245573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 959/1906] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:09 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:09.247689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 948/1907] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:09:09.249185 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306e32b-2768-4349-b238-8fb4d88c69f4 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:09.249435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c461c-797f-4241-a877-45c9a259717d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:09.252403 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b74c461c-797f-4241-a877-45c9a259717d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:09.296144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306e32b-2768-4349-b238-8fb4d88c69f4 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:09.316500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e52d03-34fc-4fca-a630-2735f5dbc7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:09.317605 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e52d03-34fc-4fca-a630-2735f5dbc7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:09.318117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e52d03-34fc-4fca-a630-2735f5dbc7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:09.318570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e52d03-34fc-4fca-a630-2735f5dbc7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:09.319969 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e52d03-34fc-4fca-a630-2735f5dbc7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:09.324033 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e52d03-34fc-4fca-a630-2735f5dbc7d2 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:09.355213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 960/1908] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:09.357770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e52d03-34fc-4fca-a630-2735f5dbc7d2 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:09.391656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e52d03-34fc-4fca-a630-2735f5dbc7d2 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:09.400671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745abdc-1b0d-487c-bc0c-a79af308a661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:09.401682 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745abdc-1b0d-487c-bc0c-a79af308a661 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:09.402657 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745abdc-1b0d-487c-bc0c-a79af308a661 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:09.403511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745abdc-1b0d-487c-bc0c-a79af308a661 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:09.404787 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745abdc-1b0d-487c-bc0c-a79af308a661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:09.408550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745abdc-1b0d-487c-bc0c-a79af308a661 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:09.440335 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 961/1909] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:09.440335 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745abdc-1b0d-487c-bc0c-a79af308a661 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:09.459581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745abdc-1b0d-487c-bc0c-a79af308a661 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:09.472234 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2913e-cb5d-433e-b2c1-35f1d78fd4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:09.473637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2913e-cb5d-433e-b2c1-35f1d78fd4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:09.474067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2913e-cb5d-433e-b2c1-35f1d78fd4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:09.474612 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2913e-cb5d-433e-b2c1-35f1d78fd4f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:09.475936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2913e-cb5d-433e-b2c1-35f1d78fd4f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:09.480492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2913e-cb5d-433e-b2c1-35f1d78fd4f2 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:09.541178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c461c-797f-4241-a877-45c9a259717d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:09.550446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cfda0-3f06-4cdd-a996-b00df0ab2684 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:09.551533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cfda0-3f06-4cdd-a996-b00df0ab2684 service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:09.552154 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cfda0-3f06-4cdd-a996-b00df0ab2684 service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:09.552792 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cfda0-3f06-4cdd-a996-b00df0ab2684 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:09.572417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cfda0-3f06-4cdd-a996-b00df0ab2684 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:09.575185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cfda0-3f06-4cdd-a996-b00df0ab2684 service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:09.588217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 962/1910] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:09 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:09.588217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2913e-cb5d-433e-b2c1-35f1d78fd4f2 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:09.615179 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 949/1911] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:09.616990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cfda0-3f06-4cdd-a996-b00df0ab2684 service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:09.642672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cfda0-3f06-4cdd-a996-b00df0ab2684 service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:09.667232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:09.753387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2913e-cb5d-433e-b2c1-35f1d78fd4f2 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:09.772467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8798e-a475-4c4c-a785-56232214b905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:09.773580 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8798e-a475-4c4c-a785-56232214b905 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:09.774092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8798e-a475-4c4c-a785-56232214b905 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:09.775100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8798e-a475-4c4c-a785-56232214b905 admin admin] PATH_INFO: `/v3/projects/e6a51794bef94817b12c0af278f6078b/users/4981a3bb5076424da93e43dce7f83f87/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:09.796840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd881216-564e-4045-903d-a4ddb6941c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:09.797701 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd881216-564e-4045-903d-a4ddb6941c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:09.798079 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd881216-564e-4045-903d-a4ddb6941c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:09.798516 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd881216-564e-4045-903d-a4ddb6941c23 admin admin] PATH_INFO: `/v3/projects/03ebd6dab7e3419a8a82df7b4fd975ab/users/8999ed85d2be420c970cdd4d1d98a9a1/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:09.801841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:09.810887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8798e-a475-4c4c-a785-56232214b905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a51794bef94817b12c0af278f6078b, user_id=4981a3bb5076424da93e43dce7f83f87, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:09.817603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8798e-a475-4c4c-a785-56232214b905 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:09.833832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd881216-564e-4045-903d-a4ddb6941c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ebd6dab7e3419a8a82df7b4fd975ab, user_id=8999ed85d2be420c970cdd4d1d98a9a1, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:09.839946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd881216-564e-4045-903d-a4ddb6941c23 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:09.841944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 963/1912] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:09 2022] PUT /identity/v3/projects/e6a51794bef94817b12c0af278f6078b/users/4981a3bb5076424da93e43dce7f83f87/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:09.842645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8798e-a475-4c4c-a785-56232214b905 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:09.887858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 950/1913] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:09 2022] PUT /identity/v3/projects/03ebd6dab7e3419a8a82df7b4fd975ab/users/8999ed85d2be420c970cdd4d1d98a9a1/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:09.887858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd881216-564e-4045-903d-a4ddb6941c23 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:10.069738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8798e-a475-4c4c-a785-56232214b905 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:10.070658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd881216-564e-4045-903d-a4ddb6941c23 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:10.084165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0071c-e507-44e8-a4a5-fa16d3011200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:10.085562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0071c-e507-44e8-a4a5-fa16d3011200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:10.086842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0071c-e507-44e8-a4a5-fa16d3011200 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:10.090532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0071c-e507-44e8-a4a5-fa16d3011200 admin admin] PATH_INFO: `/v3/users/7d1d9878a2f3454a93263196b21d5f69` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:10.090821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0071c-e507-44e8-a4a5-fa16d3011200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d1d9878a2f3454a93263196b21d5f69)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:10.095680 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0071c-e507-44e8-a4a5-fa16d3011200 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:10.096452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21972a-c29a-4d66-8e96-67ae2acdb09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:10.097623 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21972a-c29a-4d66-8e96-67ae2acdb09c admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:10.098169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21972a-c29a-4d66-8e96-67ae2acdb09c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:10.098702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21972a-c29a-4d66-8e96-67ae2acdb09c admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:10.104824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21972a-c29a-4d66-8e96-67ae2acdb09c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:10.110000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21972a-c29a-4d66-8e96-67ae2acdb09c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:10.205195 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 964/1914] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:09 2022] POST /identity/v3/users => generated 290 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:10.206871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21972a-c29a-4d66-8e96-67ae2acdb09c admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:10.257565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21972a-c29a-4d66-8e96-67ae2acdb09c admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:10.264820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa68c13-c4a5-4467-8a40-bc096947f08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:10.265717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa68c13-c4a5-4467-8a40-bc096947f08b admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:10.266095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa68c13-c4a5-4467-8a40-bc096947f08b admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:10.266679 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa68c13-c4a5-4467-8a40-bc096947f08b admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:10.268483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa68c13-c4a5-4467-8a40-bc096947f08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:10.273735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa68c13-c4a5-4467-8a40-bc096947f08b admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:10.298514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 965/1915] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:10.300020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa68c13-c4a5-4467-8a40-bc096947f08b admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:10.300610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-86f0071c-e507-44e8-a4a5-fa16d3011200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d1d9878a2f3454a93263196b21d5f69'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:10.302289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-86f0071c-e507-44e8-a4a5-fa16d3011200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d1d9878a2f3454a93263196b21d5f69'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:10.318456 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa68c13-c4a5-4467-8a40-bc096947f08b admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:10.322047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-86f0071c-e507-44e8-a4a5-fa16d3011200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d1d9878a2f3454a93263196b21d5f69'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:10.323979 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-86f0071c-e507-44e8-a4a5-fa16d3011200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d1d9878a2f3454a93263196b21d5f69'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:10.338271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197815cc-b89a-49de-a1db-f27a9c885bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:10.339504 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197815cc-b89a-49de-a1db-f27a9c885bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:10.340198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197815cc-b89a-49de-a1db-f27a9c885bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:10.340844 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197815cc-b89a-49de-a1db-f27a9c885bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:10.347593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197815cc-b89a-49de-a1db-f27a9c885bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:10.347593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197815cc-b89a-49de-a1db-f27a9c885bf1 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:10.373291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-86f0071c-e507-44e8-a4a5-fa16d3011200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d1d9878a2f3454a93263196b21d5f69'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:10.379342 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 966/1916] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:10.381649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197815cc-b89a-49de-a1db-f27a9c885bf1 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:10.387781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-197815cc-b89a-49de-a1db-f27a9c885bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:10.414707 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197815cc-b89a-49de-a1db-f27a9c885bf1 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:10.426929 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b658f1c-b88c-4a59-be4f-b49805307f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:10.427885 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b658f1c-b88c-4a59-be4f-b49805307f17 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:10.428556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b658f1c-b88c-4a59-be4f-b49805307f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:10.429163 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b658f1c-b88c-4a59-be4f-b49805307f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:10.431362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b658f1c-b88c-4a59-be4f-b49805307f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:10.442200 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 951/1917] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:09 2022] DELETE /identity/v3/users/7d1d9878a2f3454a93263196b21d5f69 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:10.444488 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0071c-e507-44e8-a4a5-fa16d3011200 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:10.447215 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b658f1c-b88c-4a59-be4f-b49805307f17 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:10.450625 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-86f0071c-e507-44e8-a4a5-fa16d3011200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:10.515223 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 967/1918] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:10.515223 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b658f1c-b88c-4a59-be4f-b49805307f17 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:10.533048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6b658f1c-b88c-4a59-be4f-b49805307f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:10.590315 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b658f1c-b88c-4a59-be4f-b49805307f17 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:10.594505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:10.785268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0071c-e507-44e8-a4a5-fa16d3011200 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:10.793161 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac5755-a580-4a96-b1ba-3b4f8bc5a08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:10.794973 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac5755-a580-4a96-b1ba-3b4f8bc5a08d admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:10.795761 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac5755-a580-4a96-b1ba-3b4f8bc5a08d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:10.796426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac5755-a580-4a96-b1ba-3b4f8bc5a08d admin admin] PATH_INFO: `/v3/projects/03ebd6dab7e3419a8a82df7b4fd975ab/users/8999ed85d2be420c970cdd4d1d98a9a1/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:10.799758 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac5755-a580-4a96-b1ba-3b4f8bc5a08d admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ebd6dab7e3419a8a82df7b4fd975ab, user_id=8999ed85d2be420c970cdd4d1d98a9a1, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:10.800949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84279ae-71af-43a5-a5c0-dd7f7a688cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:10.801662 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84279ae-71af-43a5-a5c0-dd7f7a688cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:10.801943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84279ae-71af-43a5-a5c0-dd7f7a688cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:10.802241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84279ae-71af-43a5-a5c0-dd7f7a688cb1 admin admin] PATH_INFO: `/v3/projects/e6a51794bef94817b12c0af278f6078b/users/4981a3bb5076424da93e43dce7f83f87/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:10.804665 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84279ae-71af-43a5-a5c0-dd7f7a688cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a51794bef94817b12c0af278f6078b, user_id=4981a3bb5076424da93e43dce7f83f87, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:10.804985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac5755-a580-4a96-b1ba-3b4f8bc5a08d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:10.807589 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84279ae-71af-43a5-a5c0-dd7f7a688cb1 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:10.843579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 952/1919] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:10 2022] PUT /identity/v3/projects/e6a51794bef94817b12c0af278f6078b/users/4981a3bb5076424da93e43dce7f83f87/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:10.845385 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33b1d7-17d6-43a4-b5ae-187358f4946d None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:10.845767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33b1d7-17d6-43a4-b5ae-187358f4946d None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:10.846044 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33b1d7-17d6-43a4-b5ae-187358f4946d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:10.876461 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 968/1920] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:10 2022] PUT /identity/v3/projects/03ebd6dab7e3419a8a82df7b4fd975ab/users/8999ed85d2be420c970cdd4d1d98a9a1/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:10.879168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac5755-a580-4a96-b1ba-3b4f8bc5a08d admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:10.901633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ba33b1d7-17d6-43a4-b5ae-187358f4946d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:10.904289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ba33b1d7-17d6-43a4-b5ae-187358f4946d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:11.056014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:11.096036 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 953/1921] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:11.098429 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413020eb-9a9a-43c7-829d-00ed0bf069e8 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:11.099050 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413020eb-9a9a-43c7-829d-00ed0bf069e8 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:11.099634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413020eb-9a9a-43c7-829d-00ed0bf069e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:11.110229 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac5755-a580-4a96-b1ba-3b4f8bc5a08d admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:11.122287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f205c9-6a1e-415f-973a-033f4d2bd7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:11.123689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f205c9-6a1e-415f-973a-033f4d2bd7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:11.123689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f205c9-6a1e-415f-973a-033f4d2bd7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:11.124286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f205c9-6a1e-415f-973a-033f4d2bd7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:11.126017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f205c9-6a1e-415f-973a-033f4d2bd7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:11.129663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f205c9-6a1e-415f-973a-033f4d2bd7c2 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:11.172842 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 969/1922] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:11.172842 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6df1c-4104-4d75-a0fc-ce7e833215ef None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:11.172842 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6df1c-4104-4d75-a0fc-ce7e833215ef None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:11.186581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6df1c-4104-4d75-a0fc-ce7e833215ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:11.186905 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-413020eb-9a9a-43c7-829d-00ed0bf069e8 None None] MFA Rules not processed for user `4981a3bb5076424da93e43dce7f83f87`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:11.189508 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-413020eb-9a9a-43c7-829d-00ed0bf069e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:11.282086 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-13d6df1c-4104-4d75-a0fc-ce7e833215ef None None] MFA Rules not processed for user `8999ed85d2be420c970cdd4d1d98a9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:11.288467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-13d6df1c-4104-4d75-a0fc-ce7e833215ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:11.457194 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 954/1923] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:11 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:11.457194 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413020eb-9a9a-43c7-829d-00ed0bf069e8 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:11.465284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-413020eb-9a9a-43c7-829d-00ed0bf069e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:11.554954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:11.580300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 970/1924] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:11.581765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6df1c-4104-4d75-a0fc-ce7e833215ef None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:11.615709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6df1c-4104-4d75-a0fc-ce7e833215ef None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:11.627668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413020eb-9a9a-43c7-829d-00ed0bf069e8 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:11.636058 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663b9f0-f769-4809-a14a-87e8981baab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:11.636428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663b9f0-f769-4809-a14a-87e8981baab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:11.636428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663b9f0-f769-4809-a14a-87e8981baab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:11.636859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663b9f0-f769-4809-a14a-87e8981baab3 admin admin] PATH_INFO: `/v3/projects/5b50a13c3ff84e169c64317efcb45b11/users/ae6796e3c6504180a7f6609c3c444ad3/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:11.637365 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101b902-23d6-4af5-8d93-c2ac471dadbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:11.638754 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101b902-23d6-4af5-8d93-c2ac471dadbc service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:11.639190 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101b902-23d6-4af5-8d93-c2ac471dadbc service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:11.639625 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101b902-23d6-4af5-8d93-c2ac471dadbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:11.685746 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663b9f0-f769-4809-a14a-87e8981baab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b50a13c3ff84e169c64317efcb45b11, user_id=ae6796e3c6504180a7f6609c3c444ad3, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:11.687222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101b902-23d6-4af5-8d93-c2ac471dadbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:11.689608 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663b9f0-f769-4809-a14a-87e8981baab3 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:11.692095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101b902-23d6-4af5-8d93-c2ac471dadbc service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:11.745030 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 955/1925] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:11.745581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 971/1926] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:11 2022] PUT /identity/v3/projects/5b50a13c3ff84e169c64317efcb45b11/users/ae6796e3c6504180a7f6609c3c444ad3/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:11.750831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663b9f0-f769-4809-a14a-87e8981baab3 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:11.759707 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-2663b9f0-f769-4809-a14a-87e8981baab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:11.761614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094e5c3-ec57-4d92-8f32-439152b1c8cb None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:11.762501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094e5c3-ec57-4d92-8f32-439152b1c8cb None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:11.763592 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094e5c3-ec57-4d92-8f32-439152b1c8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:11.888165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-e094e5c3-ec57-4d92-8f32-439152b1c8cb None None] MFA Rules not processed for user `ae6796e3c6504180a7f6609c3c444ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:11.895016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-e094e5c3-ec57-4d92-8f32-439152b1c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:12.003874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663b9f0-f769-4809-a14a-87e8981baab3 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:12.019208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1575cf-c17a-4475-9ecf-f7a952274c0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:12.020317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1575cf-c17a-4475-9ecf-f7a952274c0b service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:12.020762 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1575cf-c17a-4475-9ecf-f7a952274c0b service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:12.024724 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1575cf-c17a-4475-9ecf-f7a952274c0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:12.091204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 956/1927] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:12.093569 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094e5c3-ec57-4d92-8f32-439152b1c8cb None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:12.193716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:12.263112 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1575cf-c17a-4475-9ecf-f7a952274c0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:12.270303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1575cf-c17a-4475-9ecf-f7a952274c0b service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:12.273475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094e5c3-ec57-4d92-8f32-439152b1c8cb None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:12.299818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39517978-1155-4ebf-b9e2-006a5acaf4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:12.301375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39517978-1155-4ebf-b9e2-006a5acaf4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:12.302080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39517978-1155-4ebf-b9e2-006a5acaf4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:12.302838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39517978-1155-4ebf-b9e2-006a5acaf4d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:12.304112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39517978-1155-4ebf-b9e2-006a5acaf4d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:12.306739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 972/1928] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:11 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:12.307473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39517978-1155-4ebf-b9e2-006a5acaf4d5 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:12.312492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1575cf-c17a-4475-9ecf-f7a952274c0b service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:12.315998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-4d1575cf-c17a-4475-9ecf-f7a952274c0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:12.334684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1575cf-c17a-4475-9ecf-f7a952274c0b service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:12.339392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2027a-6cd3-40e5-939a-31833fef4fb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:12.341154 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2027a-6cd3-40e5-939a-31833fef4fb5 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:12.341764 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2027a-6cd3-40e5-939a-31833fef4fb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:12.342239 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2027a-6cd3-40e5-939a-31833fef4fb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:12.399928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 957/1929] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:12 2022] POST /identity/v3/projects => generated 381 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:09:12.407140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39517978-1155-4ebf-b9e2-006a5acaf4d5 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:12.556927 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2027a-6cd3-40e5-939a-31833fef4fb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:12.559572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2027a-6cd3-40e5-939a-31833fef4fb5 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:12.572071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:12.594939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 973/1930] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:12.641806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39517978-1155-4ebf-b9e2-006a5acaf4d5 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:12.657778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80450433-1078-4896-aafb-3a601cd55045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:12.658434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80450433-1078-4896-aafb-3a601cd55045 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:12.658715 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80450433-1078-4896-aafb-3a601cd55045 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:12.658995 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80450433-1078-4896-aafb-3a601cd55045 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:12.660540 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80450433-1078-4896-aafb-3a601cd55045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:12.665810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80450433-1078-4896-aafb-3a601cd55045 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:12.710636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2027a-6cd3-40e5-939a-31833fef4fb5 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:12.733311 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 958/1931] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:12 2022] POST /identity/v3/users => generated 297 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:09:12.750955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2027a-6cd3-40e5-939a-31833fef4fb5 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:12.751141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80450433-1078-4896-aafb-3a601cd55045 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:12.788436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80450433-1078-4896-aafb-3a601cd55045 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:12.811897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce40ada-0560-48e5-9772-ebc64e68c063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:12.820115 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce40ada-0560-48e5-9772-ebc64e68c063 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:12.820721 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce40ada-0560-48e5-9772-ebc64e68c063 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:12.825601 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce40ada-0560-48e5-9772-ebc64e68c063 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:12.826987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce40ada-0560-48e5-9772-ebc64e68c063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:12.840623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce40ada-0560-48e5-9772-ebc64e68c063 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:12.922548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 959/1932] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:12.922548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce40ada-0560-48e5-9772-ebc64e68c063 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:12.929804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2ce40ada-0560-48e5-9772-ebc64e68c063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:12.952541 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46e43f-08bd-44b3-8efd-e1b0fff1cf51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:12.953468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46e43f-08bd-44b3-8efd-e1b0fff1cf51 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:12.954256 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46e43f-08bd-44b3-8efd-e1b0fff1cf51 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:12.954737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46e43f-08bd-44b3-8efd-e1b0fff1cf51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:12.957776 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-3c46e43f-08bd-44b3-8efd-e1b0fff1cf51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:12.990040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce40ada-0560-48e5-9772-ebc64e68c063 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:13.019002 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3578fb5-289c-41a2-961b-2e92f1c3d7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:13.020068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3578fb5-289c-41a2-961b-2e92f1c3d7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:13.020565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3578fb5-289c-41a2-961b-2e92f1c3d7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:13.021044 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3578fb5-289c-41a2-961b-2e92f1c3d7e1 admin admin] PATH_INFO: `/v3/projects/63f49ef585b848209e5731187c55882a` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:13.023195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3578fb5-289c-41a2-961b-2e92f1c3d7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f49ef585b848209e5731187c55882a)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:13.027012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3578fb5-289c-41a2-961b-2e92f1c3d7e1 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:13.195928 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46e43f-08bd-44b3-8efd-e1b0fff1cf51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:13.198297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46e43f-08bd-44b3-8efd-e1b0fff1cf51 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:13.245468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 974/1933] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:13.245753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d3578fb5-289c-41a2-961b-2e92f1c3d7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f49ef585b848209e5731187c55882a', 'request_id': 'req-d3578fb5-289c-41a2-961b-2e92f1c3d7e1'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:13.250101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46e43f-08bd-44b3-8efd-e1b0fff1cf51 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:13.276056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d3578fb5-289c-41a2-961b-2e92f1c3d7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f49ef585b848209e5731187c55882a', 'request_id': 'req-d3578fb5-289c-41a2-961b-2e92f1c3d7e1'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:13.303052 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d3578fb5-289c-41a2-961b-2e92f1c3d7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f49ef585b848209e5731187c55882a', 'request_id': 'req-d3578fb5-289c-41a2-961b-2e92f1c3d7e1'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:13.338708 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46e43f-08bd-44b3-8efd-e1b0fff1cf51 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:13.350489 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d3578fb5-289c-41a2-961b-2e92f1c3d7e1 admin admin] The token cache is being invalidate because project 63f49ef585b848209e5731187c55882a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:13.350946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d3578fb5-289c-41a2-961b-2e92f1c3d7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:13.356144 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d3578fb5-289c-41a2-961b-2e92f1c3d7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:13.363062 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 960/1934] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:12 2022] DELETE /identity/v3/projects/63f49ef585b848209e5731187c55882a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:13.370962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37cb6d-30b3-418d-8e0f-384bf06f5343 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:13.371760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37cb6d-30b3-418d-8e0f-384bf06f5343 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:13.372621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37cb6d-30b3-418d-8e0f-384bf06f5343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:13.455607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-0f37cb6d-30b3-418d-8e0f-384bf06f5343 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:13.463795 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0f37cb6d-30b3-418d-8e0f-384bf06f5343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:13.474579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:13.585065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30d682-68aa-4e6d-8d84-f6aac1f9162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:13.586190 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30d682-68aa-4e6d-8d84-f6aac1f9162a admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:13.587119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30d682-68aa-4e6d-8d84-f6aac1f9162a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:13.587348 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30d682-68aa-4e6d-8d84-f6aac1f9162a admin admin] PATH_INFO: `/v3/projects/d1cf7eac5b234218b0ec8e160aa35bce/users/dfa37e10bfe240cc8253ee744321e44d/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:13.658413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30d682-68aa-4e6d-8d84-f6aac1f9162a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cf7eac5b234218b0ec8e160aa35bce, user_id=dfa37e10bfe240cc8253ee744321e44d, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:13.661315 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30d682-68aa-4e6d-8d84-f6aac1f9162a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:13.675514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 961/1935] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:13.678300 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37cb6d-30b3-418d-8e0f-384bf06f5343 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:13.682026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0f37cb6d-30b3-418d-8e0f-384bf06f5343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:13.700803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 975/1936] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:13 2022] PUT /identity/v3/projects/d1cf7eac5b234218b0ec8e160aa35bce/users/dfa37e10bfe240cc8253ee744321e44d/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:13.700803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79968717-a97f-4b58-8cd1-caae832035ca None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:13.700803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79968717-a97f-4b58-8cd1-caae832035ca None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:13.700803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79968717-a97f-4b58-8cd1-caae832035ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:13.739082 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37cb6d-30b3-418d-8e0f-384bf06f5343 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:13.778437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-79968717-a97f-4b58-8cd1-caae832035ca None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:13.804412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-79968717-a97f-4b58-8cd1-caae832035ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:13.971739 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:14.003949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8046ef3-47bb-4a29-bcb7-a2e765372a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:14.005930 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8046ef3-47bb-4a29-bcb7-a2e765372a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:14.009885 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8046ef3-47bb-4a29-bcb7-a2e765372a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:14.011143 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8046ef3-47bb-4a29-bcb7-a2e765372a07 admin admin] PATH_INFO: `/v3/users/a73a9a71cec6494caa70be0293cc10a4` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:14.016744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8046ef3-47bb-4a29-bcb7-a2e765372a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73a9a71cec6494caa70be0293cc10a4)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:14.023152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8046ef3-47bb-4a29-bcb7-a2e765372a07 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:14.052142 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 976/1937] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:14.058736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79968717-a97f-4b58-8cd1-caae832035ca None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:14.066621 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-79968717-a97f-4b58-8cd1-caae832035ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:14.098206 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79968717-a97f-4b58-8cd1-caae832035ca None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:14.148614 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaebf9-58ce-4997-8b73-3f1a7bae64f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:14.152760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaebf9-58ce-4997-8b73-3f1a7bae64f0 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:14.152760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaebf9-58ce-4997-8b73-3f1a7bae64f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:14.153361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaebf9-58ce-4997-8b73-3f1a7bae64f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:14.154818 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaebf9-58ce-4997-8b73-3f1a7bae64f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:14.157777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaebf9-58ce-4997-8b73-3f1a7bae64f0 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:14.217465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 977/1938] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:14.218867 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaebf9-58ce-4997-8b73-3f1a7bae64f0 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:14.223724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c8046ef3-47bb-4a29-bcb7-a2e765372a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73a9a71cec6494caa70be0293cc10a4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:14.227646 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c8046ef3-47bb-4a29-bcb7-a2e765372a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73a9a71cec6494caa70be0293cc10a4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:14.232858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaebf9-58ce-4997-8b73-3f1a7bae64f0 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:14.249553 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a5735-9de1-4c5d-8cb1-66a39dc4e656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:14.251890 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a5735-9de1-4c5d-8cb1-66a39dc4e656 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:14.253182 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c8046ef3-47bb-4a29-bcb7-a2e765372a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73a9a71cec6494caa70be0293cc10a4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:14.253610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a5735-9de1-4c5d-8cb1-66a39dc4e656 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:14.253887 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c8046ef3-47bb-4a29-bcb7-a2e765372a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73a9a71cec6494caa70be0293cc10a4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:14.254322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a5735-9de1-4c5d-8cb1-66a39dc4e656 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:14.256315 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a5735-9de1-4c5d-8cb1-66a39dc4e656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:14.256986 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a5735-9de1-4c5d-8cb1-66a39dc4e656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:14.260813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a5735-9de1-4c5d-8cb1-66a39dc4e656 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:14.271075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c8046ef3-47bb-4a29-bcb7-a2e765372a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73a9a71cec6494caa70be0293cc10a4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:14.284951 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 978/1939] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:09:14.286097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a5735-9de1-4c5d-8cb1-66a39dc4e656 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:14.289662 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-276a5735-9de1-4c5d-8cb1-66a39dc4e656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:14.308278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a5735-9de1-4c5d-8cb1-66a39dc4e656 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:14.316806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 962/1940] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:13 2022] DELETE /identity/v3/users/a73a9a71cec6494caa70be0293cc10a4 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:14.317642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8046ef3-47bb-4a29-bcb7-a2e765372a07 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:14.322177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c8046ef3-47bb-4a29-bcb7-a2e765372a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:14.457649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8046ef3-47bb-4a29-bcb7-a2e765372a07 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:14.464147 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe00c7b-c12a-4591-ba1c-e49fa3b4a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:14.465336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe00c7b-c12a-4591-ba1c-e49fa3b4a242 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:14.465978 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe00c7b-c12a-4591-ba1c-e49fa3b4a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:14.466847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe00c7b-c12a-4591-ba1c-e49fa3b4a242 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:14.470734 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe00c7b-c12a-4591-ba1c-e49fa3b4a242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:14.478361 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe00c7b-c12a-4591-ba1c-e49fa3b4a242 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:14.552905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00989dcd-99b6-4c8a-908c-5ec53d9ce49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:14.555114 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00989dcd-99b6-4c8a-908c-5ec53d9ce49f admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:14.556166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00989dcd-99b6-4c8a-908c-5ec53d9ce49f admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:14.556477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00989dcd-99b6-4c8a-908c-5ec53d9ce49f admin admin] PATH_INFO: `/v3/projects/d1cf7eac5b234218b0ec8e160aa35bce/users/dfa37e10bfe240cc8253ee744321e44d/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:14.563463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00989dcd-99b6-4c8a-908c-5ec53d9ce49f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cf7eac5b234218b0ec8e160aa35bce, user_id=dfa37e10bfe240cc8253ee744321e44d, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:14.566310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00989dcd-99b6-4c8a-908c-5ec53d9ce49f admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:14.571927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 963/1941] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:14 2022] POST /identity/v3/projects => generated 375 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:14.575949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720e868-ad87-43a2-b253-69fd95775eee None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:14.576580 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720e868-ad87-43a2-b253-69fd95775eee None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:14.576896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720e868-ad87-43a2-b253-69fd95775eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:14.616428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 979/1942] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:14 2022] PUT /identity/v3/projects/d1cf7eac5b234218b0ec8e160aa35bce/users/dfa37e10bfe240cc8253ee744321e44d/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:14.616428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00989dcd-99b6-4c8a-908c-5ec53d9ce49f admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:14.641420 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-3720e868-ad87-43a2-b253-69fd95775eee None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:14.642988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3720e868-ad87-43a2-b253-69fd95775eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:14.684890 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:14.745217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00989dcd-99b6-4c8a-908c-5ec53d9ce49f admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:14.754587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506372d-62fe-41dc-b9be-55e9d2c9ec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:14.756623 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506372d-62fe-41dc-b9be-55e9d2c9ec62 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:14.757062 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506372d-62fe-41dc-b9be-55e9d2c9ec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:14.757458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506372d-62fe-41dc-b9be-55e9d2c9ec62 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:14.758260 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506372d-62fe-41dc-b9be-55e9d2c9ec62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:14.763102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506372d-62fe-41dc-b9be-55e9d2c9ec62 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:14.774086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:14.828140 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 980/1943] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:14 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:14.835863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37783635-578b-4fcd-b225-235f1d0b7521 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:14.835863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37783635-578b-4fcd-b225-235f1d0b7521 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:14.841192 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 964/1944] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:14.841192 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720e868-ad87-43a2-b253-69fd95775eee None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:14.844670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37783635-578b-4fcd-b225-235f1d0b7521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:14.898721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-37783635-578b-4fcd-b225-235f1d0b7521 None None] MFA Rules not processed for user `dfa37e10bfe240cc8253ee744321e44d`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:14.900538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-37783635-578b-4fcd-b225-235f1d0b7521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:14.903178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720e868-ad87-43a2-b253-69fd95775eee None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:14.921534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1314781-94c3-4ad7-aeb2-d91106a6a34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:14.922244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1314781-94c3-4ad7-aeb2-d91106a6a34d admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:14.922535 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1314781-94c3-4ad7-aeb2-d91106a6a34d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:14.922797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1314781-94c3-4ad7-aeb2-d91106a6a34d admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:14.932273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1314781-94c3-4ad7-aeb2-d91106a6a34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:14.934321 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1314781-94c3-4ad7-aeb2-d91106a6a34d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:14.966365 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 965/1945] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:14.967356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1314781-94c3-4ad7-aeb2-d91106a6a34d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:14.971850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c1314781-94c3-4ad7-aeb2-d91106a6a34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:15.072399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 981/1946] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:15.072399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37783635-578b-4fcd-b225-235f1d0b7521 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:15.093637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37783635-578b-4fcd-b225-235f1d0b7521 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:15.101322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127c9ef-a07e-44a5-b3e0-e4063b3d3518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:15.101322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127c9ef-a07e-44a5-b3e0-e4063b3d3518 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:15.101635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127c9ef-a07e-44a5-b3e0-e4063b3d3518 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:15.101867 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127c9ef-a07e-44a5-b3e0-e4063b3d3518 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:15.102448 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127c9ef-a07e-44a5-b3e0-e4063b3d3518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:15.104165 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127c9ef-a07e-44a5-b3e0-e4063b3d3518 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:15.112637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1314781-94c3-4ad7-aeb2-d91106a6a34d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:15.117742 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403118ef-3796-48b7-a62c-9215dfaac4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:15.118397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 982/1947] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:15.118747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403118ef-3796-48b7-a62c-9215dfaac4df service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:15.119170 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403118ef-3796-48b7-a62c-9215dfaac4df service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:15.119447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403118ef-3796-48b7-a62c-9215dfaac4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:15.123454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127c9ef-a07e-44a5-b3e0-e4063b3d3518 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:15.140619 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127c9ef-a07e-44a5-b3e0-e4063b3d3518 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:15.146947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76065eda-de8f-412e-822b-e4829174eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:15.148067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76065eda-de8f-412e-822b-e4829174eaba admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:15.148648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76065eda-de8f-412e-822b-e4829174eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:15.149076 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76065eda-de8f-412e-822b-e4829174eaba admin admin] PATH_INFO: `/v3/projects/5ab27611748448139d2d08a8c622986a/users/446977fbaef348948ddf7d51f9caa631/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:15.153098 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403118ef-3796-48b7-a62c-9215dfaac4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:15.158731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403118ef-3796-48b7-a62c-9215dfaac4df service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:15.175134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76065eda-de8f-412e-822b-e4829174eaba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab27611748448139d2d08a8c622986a, user_id=446977fbaef348948ddf7d51f9caa631, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:15.178786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76065eda-de8f-412e-822b-e4829174eaba admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:15.182889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 966/1948] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:15.184761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403118ef-3796-48b7-a62c-9215dfaac4df service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:15.188298 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-403118ef-3796-48b7-a62c-9215dfaac4df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:15.202494 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 983/1949] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:15 2022] PUT /identity/v3/projects/5ab27611748448139d2d08a8c622986a/users/446977fbaef348948ddf7d51f9caa631/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:15.216063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d6c7f-2b83-40d9-afe5-0e318afb7694 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:15.216686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d6c7f-2b83-40d9-afe5-0e318afb7694 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:15.217452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d6c7f-2b83-40d9-afe5-0e318afb7694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:15.329406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403118ef-3796-48b7-a62c-9215dfaac4df service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:15.342757 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-d65d6c7f-2b83-40d9-afe5-0e318afb7694 None None] MFA Rules not processed for user `446977fbaef348948ddf7d51f9caa631`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:15.347236 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d65d6c7f-2b83-40d9-afe5-0e318afb7694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:15.523188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a46d97-b4d3-4a1e-861e-3be81ccef6eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:15.524244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a46d97-b4d3-4a1e-861e-3be81ccef6eb service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:15.524808 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a46d97-b4d3-4a1e-861e-3be81ccef6eb service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:15.525308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a46d97-b4d3-4a1e-861e-3be81ccef6eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:15.623080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:15.656620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 984/1950] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:15.673696 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d6c7f-2b83-40d9-afe5-0e318afb7694 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:15.854386 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:15.872131 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a46d97-b4d3-4a1e-861e-3be81ccef6eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:15.874971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a46d97-b4d3-4a1e-861e-3be81ccef6eb service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:15.917899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 967/1951] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:15.944423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d6c7f-2b83-40d9-afe5-0e318afb7694 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:15.957986 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d64549-ce27-41fd-b8be-26c4fe7a92c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:15.959044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d64549-ce27-41fd-b8be-26c4fe7a92c9 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:15.959501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d64549-ce27-41fd-b8be-26c4fe7a92c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:15.959980 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d64549-ce27-41fd-b8be-26c4fe7a92c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:15.965026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d64549-ce27-41fd-b8be-26c4fe7a92c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:15.974482 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d64549-ce27-41fd-b8be-26c4fe7a92c9 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:16.066119 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a46d97-b4d3-4a1e-861e-3be81ccef6eb service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:16.067125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f4a46d97-b4d3-4a1e-861e-3be81ccef6eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:16.104419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 985/1952] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:15 2022] POST /identity/v3/projects => generated 375 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:16.117485 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d64549-ce27-41fd-b8be-26c4fe7a92c9 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:16.141096 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a46d97-b4d3-4a1e-861e-3be81ccef6eb service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:16.292048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d64549-ce27-41fd-b8be-26c4fe7a92c9 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:16.324050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc42b10-6edb-4375-bb74-0fe350f62205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:16.325119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc42b10-6edb-4375-bb74-0fe350f62205 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:16.325660 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc42b10-6edb-4375-bb74-0fe350f62205 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:16.326028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc42b10-6edb-4375-bb74-0fe350f62205 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:16.326946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc42b10-6edb-4375-bb74-0fe350f62205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:16.329052 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc42b10-6edb-4375-bb74-0fe350f62205 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:16.371418 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93ccff-3444-4722-9b23-e42c6105098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:16.372705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93ccff-3444-4722-9b23-e42c6105098d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:16.373196 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93ccff-3444-4722-9b23-e42c6105098d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:16.373690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93ccff-3444-4722-9b23-e42c6105098d admin admin] PATH_INFO: `/v3/projects/acab7512990b45719c8cfb97f66d14f6` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:16.375086 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 986/1953] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:16 2022] POST /identity/v3/users => generated 288 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:16.379144 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93ccff-3444-4722-9b23-e42c6105098d admin admin] RBAC: Authorizing `identity:delete_project(project_id=acab7512990b45719c8cfb97f66d14f6)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:16.381367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93ccff-3444-4722-9b23-e42c6105098d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:16.383596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc42b10-6edb-4375-bb74-0fe350f62205 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:16.414684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc42b10-6edb-4375-bb74-0fe350f62205 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:16.427084 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b4642-4c2b-4b37-a493-858d301355e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:16.427721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b4642-4c2b-4b37-a493-858d301355e7 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:16.427978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b4642-4c2b-4b37-a493-858d301355e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:16.428253 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b4642-4c2b-4b37-a493-858d301355e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:16.428973 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b4642-4c2b-4b37-a493-858d301355e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:16.431385 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b4642-4c2b-4b37-a493-858d301355e7 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:16.460977 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 987/1954] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:16.466036 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b4642-4c2b-4b37-a493-858d301355e7 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:16.520916 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-cf93ccff-3444-4722-9b23-e42c6105098d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acab7512990b45719c8cfb97f66d14f6', 'request_id': 'req-cf93ccff-3444-4722-9b23-e42c6105098d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:16.538671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-cf93ccff-3444-4722-9b23-e42c6105098d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acab7512990b45719c8cfb97f66d14f6', 'request_id': 'req-cf93ccff-3444-4722-9b23-e42c6105098d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:16.559151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-cf93ccff-3444-4722-9b23-e42c6105098d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acab7512990b45719c8cfb97f66d14f6', 'request_id': 'req-cf93ccff-3444-4722-9b23-e42c6105098d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:16.594318 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-cf93ccff-3444-4722-9b23-e42c6105098d admin admin] The token cache is being invalidate because project acab7512990b45719c8cfb97f66d14f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:16.594957 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-cf93ccff-3444-4722-9b23-e42c6105098d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:16.597471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-cf93ccff-3444-4722-9b23-e42c6105098d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:16.604439 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 968/1955] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:16 2022] DELETE /identity/v3/projects/acab7512990b45719c8cfb97f66d14f6 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:16.608019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93ccff-3444-4722-9b23-e42c6105098d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:16.611100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b4642-4c2b-4b37-a493-858d301355e7 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:16.611639 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-cf93ccff-3444-4722-9b23-e42c6105098d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:16.633894 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:16.750812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af1ac0-15fb-4ca4-af67-09d97c09635b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:16.752304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af1ac0-15fb-4ca4-af67-09d97c09635b service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:16.752979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af1ac0-15fb-4ca4-af67-09d97c09635b service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:16.755301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af1ac0-15fb-4ca4-af67-09d97c09635b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:16.757846 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a2af1ac0-15fb-4ca4-af67-09d97c09635b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:16.808655 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93ccff-3444-4722-9b23-e42c6105098d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:16.814508 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024d599-2d30-4d80-b6a6-a9870df08086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:16.815390 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024d599-2d30-4d80-b6a6-a9870df08086 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:16.815694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024d599-2d30-4d80-b6a6-a9870df08086 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:16.816110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024d599-2d30-4d80-b6a6-a9870df08086 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:16.816831 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024d599-2d30-4d80-b6a6-a9870df08086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:16.821735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024d599-2d30-4d80-b6a6-a9870df08086 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:16.838692 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 969/1956] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:16.840244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024d599-2d30-4d80-b6a6-a9870df08086 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:16.843001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0024d599-2d30-4d80-b6a6-a9870df08086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:16.866778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024d599-2d30-4d80-b6a6-a9870df08086 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:16.877640 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ddf7c-6645-42d2-9a22-259e5b44c714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:16.878836 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ddf7c-6645-42d2-9a22-259e5b44c714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:16.879225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ddf7c-6645-42d2-9a22-259e5b44c714 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:16.879730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ddf7c-6645-42d2-9a22-259e5b44c714 admin admin] PATH_INFO: `/v3/users/4a8a7a8f31ad45128d2990de135b89b5` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:16.882450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ddf7c-6645-42d2-9a22-259e5b44c714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8a7a8f31ad45128d2990de135b89b5)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:16.886349 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ddf7c-6645-42d2-9a22-259e5b44c714 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:16.904784 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af1ac0-15fb-4ca4-af67-09d97c09635b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:16.909651 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af1ac0-15fb-4ca4-af67-09d97c09635b service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:16.928159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:16.950839 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 988/1957] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:16.952243 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af1ac0-15fb-4ca4-af67-09d97c09635b service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:16.983908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af1ac0-15fb-4ca4-af67-09d97c09635b service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:16.993916 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505934b2-2a41-4781-9100-41ad30cfa4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:16.995136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505934b2-2a41-4781-9100-41ad30cfa4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:16.995607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505934b2-2a41-4781-9100-41ad30cfa4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:16.996223 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505934b2-2a41-4781-9100-41ad30cfa4d3 admin admin] PATH_INFO: `/v3/projects/20b3a1d485e641f3bfc072be5c01f1c0/users/b2109f60901b4243bfc7feabcd1c43d1/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:17.030074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-577ddf7c-6645-42d2-9a22-259e5b44c714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8a7a8f31ad45128d2990de135b89b5'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:17.031243 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505934b2-2a41-4781-9100-41ad30cfa4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b3a1d485e641f3bfc072be5c01f1c0, user_id=b2109f60901b4243bfc7feabcd1c43d1, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:17.031379 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-577ddf7c-6645-42d2-9a22-259e5b44c714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8a7a8f31ad45128d2990de135b89b5'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:17.038116 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505934b2-2a41-4781-9100-41ad30cfa4d3 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:17.048399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-577ddf7c-6645-42d2-9a22-259e5b44c714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8a7a8f31ad45128d2990de135b89b5'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:17.054223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-577ddf7c-6645-42d2-9a22-259e5b44c714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8a7a8f31ad45128d2990de135b89b5'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:17.078448 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 989/1958] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:16 2022] PUT /identity/v3/projects/20b3a1d485e641f3bfc072be5c01f1c0/users/b2109f60901b4243bfc7feabcd1c43d1/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:17.083435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-577ddf7c-6645-42d2-9a22-259e5b44c714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8a7a8f31ad45128d2990de135b89b5'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:17.101707 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6722-92f5-46ce-9d91-c73fe81a4fb4 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:17.102234 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6722-92f5-46ce-9d91-c73fe81a4fb4 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:17.102815 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6722-92f5-46ce-9d91-c73fe81a4fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:17.193589 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 970/1959] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:16 2022] DELETE /identity/v3/users/4a8a7a8f31ad45128d2990de135b89b5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:17.204202 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-b85a6722-92f5-46ce-9d91-c73fe81a4fb4 None None] MFA Rules not processed for user `b2109f60901b4243bfc7feabcd1c43d1`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:17.206545 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b85a6722-92f5-46ce-9d91-c73fe81a4fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:17.359758 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 990/1960] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:09:17.365481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ddf7c-6645-42d2-9a22-259e5b44c714 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:17.367020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-577ddf7c-6645-42d2-9a22-259e5b44c714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:17.629390 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ddf7c-6645-42d2-9a22-259e5b44c714 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:17.663567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26887403-0293-461d-92ab-0bd52b62cbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:17.664218 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26887403-0293-461d-92ab-0bd52b62cbef admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:17.664603 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26887403-0293-461d-92ab-0bd52b62cbef admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:17.665544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26887403-0293-461d-92ab-0bd52b62cbef admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:17.666213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26887403-0293-461d-92ab-0bd52b62cbef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:17.668391 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26887403-0293-461d-92ab-0bd52b62cbef admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:17.738678 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 971/1961] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:17 2022] POST /identity/v3/projects => generated 375 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:17.742900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a6722-92f5-46ce-9d91-c73fe81a4fb4 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:17.762726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a6722-92f5-46ce-9d91-c73fe81a4fb4 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:17.857596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:17.891306 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf446e-a7c8-4844-a5ba-d5f3c1b38ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:17.891926 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf446e-a7c8-4844-a5ba-d5f3c1b38ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:17.892200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf446e-a7c8-4844-a5ba-d5f3c1b38ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:17.892640 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf446e-a7c8-4844-a5ba-d5f3c1b38ab8 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:17.893590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf446e-a7c8-4844-a5ba-d5f3c1b38ab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:17.895699 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf446e-a7c8-4844-a5ba-d5f3c1b38ab8 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:17.923299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 991/1962] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:17 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:17.932402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26887403-0293-461d-92ab-0bd52b62cbef admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:17.950534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26887403-0293-461d-92ab-0bd52b62cbef admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:17.960352 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97654350-b1d3-4e66-83c8-321fe3d95409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:17.961667 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97654350-b1d3-4e66-83c8-321fe3d95409 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:17.962589 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97654350-b1d3-4e66-83c8-321fe3d95409 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:17.964813 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97654350-b1d3-4e66-83c8-321fe3d95409 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:17.966286 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97654350-b1d3-4e66-83c8-321fe3d95409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:17.973327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97654350-b1d3-4e66-83c8-321fe3d95409 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:17.994363 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 972/1963] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:17.999378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf446e-a7c8-4844-a5ba-d5f3c1b38ab8 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:18.021637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf446e-a7c8-4844-a5ba-d5f3c1b38ab8 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:18.028460 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff69258-f5d7-4331-9a69-e75b1ad70340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:18.029635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff69258-f5d7-4331-9a69-e75b1ad70340 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:18.030084 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff69258-f5d7-4331-9a69-e75b1ad70340 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:18.030739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff69258-f5d7-4331-9a69-e75b1ad70340 admin admin] PATH_INFO: `/v3/projects/45d8df78c4404912a028b5a30cf81867/users/9c24ab86f34d43a783ca7fa2eb470657/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:18.032123 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97654350-b1d3-4e66-83c8-321fe3d95409 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:18.036478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-97654350-b1d3-4e66-83c8-321fe3d95409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:18.065705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff69258-f5d7-4331-9a69-e75b1ad70340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d8df78c4404912a028b5a30cf81867, user_id=9c24ab86f34d43a783ca7fa2eb470657, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:18.072049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff69258-f5d7-4331-9a69-e75b1ad70340 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:18.074544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97654350-b1d3-4e66-83c8-321fe3d95409 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:18.086592 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02023f5-6f61-4c22-a91e-31b03d911c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:18.087272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02023f5-6f61-4c22-a91e-31b03d911c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:18.088803 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02023f5-6f61-4c22-a91e-31b03d911c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:18.089088 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02023f5-6f61-4c22-a91e-31b03d911c87 admin admin] PATH_INFO: `/v3/projects/287d490927704c5e8fc703a1303b2c6f` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:18.093742 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02023f5-6f61-4c22-a91e-31b03d911c87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=287d490927704c5e8fc703a1303b2c6f)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:18.101173 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02023f5-6f61-4c22-a91e-31b03d911c87 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:18.110287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 992/1964] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:17 2022] PUT /identity/v3/projects/45d8df78c4404912a028b5a30cf81867/users/9c24ab86f34d43a783ca7fa2eb470657/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:18.112925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff69258-f5d7-4331-9a69-e75b1ad70340 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:18.236032 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e02023f5-6f61-4c22-a91e-31b03d911c87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '287d490927704c5e8fc703a1303b2c6f', 'request_id': 'req-e02023f5-6f61-4c22-a91e-31b03d911c87'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:18.251666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e02023f5-6f61-4c22-a91e-31b03d911c87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '287d490927704c5e8fc703a1303b2c6f', 'request_id': 'req-e02023f5-6f61-4c22-a91e-31b03d911c87'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:18.264884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:18.270161 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e02023f5-6f61-4c22-a91e-31b03d911c87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '287d490927704c5e8fc703a1303b2c6f', 'request_id': 'req-e02023f5-6f61-4c22-a91e-31b03d911c87'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:18.304193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff69258-f5d7-4331-9a69-e75b1ad70340 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:18.324427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e02023f5-6f61-4c22-a91e-31b03d911c87 admin admin] The token cache is being invalidate because project 287d490927704c5e8fc703a1303b2c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:18.332671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e02023f5-6f61-4c22-a91e-31b03d911c87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:18.334440 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e02023f5-6f61-4c22-a91e-31b03d911c87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:18.340758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 973/1965] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:18 2022] DELETE /identity/v3/projects/287d490927704c5e8fc703a1303b2c6f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:18.352091 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a10fe-b849-4f09-b19f-523ab9d5dd4a None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:18.353112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a10fe-b849-4f09-b19f-523ab9d5dd4a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:18.353765 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a10fe-b849-4f09-b19f-523ab9d5dd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:18.434693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ae8a10fe-b849-4f09-b19f-523ab9d5dd4a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:18.439049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ae8a10fe-b849-4f09-b19f-523ab9d5dd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:18.473781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7478cf4-594e-487c-95f0-4c409353acbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:18.474715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7478cf4-594e-487c-95f0-4c409353acbf admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:18.475168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7478cf4-594e-487c-95f0-4c409353acbf admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:18.475624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7478cf4-594e-487c-95f0-4c409353acbf admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:18.476930 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7478cf4-594e-487c-95f0-4c409353acbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:18.480459 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7478cf4-594e-487c-95f0-4c409353acbf admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:18.508959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 993/1966] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:18.512689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7478cf4-594e-487c-95f0-4c409353acbf admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:18.519885 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f7478cf4-594e-487c-95f0-4c409353acbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:18.520069 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 974/1967] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:18.536997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88862de-c1f8-4a3e-b377-2a5162cbbf44 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:18.536997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88862de-c1f8-4a3e-b377-2a5162cbbf44 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:18.536997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88862de-c1f8-4a3e-b377-2a5162cbbf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:18.568528 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7478cf4-594e-487c-95f0-4c409353acbf admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:18.578746 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-e88862de-c1f8-4a3e-b377-2a5162cbbf44 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:18.580062 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-e88862de-c1f8-4a3e-b377-2a5162cbbf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:18.580348 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d057d60-1a5e-4c4e-bec9-2485192adc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:18.582340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d057d60-1a5e-4c4e-bec9-2485192adc10 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:18.583645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d057d60-1a5e-4c4e-bec9-2485192adc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:18.585532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d057d60-1a5e-4c4e-bec9-2485192adc10 admin admin] PATH_INFO: `/v3/projects/45d8df78c4404912a028b5a30cf81867/users/9c24ab86f34d43a783ca7fa2eb470657/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:18.590503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d057d60-1a5e-4c4e-bec9-2485192adc10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d8df78c4404912a028b5a30cf81867, user_id=9c24ab86f34d43a783ca7fa2eb470657, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:18.595608 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d057d60-1a5e-4c4e-bec9-2485192adc10 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:18.619299 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 975/1968] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:09:18.624234 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88862de-c1f8-4a3e-b377-2a5162cbbf44 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:18.644885 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 994/1969] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:18 2022] PUT /identity/v3/projects/45d8df78c4404912a028b5a30cf81867/users/9c24ab86f34d43a783ca7fa2eb470657/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:18.658110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88862de-c1f8-4a3e-b377-2a5162cbbf44 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:18.664884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80529706-26ae-419f-b0b6-394c3a9b1211 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:18.665361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80529706-26ae-419f-b0b6-394c3a9b1211 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:18.665826 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80529706-26ae-419f-b0b6-394c3a9b1211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:18.738777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-80529706-26ae-419f-b0b6-394c3a9b1211 None None] MFA Rules not processed for user `9c24ab86f34d43a783ca7fa2eb470657`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:18.740321 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-80529706-26ae-419f-b0b6-394c3a9b1211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:18.811912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e277846-af19-437c-8286-191bf96d0e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:18.812977 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:18.815521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e277846-af19-437c-8286-191bf96d0e0d admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:18.817237 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e277846-af19-437c-8286-191bf96d0e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:18.817915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e277846-af19-437c-8286-191bf96d0e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:18.819578 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e277846-af19-437c-8286-191bf96d0e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:18.820320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e277846-af19-437c-8286-191bf96d0e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:18.823641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e277846-af19-437c-8286-191bf96d0e0d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:18.851900 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 976/1970] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:09:18.861304 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e277846-af19-437c-8286-191bf96d0e0d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:18.873894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6e277846-af19-437c-8286-191bf96d0e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:18.899045 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e277846-af19-437c-8286-191bf96d0e0d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:18.908271 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58339461-71e1-415c-ac7c-ec16469f963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:18.909770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58339461-71e1-415c-ac7c-ec16469f963c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:18.910159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58339461-71e1-415c-ac7c-ec16469f963c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:18.910749 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58339461-71e1-415c-ac7c-ec16469f963c admin admin] PATH_INFO: `/v3/users/dda2f7e9560341da89340ea9811d2341` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:18.913880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58339461-71e1-415c-ac7c-ec16469f963c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda2f7e9560341da89340ea9811d2341)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:18.916552 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58339461-71e1-415c-ac7c-ec16469f963c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:18.920568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 995/1971] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:18.921476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80529706-26ae-419f-b0b6-394c3a9b1211 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:18.959727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80529706-26ae-419f-b0b6-394c3a9b1211 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:18.979543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb708e4-c153-44b7-bad1-1fe79e74aba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:18.980210 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb708e4-c153-44b7-bad1-1fe79e74aba3 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:18.980630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb708e4-c153-44b7-bad1-1fe79e74aba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:18.980924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb708e4-c153-44b7-bad1-1fe79e74aba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:18.981832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb708e4-c153-44b7-bad1-1fe79e74aba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:18.984011 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb708e4-c153-44b7-bad1-1fe79e74aba3 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:19.029554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-58339461-71e1-415c-ac7c-ec16469f963c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda2f7e9560341da89340ea9811d2341'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:19.030429 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-58339461-71e1-415c-ac7c-ec16469f963c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda2f7e9560341da89340ea9811d2341'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:19.043910 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-58339461-71e1-415c-ac7c-ec16469f963c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda2f7e9560341da89340ea9811d2341'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:19.046035 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-58339461-71e1-415c-ac7c-ec16469f963c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda2f7e9560341da89340ea9811d2341'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:19.060991 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-58339461-71e1-415c-ac7c-ec16469f963c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda2f7e9560341da89340ea9811d2341'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:19.068304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 996/1972] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:18 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:19.069988 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb708e4-c153-44b7-bad1-1fe79e74aba3 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:19.077815 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-edb708e4-c153-44b7-bad1-1fe79e74aba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:19.084051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:19.120246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 977/1973] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:18 2022] DELETE /identity/v3/users/dda2f7e9560341da89340ea9811d2341 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:19.121544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58339461-71e1-415c-ac7c-ec16469f963c admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:19.123504 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-58339461-71e1-415c-ac7c-ec16469f963c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:19.243734 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb708e4-c153-44b7-bad1-1fe79e74aba3 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:19.243979 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58339461-71e1-415c-ac7c-ec16469f963c admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:19.250406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89416f20-8a21-437b-8566-ee840f4d9a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:19.251630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89416f20-8a21-437b-8566-ee840f4d9a4d admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:19.251630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89416f20-8a21-437b-8566-ee840f4d9a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:19.251630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89416f20-8a21-437b-8566-ee840f4d9a4d admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:19.252314 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89416f20-8a21-437b-8566-ee840f4d9a4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:19.254533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89416f20-8a21-437b-8566-ee840f4d9a4d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:19.293527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 978/1974] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:19 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:19.293527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0db96-544c-41e2-90c3-80a05aa206b1 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:19.293527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0db96-544c-41e2-90c3-80a05aa206b1 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:19.293527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0db96-544c-41e2-90c3-80a05aa206b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:19.323527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-80e0db96-544c-41e2-90c3-80a05aa206b1 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:19.323527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-80e0db96-544c-41e2-90c3-80a05aa206b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:19.333604 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 979/1975] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:19.335932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0db96-544c-41e2-90c3-80a05aa206b1 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:19.358065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0db96-544c-41e2-90c3-80a05aa206b1 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:19.370908 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e6e1-e7a9-4dc0-a9be-64eb81923985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:19.371742 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e6e1-e7a9-4dc0-a9be-64eb81923985 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:19.372079 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e6e1-e7a9-4dc0-a9be-64eb81923985 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:19.372452 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e6e1-e7a9-4dc0-a9be-64eb81923985 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:19.373209 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52e6e1-e7a9-4dc0-a9be-64eb81923985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:19.375103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52e6e1-e7a9-4dc0-a9be-64eb81923985 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:19.382791 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7e398-d162-4399-8333-3fe65bc135d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:19.383523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7e398-d162-4399-8333-3fe65bc135d3 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:19.383900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7e398-d162-4399-8333-3fe65bc135d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:19.384182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7e398-d162-4399-8333-3fe65bc135d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:19.396865 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 980/1976] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:19.398853 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-fcf7e398-d162-4399-8333-3fe65bc135d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:19.403338 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e6e1-e7a9-4dc0-a9be-64eb81923985 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:19.406560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-df52e6e1-e7a9-4dc0-a9be-64eb81923985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:19.513162 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7e398-d162-4399-8333-3fe65bc135d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:19.514142 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e6e1-e7a9-4dc0-a9be-64eb81923985 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:19.515087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7e398-d162-4399-8333-3fe65bc135d3 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:19.521443 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fd1e7-b366-4544-b852-67ca22129de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:19.528942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fd1e7-b366-4544-b852-67ca22129de2 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:19.529389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 997/1977] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:19.529787 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fd1e7-b366-4544-b852-67ca22129de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:19.530238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fd1e7-b366-4544-b852-67ca22129de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:19.530402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7e398-d162-4399-8333-3fe65bc135d3 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:19.543854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fd1e7-b366-4544-b852-67ca22129de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:19.544730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7e398-d162-4399-8333-3fe65bc135d3 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:19.546724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fd1e7-b366-4544-b852-67ca22129de2 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:19.550309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c46f6-cc41-41e8-82fd-961e738e9fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:19.550946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c46f6-cc41-41e8-82fd-961e738e9fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:19.551281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c46f6-cc41-41e8-82fd-961e738e9fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:19.551556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c46f6-cc41-41e8-82fd-961e738e9fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:19.552224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c46f6-cc41-41e8-82fd-961e738e9fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:19.554103 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c46f6-cc41-41e8-82fd-961e738e9fb9 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:19.555691 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:19.563686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 981/1978] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:19.568845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 998/1979] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:19.575381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fd1e7-b366-4544-b852-67ca22129de2 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:19.610749 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fd1e7-b366-4544-b852-67ca22129de2 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:19.640681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207c1ea-abf1-4769-b804-5983311d8e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:19.642379 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207c1ea-abf1-4769-b804-5983311d8e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:19.643493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207c1ea-abf1-4769-b804-5983311d8e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:19.645363 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207c1ea-abf1-4769-b804-5983311d8e95 admin admin] PATH_INFO: `/v3/projects/444a51f51c53463e8cf6be7cc78525c3/users/2658d4393862473a88485e6bce6feab5/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:19.677261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207c1ea-abf1-4769-b804-5983311d8e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444a51f51c53463e8cf6be7cc78525c3, user_id=2658d4393862473a88485e6bce6feab5, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:19.692140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207c1ea-abf1-4769-b804-5983311d8e95 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:19.721282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 982/1980] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:19 2022] PUT /identity/v3/projects/444a51f51c53463e8cf6be7cc78525c3/users/2658d4393862473a88485e6bce6feab5/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:19.751041 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e41148-17b1-4de3-a653-d9d64868ff98 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:19.751485 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e41148-17b1-4de3-a653-d9d64868ff98 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:19.751822 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e41148-17b1-4de3-a653-d9d64868ff98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:19.802685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-e9e41148-17b1-4de3-a653-d9d64868ff98 None None] MFA Rules not processed for user `2658d4393862473a88485e6bce6feab5`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:19.805598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e9e41148-17b1-4de3-a653-d9d64868ff98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:19.907956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207c1ea-abf1-4769-b804-5983311d8e95 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:19.910085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-9207c1ea-abf1-4769-b804-5983311d8e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:19.962506 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 999/1981] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:19.969505 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e41148-17b1-4de3-a653-d9d64868ff98 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:20.002902 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:20.039103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207c1ea-abf1-4769-b804-5983311d8e95 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:20.044485 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715f0d3-7159-4f9e-a6b9-72c3d6111f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:20.045217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715f0d3-7159-4f9e-a6b9-72c3d6111f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:20.045572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715f0d3-7159-4f9e-a6b9-72c3d6111f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:20.045762 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715f0d3-7159-4f9e-a6b9-72c3d6111f23 admin admin] PATH_INFO: `/v3/users/71d1f8e260644076b976122c0c6e4e06` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:20.047029 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715f0d3-7159-4f9e-a6b9-72c3d6111f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d1f8e260644076b976122c0c6e4e06)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:20.049116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715f0d3-7159-4f9e-a6b9-72c3d6111f23 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:20.114492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e41148-17b1-4de3-a653-d9d64868ff98 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:20.121648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed9128-dd22-4de8-8e05-8c9f69552493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:20.122613 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed9128-dd22-4de8-8e05-8c9f69552493 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:20.123077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed9128-dd22-4de8-8e05-8c9f69552493 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:20.123735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed9128-dd22-4de8-8e05-8c9f69552493 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:20.125551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed9128-dd22-4de8-8e05-8c9f69552493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:20.127743 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed9128-dd22-4de8-8e05-8c9f69552493 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:20.134623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0715f0d3-7159-4f9e-a6b9-72c3d6111f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d1f8e260644076b976122c0c6e4e06'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:20.136571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0715f0d3-7159-4f9e-a6b9-72c3d6111f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d1f8e260644076b976122c0c6e4e06'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:20.153737 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0715f0d3-7159-4f9e-a6b9-72c3d6111f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d1f8e260644076b976122c0c6e4e06'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:20.156004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0715f0d3-7159-4f9e-a6b9-72c3d6111f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d1f8e260644076b976122c0c6e4e06'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:20.169430 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0715f0d3-7159-4f9e-a6b9-72c3d6111f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d1f8e260644076b976122c0c6e4e06'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:20.171752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1000/1982] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:19 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:09:20.173105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed9128-dd22-4de8-8e05-8c9f69552493 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:20.178267 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e0ed9128-dd22-4de8-8e05-8c9f69552493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:20.195543 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 983/1983] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:19 2022] DELETE /identity/v3/users/71d1f8e260644076b976122c0c6e4e06 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:20.196720 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715f0d3-7159-4f9e-a6b9-72c3d6111f23 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:20.200435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0715f0d3-7159-4f9e-a6b9-72c3d6111f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:20.261408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed9128-dd22-4de8-8e05-8c9f69552493 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:20.280694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:20.291128 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715f0d3-7159-4f9e-a6b9-72c3d6111f23 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:20.300575 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d887e26-3252-4353-bef0-9fb5881b2457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:20.301224 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d887e26-3252-4353-bef0-9fb5881b2457 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:20.301833 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d887e26-3252-4353-bef0-9fb5881b2457 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:20.302227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d887e26-3252-4353-bef0-9fb5881b2457 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:20.302889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d887e26-3252-4353-bef0-9fb5881b2457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:20.305101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d887e26-3252-4353-bef0-9fb5881b2457 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:20.338819 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 984/1984] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:20 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:20.340874 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836e91f-3ac3-41ec-b0a0-3ee702d9681e None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:20.341162 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836e91f-3ac3-41ec-b0a0-3ee702d9681e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:20.341436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836e91f-3ac3-41ec-b0a0-3ee702d9681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:20.377116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-d836e91f-3ac3-41ec-b0a0-3ee702d9681e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:20.379943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d836e91f-3ac3-41ec-b0a0-3ee702d9681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:20.382450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f405324-4ec5-4e29-8117-d3d08715b649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:20.383183 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f405324-4ec5-4e29-8117-d3d08715b649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:20.383506 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f405324-4ec5-4e29-8117-d3d08715b649 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:20.384019 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f405324-4ec5-4e29-8117-d3d08715b649 admin admin] PATH_INFO: `/v3/projects/c5d9324f418e43b6b3a86bb1c6fd3620` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:20.385641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f405324-4ec5-4e29-8117-d3d08715b649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d9324f418e43b6b3a86bb1c6fd3620)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:20.389369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f405324-4ec5-4e29-8117-d3d08715b649 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:20.401247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 985/1985] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:20.401247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836e91f-3ac3-41ec-b0a0-3ee702d9681e None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:20.421949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836e91f-3ac3-41ec-b0a0-3ee702d9681e None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:20.436148 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa967564-a274-4de9-8b3c-eb23fddae3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:20.437057 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa967564-a274-4de9-8b3c-eb23fddae3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:20.437479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa967564-a274-4de9-8b3c-eb23fddae3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:20.437717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa967564-a274-4de9-8b3c-eb23fddae3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:20.438787 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa967564-a274-4de9-8b3c-eb23fddae3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:20.442206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa967564-a274-4de9-8b3c-eb23fddae3c7 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:20.459330 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 986/1986] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:20.461567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa967564-a274-4de9-8b3c-eb23fddae3c7 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:20.468889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fa967564-a274-4de9-8b3c-eb23fddae3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:20.492780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-3f405324-4ec5-4e29-8117-d3d08715b649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d9324f418e43b6b3a86bb1c6fd3620', 'request_id': 'req-3f405324-4ec5-4e29-8117-d3d08715b649'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:20.512033 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-3f405324-4ec5-4e29-8117-d3d08715b649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d9324f418e43b6b3a86bb1c6fd3620', 'request_id': 'req-3f405324-4ec5-4e29-8117-d3d08715b649'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:20.529068 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-3f405324-4ec5-4e29-8117-d3d08715b649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d9324f418e43b6b3a86bb1c6fd3620', 'request_id': 'req-3f405324-4ec5-4e29-8117-d3d08715b649'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:20.552757 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-3f405324-4ec5-4e29-8117-d3d08715b649 admin admin] The token cache is being invalidate because project c5d9324f418e43b6b3a86bb1c6fd3620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:20.553162 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-3f405324-4ec5-4e29-8117-d3d08715b649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:20.556591 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:20.559074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-3f405324-4ec5-4e29-8117-d3d08715b649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:20.561148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1001/1987] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:20 2022] DELETE /identity/v3/projects/c5d9324f418e43b6b3a86bb1c6fd3620 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:20.563152 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f405324-4ec5-4e29-8117-d3d08715b649 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:20.572156 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-3f405324-4ec5-4e29-8117-d3d08715b649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:20.620943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa967564-a274-4de9-8b3c-eb23fddae3c7 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:20.685024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f405324-4ec5-4e29-8117-d3d08715b649 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:20.691244 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2848e0b-fe26-4a65-8655-eee4b348c705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:20.692259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2848e0b-fe26-4a65-8655-eee4b348c705 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:20.692620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2848e0b-fe26-4a65-8655-eee4b348c705 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:20.692878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2848e0b-fe26-4a65-8655-eee4b348c705 admin admin] PATH_INFO: `/v3/projects/4cbfff4e29fa4f3f9db65146d105286a/users/768cf9d74d75492183467067c7989773/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:20.713930 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2848e0b-fe26-4a65-8655-eee4b348c705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbfff4e29fa4f3f9db65146d105286a, user_id=768cf9d74d75492183467067c7989773, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:20.718428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2848e0b-fe26-4a65-8655-eee4b348c705 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:20.745515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1002/1988] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:20 2022] PUT /identity/v3/projects/4cbfff4e29fa4f3f9db65146d105286a/users/768cf9d74d75492183467067c7989773/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:20.746624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2848e0b-fe26-4a65-8655-eee4b348c705 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:20.748588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c2848e0b-fe26-4a65-8655-eee4b348c705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:20.752073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfde4b-4e8a-4218-bf72-bbe805c34d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:20.753867 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfde4b-4e8a-4218-bf72-bbe805c34d67 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:20.753867 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfde4b-4e8a-4218-bf72-bbe805c34d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:20.753867 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfde4b-4e8a-4218-bf72-bbe805c34d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:20.756744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c8cfde4b-4e8a-4218-bf72-bbe805c34d67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:20.780088 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfde4b-4e8a-4218-bf72-bbe805c34d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:20.783458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfde4b-4e8a-4218-bf72-bbe805c34d67 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:20.799926 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:20.805383 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 987/1989] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:20.806581 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfde4b-4e8a-4218-bf72-bbe805c34d67 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:20.835589 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfde4b-4e8a-4218-bf72-bbe805c34d67 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:20.916444 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2848e0b-fe26-4a65-8655-eee4b348c705 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:20.943956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6362b4f-0b6e-40ed-b3a8-a39afdc398f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:20.945001 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6362b4f-0b6e-40ed-b3a8-a39afdc398f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:20.945478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6362b4f-0b6e-40ed-b3a8-a39afdc398f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:20.945955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6362b4f-0b6e-40ed-b3a8-a39afdc398f2 admin admin] PATH_INFO: `/v3/users/8999ed85d2be420c970cdd4d1d98a9a1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:20.949966 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6362b4f-0b6e-40ed-b3a8-a39afdc398f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8999ed85d2be420c970cdd4d1d98a9a1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:20.954546 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1cd07-dc9d-47d2-b93b-52efcd176bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:20.955509 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1cd07-dc9d-47d2-b93b-52efcd176bec admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:20.956041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1cd07-dc9d-47d2-b93b-52efcd176bec admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:20.956501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1cd07-dc9d-47d2-b93b-52efcd176bec admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:20.957776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1cd07-dc9d-47d2-b93b-52efcd176bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:20.958456 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6362b4f-0b6e-40ed-b3a8-a39afdc398f2 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:20.961915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1cd07-dc9d-47d2-b93b-52efcd176bec admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:20.980808 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 988/1990] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:20.983185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1cd07-dc9d-47d2-b93b-52efcd176bec admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:20.999058 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1cd07-dc9d-47d2-b93b-52efcd176bec admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:21.021266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f03f1-1b77-48be-bdb2-acf3c7c22780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:21.027899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f03f1-1b77-48be-bdb2-acf3c7c22780 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:21.030080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f03f1-1b77-48be-bdb2-acf3c7c22780 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:21.032675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f03f1-1b77-48be-bdb2-acf3c7c22780 admin admin] PATH_INFO: `/v3/projects/4cbfff4e29fa4f3f9db65146d105286a/users/768cf9d74d75492183467067c7989773/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:21.039046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f03f1-1b77-48be-bdb2-acf3c7c22780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbfff4e29fa4f3f9db65146d105286a, user_id=768cf9d74d75492183467067c7989773, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:21.053740 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f03f1-1b77-48be-bdb2-acf3c7c22780 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:21.079648 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 989/1991] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:20 2022] PUT /identity/v3/projects/4cbfff4e29fa4f3f9db65146d105286a/users/768cf9d74d75492183467067c7989773/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:21.101146 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ebf55-04c4-430c-9c41-ed4128b19d54 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:21.101733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ebf55-04c4-430c-9c41-ed4128b19d54 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:21.102153 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ebf55-04c4-430c-9c41-ed4128b19d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:21.127203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c6362b4f-0b6e-40ed-b3a8-a39afdc398f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8999ed85d2be420c970cdd4d1d98a9a1'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:21.128939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c6362b4f-0b6e-40ed-b3a8-a39afdc398f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8999ed85d2be420c970cdd4d1d98a9a1'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:21.155342 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c6362b4f-0b6e-40ed-b3a8-a39afdc398f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8999ed85d2be420c970cdd4d1d98a9a1'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:21.177455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-216ebf55-04c4-430c-9c41-ed4128b19d54 None None] MFA Rules not processed for user `768cf9d74d75492183467067c7989773`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:21.179013 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-216ebf55-04c4-430c-9c41-ed4128b19d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:21.192323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c6362b4f-0b6e-40ed-b3a8-a39afdc398f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8999ed85d2be420c970cdd4d1d98a9a1'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:21.216793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c6362b4f-0b6e-40ed-b3a8-a39afdc398f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8999ed85d2be420c970cdd4d1d98a9a1'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:21.228883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1003/1992] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:20 2022] DELETE /identity/v3/users/8999ed85d2be420c970cdd4d1d98a9a1 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:21.375532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:21.401710 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 990/1993] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:21.410725 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6362b4f-0b6e-40ed-b3a8-a39afdc398f2 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:21.413893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c6362b4f-0b6e-40ed-b3a8-a39afdc398f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:21.531104 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ebf55-04c4-430c-9c41-ed4128b19d54 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:21.532608 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-216ebf55-04c4-430c-9c41-ed4128b19d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:21.550977 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6362b4f-0b6e-40ed-b3a8-a39afdc398f2 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:21.555776 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4b407-215d-4bd8-9129-fdf7321af0d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:21.556433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4b407-215d-4bd8-9129-fdf7321af0d1 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:21.556718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4b407-215d-4bd8-9129-fdf7321af0d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:21.556995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4b407-215d-4bd8-9129-fdf7321af0d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:21.560266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-bfb4b407-215d-4bd8-9129-fdf7321af0d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:21.670396 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4b407-215d-4bd8-9129-fdf7321af0d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:21.681595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4b407-215d-4bd8-9129-fdf7321af0d1 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:21.707499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ebf55-04c4-430c-9c41-ed4128b19d54 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:21.718342 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577de56-c907-4d2e-8e0b-ea180414bdcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:21.725786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1004/1994] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:21.733537 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577de56-c907-4d2e-8e0b-ea180414bdcf service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:21.735142 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577de56-c907-4d2e-8e0b-ea180414bdcf service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:21.738651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577de56-c907-4d2e-8e0b-ea180414bdcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:21.741756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4b407-215d-4bd8-9129-fdf7321af0d1 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:21.745844 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2577de56-c907-4d2e-8e0b-ea180414bdcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:21.747556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-bfb4b407-215d-4bd8-9129-fdf7321af0d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:21.778681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:21.889110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577de56-c907-4d2e-8e0b-ea180414bdcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:21.891835 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577de56-c907-4d2e-8e0b-ea180414bdcf service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:21.907787 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 991/1995] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:09:21.922568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577de56-c907-4d2e-8e0b-ea180414bdcf service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:21.935826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2577de56-c907-4d2e-8e0b-ea180414bdcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:21.982840 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4b407-215d-4bd8-9129-fdf7321af0d1 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:22.004998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa678b3-9954-4325-981d-5a5fb2f44986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:22.006123 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa678b3-9954-4325-981d-5a5fb2f44986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:22.007395 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa678b3-9954-4325-981d-5a5fb2f44986 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:22.011758 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa678b3-9954-4325-981d-5a5fb2f44986 admin admin] PATH_INFO: `/v3/projects/03ebd6dab7e3419a8a82df7b4fd975ab` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:22.017188 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa678b3-9954-4325-981d-5a5fb2f44986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ebd6dab7e3419a8a82df7b4fd975ab)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:22.022373 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa678b3-9954-4325-981d-5a5fb2f44986 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:22.210578 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577de56-c907-4d2e-8e0b-ea180414bdcf service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:22.220147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-dfa678b3-9954-4325-981d-5a5fb2f44986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ebd6dab7e3419a8a82df7b4fd975ab', 'request_id': 'req-dfa678b3-9954-4325-981d-5a5fb2f44986'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:22.235998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-dfa678b3-9954-4325-981d-5a5fb2f44986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ebd6dab7e3419a8a82df7b4fd975ab', 'request_id': 'req-dfa678b3-9954-4325-981d-5a5fb2f44986'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:22.273969 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-dfa678b3-9954-4325-981d-5a5fb2f44986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ebd6dab7e3419a8a82df7b4fd975ab', 'request_id': 'req-dfa678b3-9954-4325-981d-5a5fb2f44986'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:22.321586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-dfa678b3-9954-4325-981d-5a5fb2f44986 admin admin] The token cache is being invalidate because project 03ebd6dab7e3419a8a82df7b4fd975ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:22.321586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-dfa678b3-9954-4325-981d-5a5fb2f44986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:22.328003 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-dfa678b3-9954-4325-981d-5a5fb2f44986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:22.336129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1005/1996] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:21 2022] DELETE /identity/v3/projects/03ebd6dab7e3419a8a82df7b4fd975ab => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:22.339967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030e078-f93c-48f5-a3ae-13d80f9f8300 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:22.341105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030e078-f93c-48f5-a3ae-13d80f9f8300 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:22.343273 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030e078-f93c-48f5-a3ae-13d80f9f8300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:22.465191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-6030e078-f93c-48f5-a3ae-13d80f9f8300 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:22.474016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6030e078-f93c-48f5-a3ae-13d80f9f8300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:22.483763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2afc9d-378c-4695-9475-9896e34c7da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:22.485050 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2afc9d-378c-4695-9475-9896e34c7da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:22.486420 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2afc9d-378c-4695-9475-9896e34c7da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:22.487821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2afc9d-378c-4695-9475-9896e34c7da6 admin admin] PATH_INFO: `/v3/projects/c5fae47d3abb4797b42b77d2dcb0b3ec` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:22.491932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2afc9d-378c-4695-9475-9896e34c7da6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5fae47d3abb4797b42b77d2dcb0b3ec)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:22.501480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2afc9d-378c-4695-9475-9896e34c7da6 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:22.509322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1006/1997] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:22.523934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cb04e-8ecc-459e-a2a0-7f21af3aced7 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:22.525093 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cb04e-8ecc-459e-a2a0-7f21af3aced7 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:22.529708 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cb04e-8ecc-459e-a2a0-7f21af3aced7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:22.535023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:22.622750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-bb0cb04e-8ecc-459e-a2a0-7f21af3aced7 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:22.624935 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-bb0cb04e-8ecc-459e-a2a0-7f21af3aced7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:22.675018 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1007/1998] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:22.685671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cb04e-8ecc-459e-a2a0-7f21af3aced7 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:22.712748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-cf2afc9d-378c-4695-9475-9896e34c7da6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5fae47d3abb4797b42b77d2dcb0b3ec', 'request_id': 'req-cf2afc9d-378c-4695-9475-9896e34c7da6'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:22.729837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cb04e-8ecc-459e-a2a0-7f21af3aced7 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:22.732507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-cf2afc9d-378c-4695-9475-9896e34c7da6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5fae47d3abb4797b42b77d2dcb0b3ec', 'request_id': 'req-cf2afc9d-378c-4695-9475-9896e34c7da6'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:22.752457 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-cf2afc9d-378c-4695-9475-9896e34c7da6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5fae47d3abb4797b42b77d2dcb0b3ec', 'request_id': 'req-cf2afc9d-378c-4695-9475-9896e34c7da6'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:22.814013 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-cf2afc9d-378c-4695-9475-9896e34c7da6 admin admin] The token cache is being invalidate because project c5fae47d3abb4797b42b77d2dcb0b3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:22.814543 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-cf2afc9d-378c-4695-9475-9896e34c7da6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:22.819403 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-cf2afc9d-378c-4695-9475-9896e34c7da6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:22.833622 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 992/1999] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:21 2022] DELETE /identity/v3/projects/c5fae47d3abb4797b42b77d2dcb0b3ec => generated 0 bytes in 907 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:22.838097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2afc9d-378c-4695-9475-9896e34c7da6 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:22.840574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-cf2afc9d-378c-4695-9475-9896e34c7da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:23.005594 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883aacb-f8fc-4457-b04e-a230d20fa4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:23.006421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883aacb-f8fc-4457-b04e-a230d20fa4ec admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:23.006845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883aacb-f8fc-4457-b04e-a230d20fa4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:23.007268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883aacb-f8fc-4457-b04e-a230d20fa4ec admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:23.008136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883aacb-f8fc-4457-b04e-a230d20fa4ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:23.011297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883aacb-f8fc-4457-b04e-a230d20fa4ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:23.015593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883aacb-f8fc-4457-b04e-a230d20fa4ec admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:23.066117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1008/2000] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:09:23.073300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883aacb-f8fc-4457-b04e-a230d20fa4ec admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:23.077389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0883aacb-f8fc-4457-b04e-a230d20fa4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:23.109828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883aacb-f8fc-4457-b04e-a230d20fa4ec admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:23.118440 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2afc9d-378c-4695-9475-9896e34c7da6 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:23.122328 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d146ee-ce51-44a6-9ac3-081d3f046a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:23.122936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d146ee-ce51-44a6-9ac3-081d3f046a38 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:23.123222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d146ee-ce51-44a6-9ac3-081d3f046a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:23.123501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d146ee-ce51-44a6-9ac3-081d3f046a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:23.124427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d146ee-ce51-44a6-9ac3-081d3f046a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:23.126668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d146ee-ce51-44a6-9ac3-081d3f046a38 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:23.140792 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a804b1-9c97-4103-9063-f24b502d0984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:23.141576 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a804b1-9c97-4103-9063-f24b502d0984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:23.142829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a804b1-9c97-4103-9063-f24b502d0984 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:23.143301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a804b1-9c97-4103-9063-f24b502d0984 admin admin] PATH_INFO: `/v3/users/4981a3bb5076424da93e43dce7f83f87` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:23.145455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a804b1-9c97-4103-9063-f24b502d0984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4981a3bb5076424da93e43dce7f83f87)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:23.148323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a804b1-9c97-4103-9063-f24b502d0984 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:23.213529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:23.240631 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1009/2001] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:23 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:23.249217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d146ee-ce51-44a6-9ac3-081d3f046a38 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:23.300138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d0a804b1-9c97-4103-9063-f24b502d0984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4981a3bb5076424da93e43dce7f83f87'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:23.303068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d0a804b1-9c97-4103-9063-f24b502d0984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4981a3bb5076424da93e43dce7f83f87'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:23.323460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d0a804b1-9c97-4103-9063-f24b502d0984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4981a3bb5076424da93e43dce7f83f87'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:23.327007 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d0a804b1-9c97-4103-9063-f24b502d0984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4981a3bb5076424da93e43dce7f83f87'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:23.352861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d0a804b1-9c97-4103-9063-f24b502d0984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4981a3bb5076424da93e43dce7f83f87'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:23.411779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 993/2002] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:22 2022] DELETE /identity/v3/users/4981a3bb5076424da93e43dce7f83f87 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:09:23.429512 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d146ee-ce51-44a6-9ac3-081d3f046a38 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:23.629128 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7294195-1a89-46bd-a908-da54ef865a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:23.630124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7294195-1a89-46bd-a908-da54ef865a79 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:23.630604 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7294195-1a89-46bd-a908-da54ef865a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:23.631064 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7294195-1a89-46bd-a908-da54ef865a79 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:23.635343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7294195-1a89-46bd-a908-da54ef865a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:23.639532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7294195-1a89-46bd-a908-da54ef865a79 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:23.716936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1010/2003] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:23 2022] POST /identity/v3/users => generated 287 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:23.718283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a804b1-9c97-4103-9063-f24b502d0984 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:23.720258 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d0a804b1-9c97-4103-9063-f24b502d0984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:23.742583 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a804b1-9c97-4103-9063-f24b502d0984 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:23.769165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5bb08-3067-49ff-aba5-44b8f759ed36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:23.771113 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5bb08-3067-49ff-aba5-44b8f759ed36 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:23.771113 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5bb08-3067-49ff-aba5-44b8f759ed36 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:23.771403 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5bb08-3067-49ff-aba5-44b8f759ed36 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:23.772211 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5bb08-3067-49ff-aba5-44b8f759ed36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:23.775365 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5bb08-3067-49ff-aba5-44b8f759ed36 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:23.784601 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:23.807601 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 994/2004] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:09:23.809861 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7294195-1a89-46bd-a908-da54ef865a79 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:23.834773 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5bb08-3067-49ff-aba5-44b8f759ed36 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:23.837472 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-80c5bb08-3067-49ff-aba5-44b8f759ed36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:23.855239 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7294195-1a89-46bd-a908-da54ef865a79 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:23.867282 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976125c-a3eb-45c7-a9b8-fcaecd000cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:23.868296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976125c-a3eb-45c7-a9b8-fcaecd000cbc admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:23.868795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976125c-a3eb-45c7-a9b8-fcaecd000cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:23.871361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976125c-a3eb-45c7-a9b8-fcaecd000cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:23.872738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976125c-a3eb-45c7-a9b8-fcaecd000cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:23.878105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976125c-a3eb-45c7-a9b8-fcaecd000cbc admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:23.960841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1011/2005] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:23.962646 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976125c-a3eb-45c7-a9b8-fcaecd000cbc admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:23.988226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976125c-a3eb-45c7-a9b8-fcaecd000cbc admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:24.021535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c4f55-fafc-4713-8844-12f74f7eec17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:24.025293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c4f55-fafc-4713-8844-12f74f7eec17 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:24.025924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c4f55-fafc-4713-8844-12f74f7eec17 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:24.026571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c4f55-fafc-4713-8844-12f74f7eec17 admin admin] PATH_INFO: `/v3/projects/2c811078e3b545f199d498ba9851e2c9/users/27761d45a52942c59c68cf8951f36240/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:24.128684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c4f55-fafc-4713-8844-12f74f7eec17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c811078e3b545f199d498ba9851e2c9, user_id=27761d45a52942c59c68cf8951f36240, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:24.146087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c4f55-fafc-4713-8844-12f74f7eec17 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:24.160106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5bb08-3067-49ff-aba5-44b8f759ed36 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:24.174435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c683fab-2c40-4cbd-9d98-c0c8671b85e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:24.175485 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c683fab-2c40-4cbd-9d98-c0c8671b85e1 service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:24.177538 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c683fab-2c40-4cbd-9d98-c0c8671b85e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:24.178071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c683fab-2c40-4cbd-9d98-c0c8671b85e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:24.188934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3c683fab-2c40-4cbd-9d98-c0c8671b85e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:24.223072 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1012/2006] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:23 2022] PUT /identity/v3/projects/2c811078e3b545f199d498ba9851e2c9/users/27761d45a52942c59c68cf8951f36240/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:24.231909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab29b7-8105-4098-b074-f4dbfa9b478f None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:24.232855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab29b7-8105-4098-b074-f4dbfa9b478f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:24.233596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab29b7-8105-4098-b074-f4dbfa9b478f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:24.272445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-7aab29b7-8105-4098-b074-f4dbfa9b478f None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:24.276834 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7aab29b7-8105-4098-b074-f4dbfa9b478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:24.439254 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c683fab-2c40-4cbd-9d98-c0c8671b85e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:24.449696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c683fab-2c40-4cbd-9d98-c0c8671b85e1 service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:24.481704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:24.497538 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 995/2007] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:24.529576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1013/2008] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:24.568583 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c683fab-2c40-4cbd-9d98-c0c8671b85e1 service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:24.571242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3c683fab-2c40-4cbd-9d98-c0c8671b85e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:24.921743 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c683fab-2c40-4cbd-9d98-c0c8671b85e1 service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:25.092770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e801d-6aca-44f4-a1f3-6c40dd025a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:25.093687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e801d-6aca-44f4-a1f3-6c40dd025a6e service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:25.094121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e801d-6aca-44f4-a1f3-6c40dd025a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:25.094551 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e801d-6aca-44f4-a1f3-6c40dd025a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:25.120282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e801d-6aca-44f4-a1f3-6c40dd025a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:25.123326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e801d-6aca-44f4-a1f3-6c40dd025a6e service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:25.154365 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 996/2009] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:25.174516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab29b7-8105-4098-b074-f4dbfa9b478f None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:25.176987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7aab29b7-8105-4098-b074-f4dbfa9b478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:25.200702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab29b7-8105-4098-b074-f4dbfa9b478f None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:25.208704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d36e70-51aa-4612-a35d-d4f5f99ed830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:25.209734 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d36e70-51aa-4612-a35d-d4f5f99ed830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:25.210236 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d36e70-51aa-4612-a35d-d4f5f99ed830 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:25.210693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d36e70-51aa-4612-a35d-d4f5f99ed830 admin admin] PATH_INFO: `/v3/projects/e6a51794bef94817b12c0af278f6078b` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:25.213244 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d36e70-51aa-4612-a35d-d4f5f99ed830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a51794bef94817b12c0af278f6078b)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:25.215821 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d36e70-51aa-4612-a35d-d4f5f99ed830 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:25.328691 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-43d36e70-51aa-4612-a35d-d4f5f99ed830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a51794bef94817b12c0af278f6078b', 'request_id': 'req-43d36e70-51aa-4612-a35d-d4f5f99ed830'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:25.340470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-43d36e70-51aa-4612-a35d-d4f5f99ed830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a51794bef94817b12c0af278f6078b', 'request_id': 'req-43d36e70-51aa-4612-a35d-d4f5f99ed830'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:25.352883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-43d36e70-51aa-4612-a35d-d4f5f99ed830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a51794bef94817b12c0af278f6078b', 'request_id': 'req-43d36e70-51aa-4612-a35d-d4f5f99ed830'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:25.375028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-43d36e70-51aa-4612-a35d-d4f5f99ed830 admin admin] The token cache is being invalidate because project e6a51794bef94817b12c0af278f6078b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:25.375713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-43d36e70-51aa-4612-a35d-d4f5f99ed830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:25.376760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-43d36e70-51aa-4612-a35d-d4f5f99ed830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:25.379942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1014/2010] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:25 2022] DELETE /identity/v3/projects/e6a51794bef94817b12c0af278f6078b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:09:25.387172 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9e4cc-d616-4e10-8821-00f4720a3b55 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:25.387958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9e4cc-d616-4e10-8821-00f4720a3b55 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:25.388866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9e4cc-d616-4e10-8821-00f4720a3b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:25.419761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-aed9e4cc-d616-4e10-8821-00f4720a3b55 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:25.422589 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-aed9e4cc-d616-4e10-8821-00f4720a3b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:25.432425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:25.566350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 997/2011] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:25.580746 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13200cea-235a-46a6-8ed3-f2c8296ef383 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:25.581547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13200cea-235a-46a6-8ed3-f2c8296ef383 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:25.582286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13200cea-235a-46a6-8ed3-f2c8296ef383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:25.630579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-13200cea-235a-46a6-8ed3-f2c8296ef383 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:25.634475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-13200cea-235a-46a6-8ed3-f2c8296ef383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:25.664552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1015/2012] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:25.669376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9e4cc-d616-4e10-8821-00f4720a3b55 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:25.697961 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9e4cc-d616-4e10-8821-00f4720a3b55 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:25.710079 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af30533-dad6-40c9-b469-32aba1e39a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:25.711870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af30533-dad6-40c9-b469-32aba1e39a8c admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:25.712690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af30533-dad6-40c9-b469-32aba1e39a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:25.713373 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af30533-dad6-40c9-b469-32aba1e39a8c admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:25.714949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af30533-dad6-40c9-b469-32aba1e39a8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:25.716052 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af30533-dad6-40c9-b469-32aba1e39a8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:25.719345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af30533-dad6-40c9-b469-32aba1e39a8c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:25.765629 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 998/2013] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:09:25.774115 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13200cea-235a-46a6-8ed3-f2c8296ef383 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:25.788481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13200cea-235a-46a6-8ed3-f2c8296ef383 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:25.794216 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e598a9-dc55-4929-9a5f-7ef3760dacd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:25.794895 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e598a9-dc55-4929-9a5f-7ef3760dacd2 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:25.795173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e598a9-dc55-4929-9a5f-7ef3760dacd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:25.795450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e598a9-dc55-4929-9a5f-7ef3760dacd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:25.796323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e598a9-dc55-4929-9a5f-7ef3760dacd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:25.798377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e598a9-dc55-4929-9a5f-7ef3760dacd2 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:25.919151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1016/2014] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:25 2022] POST /identity/v3/projects => generated 401 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:25.926542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af30533-dad6-40c9-b469-32aba1e39a8c admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:25.955901 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af30533-dad6-40c9-b469-32aba1e39a8c admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:26.083627 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139813dd-d2b9-4fa4-b705-fe90a6fe5e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:26.084344 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139813dd-d2b9-4fa4-b705-fe90a6fe5e60 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:26.084713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139813dd-d2b9-4fa4-b705-fe90a6fe5e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:26.084995 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139813dd-d2b9-4fa4-b705-fe90a6fe5e60 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:26.085827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139813dd-d2b9-4fa4-b705-fe90a6fe5e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:26.088433 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139813dd-d2b9-4fa4-b705-fe90a6fe5e60 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:26.125689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 999/2015] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:25 2022] POST /identity/v3/users => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:26.130693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e598a9-dc55-4929-9a5f-7ef3760dacd2 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:26.154812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e598a9-dc55-4929-9a5f-7ef3760dacd2 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:26.165967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b2ec0-04e4-4399-9bf2-41d486387d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:26.169329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b2ec0-04e4-4399-9bf2-41d486387d61 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:26.169942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b2ec0-04e4-4399-9bf2-41d486387d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:26.170524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b2ec0-04e4-4399-9bf2-41d486387d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:26.171810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b2ec0-04e4-4399-9bf2-41d486387d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:26.175564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b2ec0-04e4-4399-9bf2-41d486387d61 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:26.200419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1017/2016] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:09:26.205455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139813dd-d2b9-4fa4-b705-fe90a6fe5e60 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:26.244493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139813dd-d2b9-4fa4-b705-fe90a6fe5e60 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:26.264646 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac49b5c-a38b-4c5f-987b-4fbea01e7061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:26.269014 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49b5c-a38b-4c5f-987b-4fbea01e7061 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:26.269764 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49b5c-a38b-4c5f-987b-4fbea01e7061 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:26.270505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49b5c-a38b-4c5f-987b-4fbea01e7061 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:26.272119 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac49b5c-a38b-4c5f-987b-4fbea01e7061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:26.294037 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac49b5c-a38b-4c5f-987b-4fbea01e7061 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:26.344442 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1000/2017] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:09:26.351896 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b2ec0-04e4-4399-9bf2-41d486387d61 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:26.374883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b2ec0-04e4-4399-9bf2-41d486387d61 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:26.383816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026e62a-44c7-4372-b803-11f54828d3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:26.385527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026e62a-44c7-4372-b803-11f54828d3ac admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:26.386005 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026e62a-44c7-4372-b803-11f54828d3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:26.386485 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026e62a-44c7-4372-b803-11f54828d3ac admin admin] PATH_INFO: `/v3/projects/f319d726e3a84c5db49155fb9038de09/users/c7f1bb927cbc4a71b57de363c8bf475c/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:26.458335 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026e62a-44c7-4372-b803-11f54828d3ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f319d726e3a84c5db49155fb9038de09, user_id=c7f1bb927cbc4a71b57de363c8bf475c, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:26.464740 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026e62a-44c7-4372-b803-11f54828d3ac admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:26.499613 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1018/2018] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:26 2022] PUT /identity/v3/projects/f319d726e3a84c5db49155fb9038de09/users/c7f1bb927cbc4a71b57de363c8bf475c/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:26.533542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bffdb-f269-4c1c-94a6-d2d4d024baf6 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:26.534040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bffdb-f269-4c1c-94a6-d2d4d024baf6 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:26.534495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bffdb-f269-4c1c-94a6-d2d4d024baf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:26.616478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-c91bffdb-f269-4c1c-94a6-d2d4d024baf6 None None] MFA Rules not processed for user `c7f1bb927cbc4a71b57de363c8bf475c`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:26.622341 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c91bffdb-f269-4c1c-94a6-d2d4d024baf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:26.750825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1001/2019] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:26 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:26.751129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026e62a-44c7-4372-b803-11f54828d3ac admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:26.970963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026e62a-44c7-4372-b803-11f54828d3ac admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:27.010604 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c00bfa-e0b2-4f20-9af2-b0a840ebb21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:27.011391 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c00bfa-e0b2-4f20-9af2-b0a840ebb21f admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:27.020588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c00bfa-e0b2-4f20-9af2-b0a840ebb21f admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:27.020748 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c00bfa-e0b2-4f20-9af2-b0a840ebb21f admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:27.021404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c00bfa-e0b2-4f20-9af2-b0a840ebb21f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:27.023424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c00bfa-e0b2-4f20-9af2-b0a840ebb21f admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:27.086885 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:27.102395 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bffdb-f269-4c1c-94a6-d2d4d024baf6 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:27.106184 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1019/2020] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:26 2022] POST /identity/v3/projects => generated 401 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:09:27.122601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9087a5-c843-44e2-9de4-9e4bd2a1fd1f None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:27.122945 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9087a5-c843-44e2-9de4-9e4bd2a1fd1f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:27.125710 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:27.132272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9087a5-c843-44e2-9de4-9e4bd2a1fd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:27.150768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bffdb-f269-4c1c-94a6-d2d4d024baf6 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:27.271517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-0f9087a5-c843-44e2-9de4-9e4bd2a1fd1f None None] MFA Rules not processed for user `27761d45a52942c59c68cf8951f36240`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:27.273980 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0f9087a5-c843-44e2-9de4-9e4bd2a1fd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:27.344327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb156a-556b-415a-99bc-2ed02003fc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:27.345163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb156a-556b-415a-99bc-2ed02003fc63 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:27.345584 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb156a-556b-415a-99bc-2ed02003fc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:27.346121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb156a-556b-415a-99bc-2ed02003fc63 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:27.347152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb156a-556b-415a-99bc-2ed02003fc63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:27.350737 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb156a-556b-415a-99bc-2ed02003fc63 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:27.401926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1002/2021] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:27 2022] POST /identity/v3/users => generated 307 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:27.404747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb156a-556b-415a-99bc-2ed02003fc63 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:27.424162 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb156a-556b-415a-99bc-2ed02003fc63 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:27.435226 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15a69d-47e8-4db7-bea8-4a1ac83b8d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:27.436246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15a69d-47e8-4db7-bea8-4a1ac83b8d7d admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:27.436675 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15a69d-47e8-4db7-bea8-4a1ac83b8d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:27.438069 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15a69d-47e8-4db7-bea8-4a1ac83b8d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:27.439576 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15a69d-47e8-4db7-bea8-4a1ac83b8d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:27.443118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15a69d-47e8-4db7-bea8-4a1ac83b8d7d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:27.484715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1020/2022] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:27.490966 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1003/2023] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:09:27.491656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9087a5-c843-44e2-9de4-9e4bd2a1fd1f None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:27.495519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15a69d-47e8-4db7-bea8-4a1ac83b8d7d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:27.500628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0f9087a5-c843-44e2-9de4-9e4bd2a1fd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:27.536238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15a69d-47e8-4db7-bea8-4a1ac83b8d7d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:27.538156 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9087a5-c843-44e2-9de4-9e4bd2a1fd1f None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:27.553544 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351ad4c-9cb8-430e-8b15-2c0e79b00c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:27.555074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351ad4c-9cb8-430e-8b15-2c0e79b00c07 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:27.557767 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351ad4c-9cb8-430e-8b15-2c0e79b00c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:27.558480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351ad4c-9cb8-430e-8b15-2c0e79b00c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:27.559838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e8129-355c-4111-8428-2b7fdc8e81bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:27.561055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e8129-355c-4111-8428-2b7fdc8e81bc admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:27.561361 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e8129-355c-4111-8428-2b7fdc8e81bc admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:27.561704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351ad4c-9cb8-430e-8b15-2c0e79b00c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:27.561891 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e8129-355c-4111-8428-2b7fdc8e81bc admin admin] PATH_INFO: `/v3/projects/ca43dabed1f64e4e9a3b746e7d8fc7a2/users/cefe3ea47edc44c1b6f41ce496a8e591/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:27.569842 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351ad4c-9cb8-430e-8b15-2c0e79b00c07 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:27.609825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e8129-355c-4111-8428-2b7fdc8e81bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca43dabed1f64e4e9a3b746e7d8fc7a2, user_id=cefe3ea47edc44c1b6f41ce496a8e591, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:27.623492 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e8129-355c-4111-8428-2b7fdc8e81bc admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:27.650365 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1004/2024] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:27 2022] PUT /identity/v3/projects/ca43dabed1f64e4e9a3b746e7d8fc7a2/users/cefe3ea47edc44c1b6f41ce496a8e591/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:27.657555 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e8129-355c-4111-8428-2b7fdc8e81bc admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:27.662266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1021/2025] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:27 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:27.664636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351ad4c-9cb8-430e-8b15-2c0e79b00c07 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:27.866960 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e8129-355c-4111-8428-2b7fdc8e81bc admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:27.875879 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddf526-a11b-4a19-b160-c823b0d0b263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:27.877631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddf526-a11b-4a19-b160-c823b0d0b263 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:27.878261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddf526-a11b-4a19-b160-c823b0d0b263 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:27.878866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddf526-a11b-4a19-b160-c823b0d0b263 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:27.882250 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddf526-a11b-4a19-b160-c823b0d0b263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:27.885901 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddf526-a11b-4a19-b160-c823b0d0b263 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:27.901210 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351ad4c-9cb8-430e-8b15-2c0e79b00c07 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:27.914921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1005/2026] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:27.923483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674166d-f377-4be8-9334-de20a391d7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:27.924598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674166d-f377-4be8-9334-de20a391d7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:27.925060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674166d-f377-4be8-9334-de20a391d7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:27.925497 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674166d-f377-4be8-9334-de20a391d7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:27.926330 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674166d-f377-4be8-9334-de20a391d7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:27.930454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674166d-f377-4be8-9334-de20a391d7a3 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:27.937714 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddf526-a11b-4a19-b160-c823b0d0b263 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:27.959082 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddf526-a11b-4a19-b160-c823b0d0b263 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:27.968295 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397b4ed-0af1-4e96-8177-9bb14bae1ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:27.969537 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397b4ed-0af1-4e96-8177-9bb14bae1ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:27.970006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397b4ed-0af1-4e96-8177-9bb14bae1ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:27.970486 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397b4ed-0af1-4e96-8177-9bb14bae1ce2 admin admin] PATH_INFO: `/v3/projects/ca43dabed1f64e4e9a3b746e7d8fc7a2/users/cefe3ea47edc44c1b6f41ce496a8e591/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:27.974731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397b4ed-0af1-4e96-8177-9bb14bae1ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca43dabed1f64e4e9a3b746e7d8fc7a2, user_id=cefe3ea47edc44c1b6f41ce496a8e591, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:27.975373 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1022/2027] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:27 2022] POST /identity/v3/users => generated 293 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:27.976529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674166d-f377-4be8-9334-de20a391d7a3 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:27.980163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397b4ed-0af1-4e96-8177-9bb14bae1ce2 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:27.992296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674166d-f377-4be8-9334-de20a391d7a3 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:27.998200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3be5c-d0ab-494d-aaf5-ad44c8211871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:27.998837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3be5c-d0ab-494d-aaf5-ad44c8211871 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:27.999163 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3be5c-d0ab-494d-aaf5-ad44c8211871 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:27.999443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3be5c-d0ab-494d-aaf5-ad44c8211871 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:28.000105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3be5c-d0ab-494d-aaf5-ad44c8211871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:28.001988 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3be5c-d0ab-494d-aaf5-ad44c8211871 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:28.019273 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1023/2028] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:28.020414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3be5c-d0ab-494d-aaf5-ad44c8211871 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:28.028444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1006/2029] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:27 2022] PUT /identity/v3/projects/ca43dabed1f64e4e9a3b746e7d8fc7a2/users/cefe3ea47edc44c1b6f41ce496a8e591/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:09:28.035968 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3be5c-d0ab-494d-aaf5-ad44c8211871 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:28.046380 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9326f6-4ac3-4b34-bdb5-18ea75aa05b6 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:28.046832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9326f6-4ac3-4b34-bdb5-18ea75aa05b6 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:28.047190 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9326f6-4ac3-4b34-bdb5-18ea75aa05b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:28.144163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-5d9326f6-4ac3-4b34-bdb5-18ea75aa05b6 None None] MFA Rules not processed for user `cefe3ea47edc44c1b6f41ce496a8e591`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:28.148976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5d9326f6-4ac3-4b34-bdb5-18ea75aa05b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:28.158277 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:28.202978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fc78f-472c-4a87-899c-0ead09c7cc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:28.205787 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fc78f-472c-4a87-899c-0ead09c7cc31 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:28.206535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fc78f-472c-4a87-899c-0ead09c7cc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:28.206975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fc78f-472c-4a87-899c-0ead09c7cc31 admin admin] PATH_INFO: `/v3/projects/8bc318b2294c4c8f91c151e26a29bffa/users/1c4e394dba0d4736938a71ec589ae897/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:28.262006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fc78f-472c-4a87-899c-0ead09c7cc31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc318b2294c4c8f91c151e26a29bffa, user_id=1c4e394dba0d4736938a71ec589ae897, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:28.265218 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:28.278713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fc78f-472c-4a87-899c-0ead09c7cc31 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:28.318131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1024/2030] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:28 2022] PUT /identity/v3/projects/8bc318b2294c4c8f91c151e26a29bffa/users/1c4e394dba0d4736938a71ec589ae897/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:28.319760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c3961-703f-4518-a460-f74108db5c90 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:28.320213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c3961-703f-4518-a460-f74108db5c90 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:28.320690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c3961-703f-4518-a460-f74108db5c90 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:28.324029 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1025/2031] 10.222.0.30 () {54 vars in 921 bytes} [Wed Sep 7 13:09:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:09:28.325773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c3961-703f-4518-a460-f74108db5c90 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:28.365785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1007/2032] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:28 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:28.368532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b27a4-e549-4641-aabc-bce4e70aa843 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:28.369435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b27a4-e549-4641-aabc-bce4e70aa843 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:28.370129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b27a4-e549-4641-aabc-bce4e70aa843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:28.474285 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-3f6b27a4-e549-4641-aabc-bce4e70aa843 None None] MFA Rules not processed for user `fbe8fa8ab8094aa69933398280810692`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:28.477483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3f6b27a4-e549-4641-aabc-bce4e70aa843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:28.492959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c3961-703f-4518-a460-f74108db5c90 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:28.501375 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f6be0-4654-4310-bb70-4007c3250b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:28.502403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f6be0-4654-4310-bb70-4007c3250b5a admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:28.502861 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f6be0-4654-4310-bb70-4007c3250b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:28.503468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f6be0-4654-4310-bb70-4007c3250b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:28.504903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f6be0-4654-4310-bb70-4007c3250b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:28.506861 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f6be0-4654-4310-bb70-4007c3250b5a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:28.555058 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1026/2033] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:28.556625 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f6be0-4654-4310-bb70-4007c3250b5a admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:28.567300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9e1f6be0-4654-4310-bb70-4007c3250b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:28.624137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1008/2034] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Sep 7 13:09:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:28.625306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b27a4-e549-4641-aabc-bce4e70aa843 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:28.626974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3f6b27a4-e549-4641-aabc-bce4e70aa843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:28.647311 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b27a4-e549-4641-aabc-bce4e70aa843 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:28.664657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09cffb-c691-4f78-948c-0a3fd9d53847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:28.664657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09cffb-c691-4f78-948c-0a3fd9d53847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:28.664657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09cffb-c691-4f78-948c-0a3fd9d53847 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:28.664657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09cffb-c691-4f78-948c-0a3fd9d53847 admin admin] PATH_INFO: `/v3/users/ae6796e3c6504180a7f6609c3c444ad3` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:28.665067 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09cffb-c691-4f78-948c-0a3fd9d53847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae6796e3c6504180a7f6609c3c444ad3)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:28.665067 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09cffb-c691-4f78-948c-0a3fd9d53847 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:28.721233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f6be0-4654-4310-bb70-4007c3250b5a admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:28.741691 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6f307-889e-41f2-98fa-c79d85a82deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:28.742492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6f307-889e-41f2-98fa-c79d85a82deb service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:28.742935 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6f307-889e-41f2-98fa-c79d85a82deb service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:28.743118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6f307-889e-41f2-98fa-c79d85a82deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:28.810637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-5c09cffb-c691-4f78-948c-0a3fd9d53847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae6796e3c6504180a7f6609c3c444ad3'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:28.813064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-5c09cffb-c691-4f78-948c-0a3fd9d53847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae6796e3c6504180a7f6609c3c444ad3'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:28.830857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-5c09cffb-c691-4f78-948c-0a3fd9d53847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae6796e3c6504180a7f6609c3c444ad3'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:28.831663 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-5c09cffb-c691-4f78-948c-0a3fd9d53847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae6796e3c6504180a7f6609c3c444ad3'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:28.857975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-5c09cffb-c691-4f78-948c-0a3fd9d53847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae6796e3c6504180a7f6609c3c444ad3'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:28.880679 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6f307-889e-41f2-98fa-c79d85a82deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:28.883686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6f307-889e-41f2-98fa-c79d85a82deb service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:28.897119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1027/2035] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:28 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:28.898118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6f307-889e-41f2-98fa-c79d85a82deb service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:28.911252 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6f307-889e-41f2-98fa-c79d85a82deb service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:28.916763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecc795-3374-4db0-bcc7-08bd2745c491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:28.917459 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecc795-3374-4db0-bcc7-08bd2745c491 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:28.917871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecc795-3374-4db0-bcc7-08bd2745c491 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:28.918217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecc795-3374-4db0-bcc7-08bd2745c491 admin admin] PATH_INFO: `/v3/projects/8bc318b2294c4c8f91c151e26a29bffa/users/1c4e394dba0d4736938a71ec589ae897/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:28.920779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecc795-3374-4db0-bcc7-08bd2745c491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc318b2294c4c8f91c151e26a29bffa, user_id=1c4e394dba0d4736938a71ec589ae897, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:28.928311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecc795-3374-4db0-bcc7-08bd2745c491 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:28.930837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1009/2036] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:28 2022] DELETE /identity/v3/users/ae6796e3c6504180a7f6609c3c444ad3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:28.931765 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09cffb-c691-4f78-948c-0a3fd9d53847 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:28.933496 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5c09cffb-c691-4f78-948c-0a3fd9d53847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:28.958733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1028/2037] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:28 2022] PUT /identity/v3/projects/8bc318b2294c4c8f91c151e26a29bffa/users/1c4e394dba0d4736938a71ec589ae897/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:28.960094 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79aa3-4b0d-4182-bbc2-f38e1f2a6fe1 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:28.960459 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79aa3-4b0d-4182-bbc2-f38e1f2a6fe1 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:28.960749 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79aa3-4b0d-4182-bbc2-f38e1f2a6fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:28.984121 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:29.021770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:29.022087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-44a79aa3-4b0d-4182-bbc2-f38e1f2a6fe1 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:29.025279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-44a79aa3-4b0d-4182-bbc2-f38e1f2a6fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:29.174234 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09cffb-c691-4f78-948c-0a3fd9d53847 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:29.248640 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1029/2038] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:29.252901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a79aa3-4b0d-4182-bbc2-f38e1f2a6fe1 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:29.256641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-44a79aa3-4b0d-4182-bbc2-f38e1f2a6fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:29.430805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e62fb-49e5-43a4-98e8-28d0f212f8d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:29.433488 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e62fb-49e5-43a4-98e8-28d0f212f8d6 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:29.433967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e62fb-49e5-43a4-98e8-28d0f212f8d6 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:29.434248 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e62fb-49e5-43a4-98e8-28d0f212f8d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:29.437483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-bc9e62fb-49e5-43a4-98e8-28d0f212f8d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:29.486149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a79aa3-4b0d-4182-bbc2-f38e1f2a6fe1 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:29.495407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6e611-21ba-4cee-9a47-307ad97a7ee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:29.496711 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6e611-21ba-4cee-9a47-307ad97a7ee0 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:29.497359 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6e611-21ba-4cee-9a47-307ad97a7ee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:29.497823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6e611-21ba-4cee-9a47-307ad97a7ee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:29.501477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-aeb6e611-21ba-4cee-9a47-307ad97a7ee0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:29.504126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e62fb-49e5-43a4-98e8-28d0f212f8d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:29.507435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e62fb-49e5-43a4-98e8-28d0f212f8d6 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:29.560917 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1010/2039] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:29.563019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e62fb-49e5-43a4-98e8-28d0f212f8d6 service nova] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:29.575635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-bc9e62fb-49e5-43a4-98e8-28d0f212f8d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:29.721949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e62fb-49e5-43a4-98e8-28d0f212f8d6 service nova] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:29.731225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6491d-ea67-4e1b-b6a7-f17374769228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:29.732893 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6491d-ea67-4e1b-b6a7-f17374769228 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:29.733753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6491d-ea67-4e1b-b6a7-f17374769228 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:29.734467 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6491d-ea67-4e1b-b6a7-f17374769228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:29.744209 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6e611-21ba-4cee-9a47-307ad97a7ee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:29.747580 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6e611-21ba-4cee-9a47-307ad97a7ee0 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:29.756456 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6491d-ea67-4e1b-b6a7-f17374769228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:29.760825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6491d-ea67-4e1b-b6a7-f17374769228 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:29.770462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1030/2040] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:29 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:29.771803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6e611-21ba-4cee-9a47-307ad97a7ee0 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:29.773541 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-aeb6e611-21ba-4cee-9a47-307ad97a7ee0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:29.788508 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1011/2041] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:29.793630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6e611-21ba-4cee-9a47-307ad97a7ee0 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:29.801847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a99277-e6f2-4b78-8ca8-2d210f6d3fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:29.802965 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a99277-e6f2-4b78-8ca8-2d210f6d3fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:29.803467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a99277-e6f2-4b78-8ca8-2d210f6d3fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:29.803946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a99277-e6f2-4b78-8ca8-2d210f6d3fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:29.807651 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-74a99277-e6f2-4b78-8ca8-2d210f6d3fe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:29.954709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:30.008882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a99277-e6f2-4b78-8ca8-2d210f6d3fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:30.012561 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a99277-e6f2-4b78-8ca8-2d210f6d3fe5 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:30.070685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1031/2042] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:30.811360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6491d-ea67-4e1b-b6a7-f17374769228 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:30.815042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fdc6491d-ea67-4e1b-b6a7-f17374769228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:30.857810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6491d-ea67-4e1b-b6a7-f17374769228 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:30.877723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf1928-725c-4fbd-a6a7-11942ea49f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:30.879082 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf1928-725c-4fbd-a6a7-11942ea49f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:30.879574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf1928-725c-4fbd-a6a7-11942ea49f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:30.883731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf1928-725c-4fbd-a6a7-11942ea49f9f admin admin] PATH_INFO: `/v3/users/446977fbaef348948ddf7d51f9caa631` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:30.888086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf1928-725c-4fbd-a6a7-11942ea49f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=446977fbaef348948ddf7d51f9caa631)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:30.898622 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf1928-725c-4fbd-a6a7-11942ea49f9f admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:31.097407 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-5fcf1928-725c-4fbd-a6a7-11942ea49f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '446977fbaef348948ddf7d51f9caa631'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:31.099569 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-5fcf1928-725c-4fbd-a6a7-11942ea49f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '446977fbaef348948ddf7d51f9caa631'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:31.118444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:31.128585 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-5fcf1928-725c-4fbd-a6a7-11942ea49f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '446977fbaef348948ddf7d51f9caa631'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:31.132517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-5fcf1928-725c-4fbd-a6a7-11942ea49f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '446977fbaef348948ddf7d51f9caa631'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:31.165619 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-5fcf1928-725c-4fbd-a6a7-11942ea49f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '446977fbaef348948ddf7d51f9caa631'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:31.250301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1012/2043] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:30 2022] DELETE /identity/v3/users/446977fbaef348948ddf7d51f9caa631 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:31.256021 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf856a-98b8-416e-9998-10c14ea78846 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:31.256908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf856a-98b8-416e-9998-10c14ea78846 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:31.258339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf856a-98b8-416e-9998-10c14ea78846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:31.321292 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-33cf856a-98b8-416e-9998-10c14ea78846 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:31.324161 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-33cf856a-98b8-416e-9998-10c14ea78846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:31.479187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1032/2044] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:31.503126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf1928-725c-4fbd-a6a7-11942ea49f9f admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:31.509049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5fcf1928-725c-4fbd-a6a7-11942ea49f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:31.635539 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f23741-ff22-44dd-beb8-3ddb0dfd9e7c None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:31.637179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f23741-ff22-44dd-beb8-3ddb0dfd9e7c None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:31.638853 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f23741-ff22-44dd-beb8-3ddb0dfd9e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:31.692363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-75f23741-ff22-44dd-beb8-3ddb0dfd9e7c None None] MFA Rules not processed for user `1c4e394dba0d4736938a71ec589ae897`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:31.694176 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-75f23741-ff22-44dd-beb8-3ddb0dfd9e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:31.695455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf1928-725c-4fbd-a6a7-11942ea49f9f admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:31.706501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbff356-d7c7-48c3-ba63-f0f563bf58c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:31.707248 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbff356-d7c7-48c3-ba63-f0f563bf58c2 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:31.707791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbff356-d7c7-48c3-ba63-f0f563bf58c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:31.708233 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbff356-d7c7-48c3-ba63-f0f563bf58c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:31.728721 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbff356-d7c7-48c3-ba63-f0f563bf58c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:31.730828 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbff356-d7c7-48c3-ba63-f0f563bf58c2 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:31.749479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1013/2045] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:31.750640 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbff356-d7c7-48c3-ba63-f0f563bf58c2 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:31.752325 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-8dbff356-d7c7-48c3-ba63-f0f563bf58c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:31.789404 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbff356-d7c7-48c3-ba63-f0f563bf58c2 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:31.806052 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c1d0d-34dd-4095-940e-31517a21747b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:31.809241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c1d0d-34dd-4095-940e-31517a21747b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:31.809831 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c1d0d-34dd-4095-940e-31517a21747b admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:31.810320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c1d0d-34dd-4095-940e-31517a21747b admin admin] PATH_INFO: `/v3/projects/5b50a13c3ff84e169c64317efcb45b11` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:31.812884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c1d0d-34dd-4095-940e-31517a21747b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b50a13c3ff84e169c64317efcb45b11)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:31.818382 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c1d0d-34dd-4095-940e-31517a21747b admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:31.903917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1033/2046] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:31.922808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973ae85-2d31-4beb-bbe1-9f34cf294336 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:31.923100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973ae85-2d31-4beb-bbe1-9f34cf294336 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:31.941025 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973ae85-2d31-4beb-bbe1-9f34cf294336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:32.000275 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-9973ae85-2d31-4beb-bbe1-9f34cf294336 None None] MFA Rules not processed for user `27761d45a52942c59c68cf8951f36240`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:32.000275 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9973ae85-2d31-4beb-bbe1-9f34cf294336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:32.056402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-df6c1d0d-34dd-4095-940e-31517a21747b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b50a13c3ff84e169c64317efcb45b11', 'request_id': 'req-df6c1d0d-34dd-4095-940e-31517a21747b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:32.085724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-df6c1d0d-34dd-4095-940e-31517a21747b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b50a13c3ff84e169c64317efcb45b11', 'request_id': 'req-df6c1d0d-34dd-4095-940e-31517a21747b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:32.121376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-df6c1d0d-34dd-4095-940e-31517a21747b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b50a13c3ff84e169c64317efcb45b11', 'request_id': 'req-df6c1d0d-34dd-4095-940e-31517a21747b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:32.146232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-df6c1d0d-34dd-4095-940e-31517a21747b admin admin] The token cache is being invalidate because project 5b50a13c3ff84e169c64317efcb45b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:32.146443 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-df6c1d0d-34dd-4095-940e-31517a21747b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:32.147693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-df6c1d0d-34dd-4095-940e-31517a21747b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:32.150703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1014/2047] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:31 2022] DELETE /identity/v3/projects/5b50a13c3ff84e169c64317efcb45b11 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:32.156768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c1d0d-34dd-4095-940e-31517a21747b admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:32.158443 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-df6c1d0d-34dd-4095-940e-31517a21747b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:32.165310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1034/2048] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:09:32.186397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973ae85-2d31-4beb-bbe1-9f34cf294336 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:32.189302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9973ae85-2d31-4beb-bbe1-9f34cf294336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:32.342530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:32.373345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:32.401548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c1d0d-34dd-4095-940e-31517a21747b admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:32.428246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b3c68-7f23-4938-a4be-d3b2fe91610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:32.448677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b3c68-7f23-4938-a4be-d3b2fe91610e admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:32.451472 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b3c68-7f23-4938-a4be-d3b2fe91610e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:32.451938 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b3c68-7f23-4938-a4be-d3b2fe91610e admin admin] PATH_INFO: `/v3/users/dfa37e10bfe240cc8253ee744321e44d` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:32.454863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b3c68-7f23-4938-a4be-d3b2fe91610e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa37e10bfe240cc8253ee744321e44d)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:32.460409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b3c68-7f23-4938-a4be-d3b2fe91610e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:32.587189 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973ae85-2d31-4beb-bbe1-9f34cf294336 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:32.630260 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10bc5e-deb0-4ac1-a9bd-30a1f9d818ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:32.635627 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10bc5e-deb0-4ac1-a9bd-30a1f9d818ec service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:32.636092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10bc5e-deb0-4ac1-a9bd-30a1f9d818ec service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:32.636610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10bc5e-deb0-4ac1-a9bd-30a1f9d818ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:32.646130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1d10bc5e-deb0-4ac1-a9bd-30a1f9d818ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:32.671005 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-2e9b3c68-7f23-4938-a4be-d3b2fe91610e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa37e10bfe240cc8253ee744321e44d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:32.683015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-2e9b3c68-7f23-4938-a4be-d3b2fe91610e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa37e10bfe240cc8253ee744321e44d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:32.705138 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10bc5e-deb0-4ac1-a9bd-30a1f9d818ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:32.710203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10bc5e-deb0-4ac1-a9bd-30a1f9d818ec service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:32.718860 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-2e9b3c68-7f23-4938-a4be-d3b2fe91610e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa37e10bfe240cc8253ee744321e44d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:32.720844 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-2e9b3c68-7f23-4938-a4be-d3b2fe91610e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa37e10bfe240cc8253ee744321e44d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:32.754442 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1035/2049] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:32.755713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10bc5e-deb0-4ac1-a9bd-30a1f9d818ec service nova] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:32.759137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-2e9b3c68-7f23-4938-a4be-d3b2fe91610e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa37e10bfe240cc8253ee744321e44d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:32.763712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1d10bc5e-deb0-4ac1-a9bd-30a1f9d818ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:32.813751 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10bc5e-deb0-4ac1-a9bd-30a1f9d818ec service nova] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:32.831896 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a732d6-589f-47eb-bdef-9dfd41248daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:32.833288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a732d6-589f-47eb-bdef-9dfd41248daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:32.833879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a732d6-589f-47eb-bdef-9dfd41248daf admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:32.835049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a732d6-589f-47eb-bdef-9dfd41248daf admin admin] PATH_INFO: `/v3/projects/5ab27611748448139d2d08a8c622986a` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:32.872345 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a732d6-589f-47eb-bdef-9dfd41248daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab27611748448139d2d08a8c622986a)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:32.879491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a732d6-589f-47eb-bdef-9dfd41248daf admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:32.897225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1015/2050] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:32 2022] DELETE /identity/v3/users/dfa37e10bfe240cc8253ee744321e44d => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:33.063909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-97a732d6-589f-47eb-bdef-9dfd41248daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab27611748448139d2d08a8c622986a', 'request_id': 'req-97a732d6-589f-47eb-bdef-9dfd41248daf'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:33.076642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-97a732d6-589f-47eb-bdef-9dfd41248daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab27611748448139d2d08a8c622986a', 'request_id': 'req-97a732d6-589f-47eb-bdef-9dfd41248daf'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:33.084013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-97a732d6-589f-47eb-bdef-9dfd41248daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab27611748448139d2d08a8c622986a', 'request_id': 'req-97a732d6-589f-47eb-bdef-9dfd41248daf'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:33.109652 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-97a732d6-589f-47eb-bdef-9dfd41248daf admin admin] The token cache is being invalidate because project 5ab27611748448139d2d08a8c622986a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:33.110759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-97a732d6-589f-47eb-bdef-9dfd41248daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:33.111495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-97a732d6-589f-47eb-bdef-9dfd41248daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:33.118098 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1036/2051] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:32 2022] DELETE /identity/v3/projects/5ab27611748448139d2d08a8c622986a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:33.120079 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b3c68-7f23-4938-a4be-d3b2fe91610e admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:33.122828 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2e9b3c68-7f23-4938-a4be-d3b2fe91610e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:33.320502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b3c68-7f23-4938-a4be-d3b2fe91610e admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:33.463238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295c17c-fa96-4baf-81ca-ed9b19f588c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:33.464609 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295c17c-fa96-4baf-81ca-ed9b19f588c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:33.465403 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295c17c-fa96-4baf-81ca-ed9b19f588c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:33.466225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295c17c-fa96-4baf-81ca-ed9b19f588c0 admin admin] PATH_INFO: `/v3/users/b2109f60901b4243bfc7feabcd1c43d1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:33.468722 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295c17c-fa96-4baf-81ca-ed9b19f588c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2109f60901b4243bfc7feabcd1c43d1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:33.474856 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295c17c-fa96-4baf-81ca-ed9b19f588c0 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:33.510631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:33.557629 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0295c17c-fa96-4baf-81ca-ed9b19f588c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2109f60901b4243bfc7feabcd1c43d1'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:33.558374 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0295c17c-fa96-4baf-81ca-ed9b19f588c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2109f60901b4243bfc7feabcd1c43d1'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:33.572272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a732d6-589f-47eb-bdef-9dfd41248daf admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:33.574059 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-97a732d6-589f-47eb-bdef-9dfd41248daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:33.577481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0295c17c-fa96-4baf-81ca-ed9b19f588c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2109f60901b4243bfc7feabcd1c43d1'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:33.594662 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a732d6-589f-47eb-bdef-9dfd41248daf admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:33.602461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0295c17c-fa96-4baf-81ca-ed9b19f588c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2109f60901b4243bfc7feabcd1c43d1'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:33.603849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747ddb6-f8f9-4fb7-959b-3030b53916ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:33.605351 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747ddb6-f8f9-4fb7-959b-3030b53916ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:33.605857 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747ddb6-f8f9-4fb7-959b-3030b53916ef admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:33.608814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747ddb6-f8f9-4fb7-959b-3030b53916ef admin admin] PATH_INFO: `/v3/projects/d1cf7eac5b234218b0ec8e160aa35bce` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:33.611337 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747ddb6-f8f9-4fb7-959b-3030b53916ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1cf7eac5b234218b0ec8e160aa35bce)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:33.613764 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747ddb6-f8f9-4fb7-959b-3030b53916ef admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:33.620116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0295c17c-fa96-4baf-81ca-ed9b19f588c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2109f60901b4243bfc7feabcd1c43d1'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:33.650960 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1016/2052] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:33 2022] DELETE /identity/v3/users/b2109f60901b4243bfc7feabcd1c43d1 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:33.685865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b747ddb6-f8f9-4fb7-959b-3030b53916ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1cf7eac5b234218b0ec8e160aa35bce', 'request_id': 'req-b747ddb6-f8f9-4fb7-959b-3030b53916ef'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:33.693127 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b747ddb6-f8f9-4fb7-959b-3030b53916ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1cf7eac5b234218b0ec8e160aa35bce', 'request_id': 'req-b747ddb6-f8f9-4fb7-959b-3030b53916ef'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:33.701888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b747ddb6-f8f9-4fb7-959b-3030b53916ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1cf7eac5b234218b0ec8e160aa35bce', 'request_id': 'req-b747ddb6-f8f9-4fb7-959b-3030b53916ef'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:33.718918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b747ddb6-f8f9-4fb7-959b-3030b53916ef admin admin] The token cache is being invalidate because project d1cf7eac5b234218b0ec8e160aa35bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:33.719488 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b747ddb6-f8f9-4fb7-959b-3030b53916ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:33.720455 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b747ddb6-f8f9-4fb7-959b-3030b53916ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:33.722535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1037/2053] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:33 2022] DELETE /identity/v3/projects/d1cf7eac5b234218b0ec8e160aa35bce => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:09:33.727697 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86950d42-812f-4242-84f6-12fa37fcb630 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:33.728098 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86950d42-812f-4242-84f6-12fa37fcb630 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:33.728437 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86950d42-812f-4242-84f6-12fa37fcb630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:33.752165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-86950d42-812f-4242-84f6-12fa37fcb630 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:33.753584 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-86950d42-812f-4242-84f6-12fa37fcb630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:33.836357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1017/2054] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:33.845145 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bd71f-c5dd-4692-8afd-3c756eea5185 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:33.845432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bd71f-c5dd-4692-8afd-3c756eea5185 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:33.845735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bd71f-c5dd-4692-8afd-3c756eea5185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:33.896107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-8b2bd71f-c5dd-4692-8afd-3c756eea5185 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:33.897456 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8b2bd71f-c5dd-4692-8afd-3c756eea5185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:33.914786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1038/2055] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:09:33.915065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86950d42-812f-4242-84f6-12fa37fcb630 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:33.938797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86950d42-812f-4242-84f6-12fa37fcb630 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:33.951468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c52ac-6b5c-47e4-aa1c-c2394ecadb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:33.952241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c52ac-6b5c-47e4-aa1c-c2394ecadb4f admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:33.952886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c52ac-6b5c-47e4-aa1c-c2394ecadb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:33.954487 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c52ac-6b5c-47e4-aa1c-c2394ecadb4f admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:33.955309 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c52ac-6b5c-47e4-aa1c-c2394ecadb4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:33.955695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c52ac-6b5c-47e4-aa1c-c2394ecadb4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:33.958329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c52ac-6b5c-47e4-aa1c-c2394ecadb4f admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:33.988577 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1018/2056] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:09:33.994700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bd71f-c5dd-4692-8afd-3c756eea5185 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:34.013909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bd71f-c5dd-4692-8afd-3c756eea5185 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:34.030204 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f887885-8fb3-4f2c-9565-83fcbd23336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:34.031259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f887885-8fb3-4f2c-9565-83fcbd23336b admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:34.031259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f887885-8fb3-4f2c-9565-83fcbd23336b admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:34.031533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f887885-8fb3-4f2c-9565-83fcbd23336b admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:34.032207 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f887885-8fb3-4f2c-9565-83fcbd23336b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:34.037328 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f887885-8fb3-4f2c-9565-83fcbd23336b admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:34.050004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:34.078631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c52ac-6b5c-47e4-aa1c-c2394ecadb4f admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:34.081844 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ab4c52ac-6b5c-47e4-aa1c-c2394ecadb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:34.114588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1039/2057] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:33 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:34.129750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f887885-8fb3-4f2c-9565-83fcbd23336b admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:34.132628 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c52ac-6b5c-47e4-aa1c-c2394ecadb4f admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:34.410038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f887885-8fb3-4f2c-9565-83fcbd23336b admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:34.463615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c40a8e-fcad-4600-a13c-d29b3b09f941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:34.469931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91de3f5-2e07-46bf-bd0f-f061f209b33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:34.471307 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c40a8e-fcad-4600-a13c-d29b3b09f941 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:34.473835 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91de3f5-2e07-46bf-bd0f-f061f209b33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:34.474490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91de3f5-2e07-46bf-bd0f-f061f209b33b admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:34.474921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91de3f5-2e07-46bf-bd0f-f061f209b33b admin admin] PATH_INFO: `/v3/projects/20b3a1d485e641f3bfc072be5c01f1c0` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:34.479555 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c40a8e-fcad-4600-a13c-d29b3b09f941 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:34.480312 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c40a8e-fcad-4600-a13c-d29b3b09f941 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:34.480984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91de3f5-2e07-46bf-bd0f-f061f209b33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b3a1d485e641f3bfc072be5c01f1c0)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:34.482456 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c40a8e-fcad-4600-a13c-d29b3b09f941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:34.492767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91de3f5-2e07-46bf-bd0f-f061f209b33b admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:34.503770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c40a8e-fcad-4600-a13c-d29b3b09f941 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:34.591532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1040/2058] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:34 2022] POST /identity/v3/users => generated 287 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:34.593904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c40a8e-fcad-4600-a13c-d29b3b09f941 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:34.618078 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:34.642400 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c40a8e-fcad-4600-a13c-d29b3b09f941 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:34.658119 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a91de3f5-2e07-46bf-bd0f-f061f209b33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b3a1d485e641f3bfc072be5c01f1c0', 'request_id': 'req-a91de3f5-2e07-46bf-bd0f-f061f209b33b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:34.670686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a91de3f5-2e07-46bf-bd0f-f061f209b33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b3a1d485e641f3bfc072be5c01f1c0', 'request_id': 'req-a91de3f5-2e07-46bf-bd0f-f061f209b33b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:34.690038 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a91de3f5-2e07-46bf-bd0f-f061f209b33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b3a1d485e641f3bfc072be5c01f1c0', 'request_id': 'req-a91de3f5-2e07-46bf-bd0f-f061f209b33b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:34.738151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a91de3f5-2e07-46bf-bd0f-f061f209b33b admin admin] The token cache is being invalidate because project 20b3a1d485e641f3bfc072be5c01f1c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:34.738503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a91de3f5-2e07-46bf-bd0f-f061f209b33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:34.740305 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a91de3f5-2e07-46bf-bd0f-f061f209b33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:34.760350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1019/2059] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:34 2022] DELETE /identity/v3/projects/20b3a1d485e641f3bfc072be5c01f1c0 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:34.761017 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91de3f5-2e07-46bf-bd0f-f061f209b33b admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:34.764237 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a91de3f5-2e07-46bf-bd0f-f061f209b33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:34.831876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39faa25-c600-41dc-b618-fa20171ac107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:34.833014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39faa25-c600-41dc-b618-fa20171ac107 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:34.833433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39faa25-c600-41dc-b618-fa20171ac107 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:34.834794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39faa25-c600-41dc-b618-fa20171ac107 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:34.836009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39faa25-c600-41dc-b618-fa20171ac107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:34.838687 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39faa25-c600-41dc-b618-fa20171ac107 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:34.857602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1041/2060] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:34.858845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39faa25-c600-41dc-b618-fa20171ac107 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:34.860887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d39faa25-c600-41dc-b618-fa20171ac107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:34.905020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39faa25-c600-41dc-b618-fa20171ac107 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:34.921748 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba662b-14cb-4b2b-9f8d-94d02dc00319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:34.923751 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba662b-14cb-4b2b-9f8d-94d02dc00319 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:34.925641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba662b-14cb-4b2b-9f8d-94d02dc00319 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:34.927185 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba662b-14cb-4b2b-9f8d-94d02dc00319 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:34.928726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba662b-14cb-4b2b-9f8d-94d02dc00319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:34.935268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba662b-14cb-4b2b-9f8d-94d02dc00319 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:34.966472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1042/2061] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:34.969480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba662b-14cb-4b2b-9f8d-94d02dc00319 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:34.972482 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91de3f5-2e07-46bf-bd0f-f061f209b33b admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:34.986037 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1dcb4-2605-40ec-94ef-0ee5dc81a6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:34.986726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1dcb4-2605-40ec-94ef-0ee5dc81a6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:34.987491 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1dcb4-2605-40ec-94ef-0ee5dc81a6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:34.987780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1dcb4-2605-40ec-94ef-0ee5dc81a6e9 admin admin] PATH_INFO: `/v3/users/9c24ab86f34d43a783ca7fa2eb470657` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:34.990173 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1dcb4-2605-40ec-94ef-0ee5dc81a6e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c24ab86f34d43a783ca7fa2eb470657)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:34.992414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1dcb4-2605-40ec-94ef-0ee5dc81a6e9 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:35.018904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba662b-14cb-4b2b-9f8d-94d02dc00319 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:35.025351 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a500d-5417-4a76-bf8b-7d00ac412b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:35.026602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a500d-5417-4a76-bf8b-7d00ac412b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:35.027266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a500d-5417-4a76-bf8b-7d00ac412b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:35.027851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a500d-5417-4a76-bf8b-7d00ac412b3c admin admin] PATH_INFO: `/v3/projects/4aeb564898ff4b55af8c7a4dac82ce7f/users/4ecb461a2d4743d3a1a3c989fb4e7ab0/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:35.047423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a500d-5417-4a76-bf8b-7d00ac412b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aeb564898ff4b55af8c7a4dac82ce7f, user_id=4ecb461a2d4743d3a1a3c989fb4e7ab0, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:35.051653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a500d-5417-4a76-bf8b-7d00ac412b3c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:35.073083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1043/2062] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:34 2022] PUT /identity/v3/projects/4aeb564898ff4b55af8c7a4dac82ce7f/users/4ecb461a2d4743d3a1a3c989fb4e7ab0/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:09:35.089766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d69cd6-ebd1-48a9-b752-873a2ddcacb5 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:35.089986 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d69cd6-ebd1-48a9-b752-873a2ddcacb5 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:35.090358 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d69cd6-ebd1-48a9-b752-873a2ddcacb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:35.113438 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-81e1dcb4-2605-40ec-94ef-0ee5dc81a6e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c24ab86f34d43a783ca7fa2eb470657'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:35.114574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-81e1dcb4-2605-40ec-94ef-0ee5dc81a6e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c24ab86f34d43a783ca7fa2eb470657'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:35.124744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-81e1dcb4-2605-40ec-94ef-0ee5dc81a6e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c24ab86f34d43a783ca7fa2eb470657'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:35.125734 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-81e1dcb4-2605-40ec-94ef-0ee5dc81a6e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c24ab86f34d43a783ca7fa2eb470657'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:35.126992 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-38d69cd6-ebd1-48a9-b752-873a2ddcacb5 None None] MFA Rules not processed for user `4ecb461a2d4743d3a1a3c989fb4e7ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:35.128386 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-38d69cd6-ebd1-48a9-b752-873a2ddcacb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:35.150804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-81e1dcb4-2605-40ec-94ef-0ee5dc81a6e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c24ab86f34d43a783ca7fa2eb470657'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:35.159041 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:35.219678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1044/2063] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:35.219911 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1020/2064] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:34 2022] DELETE /identity/v3/users/9c24ab86f34d43a783ca7fa2eb470657 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:09:35.221530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d69cd6-ebd1-48a9-b752-873a2ddcacb5 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:35.223213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-38d69cd6-ebd1-48a9-b752-873a2ddcacb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:35.370733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d69cd6-ebd1-48a9-b752-873a2ddcacb5 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:35.505115 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01920a25-8e87-475c-8ded-34e899621acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:35.506145 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01920a25-8e87-475c-8ded-34e899621acd admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:35.507322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01920a25-8e87-475c-8ded-34e899621acd admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:35.507508 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01920a25-8e87-475c-8ded-34e899621acd admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:35.510107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01920a25-8e87-475c-8ded-34e899621acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:35.512635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01920a25-8e87-475c-8ded-34e899621acd admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:35.561224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1045/2065] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:35 2022] POST /identity/v3/projects => generated 377 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:09:35.562282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1dcb4-2605-40ec-94ef-0ee5dc81a6e9 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:35.583969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1dcb4-2605-40ec-94ef-0ee5dc81a6e9 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:35.681744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:35.789236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d24ce-f271-49e8-8686-edbd75c7042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:35.790892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d24ce-f271-49e8-8686-edbd75c7042a admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:35.791382 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d24ce-f271-49e8-8686-edbd75c7042a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:35.797320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d24ce-f271-49e8-8686-edbd75c7042a admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:35.798785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d24ce-f271-49e8-8686-edbd75c7042a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:35.803534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d24ce-f271-49e8-8686-edbd75c7042a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:35.945544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1021/2066] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:35 2022] POST /identity/v3/users => generated 295 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:09:35.949207 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01920a25-8e87-475c-8ded-34e899621acd admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:36.025968 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01920a25-8e87-475c-8ded-34e899621acd admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:36.054361 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d24ce-f271-49e8-8686-edbd75c7042a admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:36.059200 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-768d24ce-f271-49e8-8686-edbd75c7042a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:36.085499 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2abf7-a9c9-4123-abb4-7129edac4130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:36.086544 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2abf7-a9c9-4123-abb4-7129edac4130 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:36.087011 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2abf7-a9c9-4123-abb4-7129edac4130 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:36.098313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2abf7-a9c9-4123-abb4-7129edac4130 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:36.099581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2abf7-a9c9-4123-abb4-7129edac4130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:36.111654 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2abf7-a9c9-4123-abb4-7129edac4130 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:36.137427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d24ce-f271-49e8-8686-edbd75c7042a admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:36.178702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1046/2067] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:36.187264 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2abf7-a9c9-4123-abb4-7129edac4130 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:36.189534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39a4b0-15ac-432c-ba01-965ee110c53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:36.190546 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39a4b0-15ac-432c-ba01-965ee110c53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:36.201069 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39a4b0-15ac-432c-ba01-965ee110c53b admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:36.202016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39a4b0-15ac-432c-ba01-965ee110c53b admin admin] PATH_INFO: `/v3/projects/45d8df78c4404912a028b5a30cf81867` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:36.205002 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39a4b0-15ac-432c-ba01-965ee110c53b admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d8df78c4404912a028b5a30cf81867)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:36.221793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2abf7-a9c9-4123-abb4-7129edac4130 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:36.227895 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39a4b0-15ac-432c-ba01-965ee110c53b admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:36.249643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdb7c9-dc81-4938-99bd-40b4e4cef535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:36.250734 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdb7c9-dc81-4938-99bd-40b4e4cef535 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:36.251191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdb7c9-dc81-4938-99bd-40b4e4cef535 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:36.251638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdb7c9-dc81-4938-99bd-40b4e4cef535 admin admin] PATH_INFO: `/v3/projects/0778c26163664ba28b4bbaa974ad018e/users/cf7af78331d346908992013b93e49a86/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:36.300495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdb7c9-dc81-4938-99bd-40b4e4cef535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0778c26163664ba28b4bbaa974ad018e, user_id=cf7af78331d346908992013b93e49a86, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:36.307571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdb7c9-dc81-4938-99bd-40b4e4cef535 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:36.337913 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1047/2068] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:36 2022] PUT /identity/v3/projects/0778c26163664ba28b4bbaa974ad018e/users/cf7af78331d346908992013b93e49a86/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:36.337913 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdb7c9-dc81-4938-99bd-40b4e4cef535 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:36.337913 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-39cdb7c9-dc81-4938-99bd-40b4e4cef535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:36.360728 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3c39a4b0-15ac-432c-ba01-965ee110c53b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d8df78c4404912a028b5a30cf81867', 'request_id': 'req-3c39a4b0-15ac-432c-ba01-965ee110c53b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:36.372327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3c39a4b0-15ac-432c-ba01-965ee110c53b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d8df78c4404912a028b5a30cf81867', 'request_id': 'req-3c39a4b0-15ac-432c-ba01-965ee110c53b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:36.385575 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3c39a4b0-15ac-432c-ba01-965ee110c53b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d8df78c4404912a028b5a30cf81867', 'request_id': 'req-3c39a4b0-15ac-432c-ba01-965ee110c53b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:36.407123 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:36.416468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3c39a4b0-15ac-432c-ba01-965ee110c53b admin admin] The token cache is being invalidate because project 45d8df78c4404912a028b5a30cf81867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:36.417122 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3c39a4b0-15ac-432c-ba01-965ee110c53b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:36.418269 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3c39a4b0-15ac-432c-ba01-965ee110c53b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:36.426008 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1022/2069] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:36 2022] DELETE /identity/v3/projects/45d8df78c4404912a028b5a30cf81867 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:09:36.430268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39a4b0-15ac-432c-ba01-965ee110c53b admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:36.433442 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3c39a4b0-15ac-432c-ba01-965ee110c53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:36.497586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdb7c9-dc81-4938-99bd-40b4e4cef535 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:36.606076 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39a4b0-15ac-432c-ba01-965ee110c53b admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:36.615436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bf220-6f71-4762-9905-ff8d406414f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:36.616884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bf220-6f71-4762-9905-ff8d406414f3 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:36.617362 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bf220-6f71-4762-9905-ff8d406414f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:36.623320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bf220-6f71-4762-9905-ff8d406414f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:36.624804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bf220-6f71-4762-9905-ff8d406414f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:36.629817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bf220-6f71-4762-9905-ff8d406414f3 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:36.645854 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38fd1e-bf70-4cc8-a9d9-cfb49d8649c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:36.646938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38fd1e-bf70-4cc8-a9d9-cfb49d8649c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:36.647393 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38fd1e-bf70-4cc8-a9d9-cfb49d8649c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:36.647865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38fd1e-bf70-4cc8-a9d9-cfb49d8649c9 admin admin] PATH_INFO: `/v3/users/c7f1bb927cbc4a71b57de363c8bf475c` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:36.656351 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38fd1e-bf70-4cc8-a9d9-cfb49d8649c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f1bb927cbc4a71b57de363c8bf475c)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:36.659630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1023/2070] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:36.667622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38fd1e-bf70-4cc8-a9d9-cfb49d8649c9 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:36.672571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611c318-c918-4667-b1c6-49fc9f12f9c0 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:36.673276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611c318-c918-4667-b1c6-49fc9f12f9c0 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:36.673890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611c318-c918-4667-b1c6-49fc9f12f9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:36.701507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-2611c318-c918-4667-b1c6-49fc9f12f9c0 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:36.704434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2611c318-c918-4667-b1c6-49fc9f12f9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:36.724350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1024/2071] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:36.725458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611c318-c918-4667-b1c6-49fc9f12f9c0 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:36.745109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611c318-c918-4667-b1c6-49fc9f12f9c0 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:36.753898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05659ef2-fff8-4203-af57-dd98500247a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:36.754855 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05659ef2-fff8-4203-af57-dd98500247a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:36.755448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05659ef2-fff8-4203-af57-dd98500247a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:36.755819 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05659ef2-fff8-4203-af57-dd98500247a0 admin admin] PATH_INFO: `/v3/projects/0778c26163664ba28b4bbaa974ad018e/users/cf7af78331d346908992013b93e49a86/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:36.759400 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05659ef2-fff8-4203-af57-dd98500247a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0778c26163664ba28b4bbaa974ad018e, user_id=cf7af78331d346908992013b93e49a86, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:36.764938 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05659ef2-fff8-4203-af57-dd98500247a0 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:36.774410 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8f38fd1e-bf70-4cc8-a9d9-cfb49d8649c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f1bb927cbc4a71b57de363c8bf475c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:36.775896 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8f38fd1e-bf70-4cc8-a9d9-cfb49d8649c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f1bb927cbc4a71b57de363c8bf475c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:36.786213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1025/2072] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:36 2022] PUT /identity/v3/projects/0778c26163664ba28b4bbaa974ad018e/users/cf7af78331d346908992013b93e49a86/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:36.790817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8f38fd1e-bf70-4cc8-a9d9-cfb49d8649c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f1bb927cbc4a71b57de363c8bf475c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:36.793204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71c52e-6f9b-4924-a7f2-aac71f19446b None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:36.794130 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71c52e-6f9b-4924-a7f2-aac71f19446b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:36.794297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71c52e-6f9b-4924-a7f2-aac71f19446b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:36.827653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8f38fd1e-bf70-4cc8-a9d9-cfb49d8649c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f1bb927cbc4a71b57de363c8bf475c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:36.848631 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8f38fd1e-bf70-4cc8-a9d9-cfb49d8649c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f1bb927cbc4a71b57de363c8bf475c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:36.864498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1048/2073] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:36 2022] DELETE /identity/v3/users/c7f1bb927cbc4a71b57de363c8bf475c => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:36.864498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe257b-b734-4b0f-b027-3f6abb093c05 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:36.864498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe257b-b734-4b0f-b027-3f6abb093c05 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:36.864498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe257b-b734-4b0f-b027-3f6abb093c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:36.871373 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-2f71c52e-6f9b-4924-a7f2-aac71f19446b None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:36.873214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2f71c52e-6f9b-4924-a7f2-aac71f19446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:36.956924 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:36.976271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-b9fe257b-b734-4b0f-b027-3f6abb093c05 None None] MFA Rules not processed for user `cf7af78331d346908992013b93e49a86`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:36.977999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b9fe257b-b734-4b0f-b027-3f6abb093c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:37.066220 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:37.085892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1026/2074] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:37.091642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd5b63-25cc-4185-945d-d07534d1a8b6 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:37.092010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd5b63-25cc-4185-945d-d07534d1a8b6 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:37.092253 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd5b63-25cc-4185-945d-d07534d1a8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:37.114179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1049/2075] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:37.115345 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe257b-b734-4b0f-b027-3f6abb093c05 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:37.117703 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b9fe257b-b734-4b0f-b027-3f6abb093c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:37.141799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ccdd5b63-25cc-4185-945d-d07534d1a8b6 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:37.143311 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ccdd5b63-25cc-4185-945d-d07534d1a8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:37.148884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe257b-b734-4b0f-b027-3f6abb093c05 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:37.156109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af7f7a-20ae-48e8-a4b1-978ee09edb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:37.156502 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af7f7a-20ae-48e8-a4b1-978ee09edb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:37.156712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af7f7a-20ae-48e8-a4b1-978ee09edb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:37.156990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af7f7a-20ae-48e8-a4b1-978ee09edb40 admin admin] PATH_INFO: `/v3/users/2658d4393862473a88485e6bce6feab5` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:37.158953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af7f7a-20ae-48e8-a4b1-978ee09edb40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2658d4393862473a88485e6bce6feab5)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:37.163016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af7f7a-20ae-48e8-a4b1-978ee09edb40 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:37.169410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1027/2076] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:37.170614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd5b63-25cc-4185-945d-d07534d1a8b6 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:37.206909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd5b63-25cc-4185-945d-d07534d1a8b6 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:37.231412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90e9e8-ac4d-4cef-8f2b-e02cf5399ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:37.232109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90e9e8-ac4d-4cef-8f2b-e02cf5399ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:37.232583 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90e9e8-ac4d-4cef-8f2b-e02cf5399ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:37.232929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90e9e8-ac4d-4cef-8f2b-e02cf5399ec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:37.233954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90e9e8-ac4d-4cef-8f2b-e02cf5399ec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:37.234164 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90e9e8-ac4d-4cef-8f2b-e02cf5399ec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:37.235820 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90e9e8-ac4d-4cef-8f2b-e02cf5399ec6 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:37.255127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1028/2077] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:09:37.256033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90e9e8-ac4d-4cef-8f2b-e02cf5399ec6 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:37.272728 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fc90e9e8-ac4d-4cef-8f2b-e02cf5399ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:37.279078 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-f0af7f7a-20ae-48e8-a4b1-978ee09edb40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2658d4393862473a88485e6bce6feab5'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:37.283081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-f0af7f7a-20ae-48e8-a4b1-978ee09edb40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2658d4393862473a88485e6bce6feab5'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:37.319638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-f0af7f7a-20ae-48e8-a4b1-978ee09edb40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2658d4393862473a88485e6bce6feab5'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:37.354117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-f0af7f7a-20ae-48e8-a4b1-978ee09edb40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2658d4393862473a88485e6bce6feab5'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:37.375673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-f0af7f7a-20ae-48e8-a4b1-978ee09edb40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2658d4393862473a88485e6bce6feab5'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:37.386709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1050/2078] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:37 2022] DELETE /identity/v3/users/2658d4393862473a88485e6bce6feab5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:37.387709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af7f7a-20ae-48e8-a4b1-978ee09edb40 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:37.395768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f0af7f7a-20ae-48e8-a4b1-978ee09edb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:37.500406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90e9e8-ac4d-4cef-8f2b-e02cf5399ec6 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:37.544923 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af7f7a-20ae-48e8-a4b1-978ee09edb40 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:37.551350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cef85-f13a-4960-8fd3-fb054d9098e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:37.552485 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cef85-f13a-4960-8fd3-fb054d9098e1 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:37.553035 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cef85-f13a-4960-8fd3-fb054d9098e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:37.553525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cef85-f13a-4960-8fd3-fb054d9098e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:37.556639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-574cef85-f13a-4960-8fd3-fb054d9098e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:37.638384 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b98cf0-3a09-4f00-80ac-56f73c69459d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:37.640165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b98cf0-3a09-4f00-80ac-56f73c69459d service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:37.640165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b98cf0-3a09-4f00-80ac-56f73c69459d service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:37.640165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b98cf0-3a09-4f00-80ac-56f73c69459d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:37.644427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-59b98cf0-3a09-4f00-80ac-56f73c69459d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:37.723226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:37.729713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cef85-f13a-4960-8fd3-fb054d9098e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:37.731516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cef85-f13a-4960-8fd3-fb054d9098e1 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:37.779440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1051/2079] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:37.781294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b98cf0-3a09-4f00-80ac-56f73c69459d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:37.784480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b98cf0-3a09-4f00-80ac-56f73c69459d service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:37.785858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cef85-f13a-4960-8fd3-fb054d9098e1 service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:37.788128 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-574cef85-f13a-4960-8fd3-fb054d9098e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:37.826073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cef85-f13a-4960-8fd3-fb054d9098e1 service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:37.831972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1029/2080] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:37.836056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962a9e3-4638-4093-b550-986d67e24239 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:37.836056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962a9e3-4638-4093-b550-986d67e24239 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:37.836481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962a9e3-4638-4093-b550-986d67e24239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:37.863651 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b49b50-a00b-45e6-9fd3-210c4c57a5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:37.865099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b49b50-a00b-45e6-9fd3-210c4c57a5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:37.865099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b49b50-a00b-45e6-9fd3-210c4c57a5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:37.865419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b49b50-a00b-45e6-9fd3-210c4c57a5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:37.866394 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b49b50-a00b-45e6-9fd3-210c4c57a5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:37.872115 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b49b50-a00b-45e6-9fd3-210c4c57a5c2 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:37.939730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-5962a9e3-4638-4093-b550-986d67e24239 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:37.943157 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5962a9e3-4638-4093-b550-986d67e24239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:37.969847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1030/2081] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:37.973358 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1052/2082] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:37 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:37.977614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962a9e3-4638-4093-b550-986d67e24239 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:38.011955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b49b50-a00b-45e6-9fd3-210c4c57a5c2 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:38.023279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962a9e3-4638-4093-b550-986d67e24239 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:38.051267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:38.264498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b49b50-a00b-45e6-9fd3-210c4c57a5c2 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:38.284279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adc529-b6df-4260-8acf-2b536fa94443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:38.290803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adc529-b6df-4260-8acf-2b536fa94443 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:38.291105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adc529-b6df-4260-8acf-2b536fa94443 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:38.291468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adc529-b6df-4260-8acf-2b536fa94443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:38.297133 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64a09c-a394-48fc-901e-c1d8fbd7705d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:38.297133 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64a09c-a394-48fc-901e-c1d8fbd7705d admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:38.297133 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64a09c-a394-48fc-901e-c1d8fbd7705d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:38.297133 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64a09c-a394-48fc-901e-c1d8fbd7705d admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:38.298280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64a09c-a394-48fc-901e-c1d8fbd7705d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:38.302227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64a09c-a394-48fc-901e-c1d8fbd7705d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:38.323187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adc529-b6df-4260-8acf-2b536fa94443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:38.326608 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adc529-b6df-4260-8acf-2b536fa94443 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:38.358218 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1053/2083] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:09:38.377681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1031/2084] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:37 2022] POST /identity/v3/users => generated 293 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:38.383503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adc529-b6df-4260-8acf-2b536fa94443 service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:38.407883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adc529-b6df-4260-8acf-2b536fa94443 service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:38.418016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af9479-2582-4225-a1ca-45c49507d01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:38.422421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af9479-2582-4225-a1ca-45c49507d01a admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:38.423387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af9479-2582-4225-a1ca-45c49507d01a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:38.424153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af9479-2582-4225-a1ca-45c49507d01a admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:38.425800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af9479-2582-4225-a1ca-45c49507d01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:38.429349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af9479-2582-4225-a1ca-45c49507d01a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:38.463513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1054/2085] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:38.466064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64a09c-a394-48fc-901e-c1d8fbd7705d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:38.492336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64a09c-a394-48fc-901e-c1d8fbd7705d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:38.504602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74112ae3-575c-497a-93ab-f3bfae48d07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:38.506376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74112ae3-575c-497a-93ab-f3bfae48d07e admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:38.507246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74112ae3-575c-497a-93ab-f3bfae48d07e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:38.508461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74112ae3-575c-497a-93ab-f3bfae48d07e admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:38.510821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74112ae3-575c-497a-93ab-f3bfae48d07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:38.515311 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74112ae3-575c-497a-93ab-f3bfae48d07e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:38.547611 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1032/2086] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:09:38.550814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af9479-2582-4225-a1ca-45c49507d01a admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:38.595451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af9479-2582-4225-a1ca-45c49507d01a admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:38.628929 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bf275-8484-40ba-b366-f483e2f29595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:38.629845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bf275-8484-40ba-b366-f483e2f29595 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:38.630191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bf275-8484-40ba-b366-f483e2f29595 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:38.630506 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bf275-8484-40ba-b366-f483e2f29595 admin admin] PATH_INFO: `/v3/projects/9aaf4c2e02864102ac859a0d6e399383/users/e7755bd5e3934c98b7ef535ffc8d82cd/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:38.665763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bf275-8484-40ba-b366-f483e2f29595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aaf4c2e02864102ac859a0d6e399383, user_id=e7755bd5e3934c98b7ef535ffc8d82cd, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:38.672197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bf275-8484-40ba-b366-f483e2f29595 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:38.697217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1055/2087] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:38 2022] PUT /identity/v3/projects/9aaf4c2e02864102ac859a0d6e399383/users/e7755bd5e3934c98b7ef535ffc8d82cd/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:38.714259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f91c84-fb88-46b1-b179-0c50a4511280 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:38.714839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f91c84-fb88-46b1-b179-0c50a4511280 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:38.717148 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f91c84-fb88-46b1-b179-0c50a4511280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:38.786977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-d7f91c84-fb88-46b1-b179-0c50a4511280 None None] MFA Rules not processed for user `e7755bd5e3934c98b7ef535ffc8d82cd`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:38.788985 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d7f91c84-fb88-46b1-b179-0c50a4511280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:38.872301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bf275-8484-40ba-b366-f483e2f29595 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:38.875879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6b3bf275-8484-40ba-b366-f483e2f29595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:39.069557 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1033/2088] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:39.073551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bf275-8484-40ba-b366-f483e2f29595 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:39.075989 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f91c84-fb88-46b1-b179-0c50a4511280 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:39.084277 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ab586-f141-4fb3-a37e-188155df25ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:39.085684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ab586-f141-4fb3-a37e-188155df25ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:39.086456 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ab586-f141-4fb3-a37e-188155df25ee admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:39.087187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ab586-f141-4fb3-a37e-188155df25ee admin admin] PATH_INFO: `/v3/users/78c8e5fe62e643ec8a90fb936bd1937c` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:39.089548 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ab586-f141-4fb3-a37e-188155df25ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=78c8e5fe62e643ec8a90fb936bd1937c)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:39.093681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ab586-f141-4fb3-a37e-188155df25ee admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:39.098887 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f91c84-fb88-46b1-b179-0c50a4511280 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:39.105344 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd079f6-30ed-4c9b-b2eb-e5df3bf8b28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:39.106550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd079f6-30ed-4c9b-b2eb-e5df3bf8b28e admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:39.107064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd079f6-30ed-4c9b-b2eb-e5df3bf8b28e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:39.107366 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd079f6-30ed-4c9b-b2eb-e5df3bf8b28e admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:39.108178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd079f6-30ed-4c9b-b2eb-e5df3bf8b28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:39.111292 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd079f6-30ed-4c9b-b2eb-e5df3bf8b28e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:39.165241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1034/2089] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:39 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:39.167350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd079f6-30ed-4c9b-b2eb-e5df3bf8b28e admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:39.170681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fbd079f6-30ed-4c9b-b2eb-e5df3bf8b28e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:39.211271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:39.215264 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-da0ab586-f141-4fb3-a37e-188155df25ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78c8e5fe62e643ec8a90fb936bd1937c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.220259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-da0ab586-f141-4fb3-a37e-188155df25ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78c8e5fe62e643ec8a90fb936bd1937c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.232713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-da0ab586-f141-4fb3-a37e-188155df25ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78c8e5fe62e643ec8a90fb936bd1937c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.252688 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-da0ab586-f141-4fb3-a37e-188155df25ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78c8e5fe62e643ec8a90fb936bd1937c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.265515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-da0ab586-f141-4fb3-a37e-188155df25ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78c8e5fe62e643ec8a90fb936bd1937c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.276335 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1056/2090] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:38 2022] DELETE /identity/v3/users/78c8e5fe62e643ec8a90fb936bd1937c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:39.277237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ab586-f141-4fb3-a37e-188155df25ee admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:39.280502 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-da0ab586-f141-4fb3-a37e-188155df25ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:39.320587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:39.330334 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd079f6-30ed-4c9b-b2eb-e5df3bf8b28e admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:39.445789 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a50ced-e3b8-41a0-9812-a10c6695328b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:39.446478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50ced-e3b8-41a0-9812-a10c6695328b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:39.446760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50ced-e3b8-41a0-9812-a10c6695328b admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:39.447034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50ced-e3b8-41a0-9812-a10c6695328b admin admin] PATH_INFO: `/v3/projects/f319d726e3a84c5db49155fb9038de09` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:39.448471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a50ced-e3b8-41a0-9812-a10c6695328b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f319d726e3a84c5db49155fb9038de09)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:39.449744 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ab586-f141-4fb3-a37e-188155df25ee admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:39.450749 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a50ced-e3b8-41a0-9812-a10c6695328b admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:39.456979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e805ee-e733-4e9a-bdd9-3a5fdef73215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:39.457789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e805ee-e733-4e9a-bdd9-3a5fdef73215 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:39.458182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e805ee-e733-4e9a-bdd9-3a5fdef73215 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:39.458710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e805ee-e733-4e9a-bdd9-3a5fdef73215 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:39.459476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e805ee-e733-4e9a-bdd9-3a5fdef73215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:39.462786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e805ee-e733-4e9a-bdd9-3a5fdef73215 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:39.505912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1057/2091] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:39 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:39.505912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e805ee-e733-4e9a-bdd9-3a5fdef73215 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:39.505912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a9e805ee-e733-4e9a-bdd9-3a5fdef73215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:39.530570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e805ee-e733-4e9a-bdd9-3a5fdef73215 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:39.546011 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1093c6e-15e4-4105-96e2-3919b2aa6553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:39.546771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1093c6e-15e4-4105-96e2-3919b2aa6553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:39.548338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1093c6e-15e4-4105-96e2-3919b2aa6553 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:39.549563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1093c6e-15e4-4105-96e2-3919b2aa6553 admin admin] PATH_INFO: `/v3/projects/444a51f51c53463e8cf6be7cc78525c3` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:39.552860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1093c6e-15e4-4105-96e2-3919b2aa6553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=444a51f51c53463e8cf6be7cc78525c3)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:39.555277 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1093c6e-15e4-4105-96e2-3919b2aa6553 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:39.586360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-95a50ced-e3b8-41a0-9812-a10c6695328b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f319d726e3a84c5db49155fb9038de09', 'request_id': 'req-95a50ced-e3b8-41a0-9812-a10c6695328b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.604015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-95a50ced-e3b8-41a0-9812-a10c6695328b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f319d726e3a84c5db49155fb9038de09', 'request_id': 'req-95a50ced-e3b8-41a0-9812-a10c6695328b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.618116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-95a50ced-e3b8-41a0-9812-a10c6695328b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f319d726e3a84c5db49155fb9038de09', 'request_id': 'req-95a50ced-e3b8-41a0-9812-a10c6695328b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.636979 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-95a50ced-e3b8-41a0-9812-a10c6695328b admin admin] The token cache is being invalidate because project f319d726e3a84c5db49155fb9038de09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:39.638024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-95a50ced-e3b8-41a0-9812-a10c6695328b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.639118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-95a50ced-e3b8-41a0-9812-a10c6695328b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.640830 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1035/2092] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:39 2022] DELETE /identity/v3/projects/f319d726e3a84c5db49155fb9038de09 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:39.644865 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a50ced-e3b8-41a0-9812-a10c6695328b admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:39.646537 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-95a50ced-e3b8-41a0-9812-a10c6695328b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:39.657139 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a1093c6e-15e4-4105-96e2-3919b2aa6553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444a51f51c53463e8cf6be7cc78525c3', 'request_id': 'req-a1093c6e-15e4-4105-96e2-3919b2aa6553'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.672803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a1093c6e-15e4-4105-96e2-3919b2aa6553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444a51f51c53463e8cf6be7cc78525c3', 'request_id': 'req-a1093c6e-15e4-4105-96e2-3919b2aa6553'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.682680 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a1093c6e-15e4-4105-96e2-3919b2aa6553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444a51f51c53463e8cf6be7cc78525c3', 'request_id': 'req-a1093c6e-15e4-4105-96e2-3919b2aa6553'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.702975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a1093c6e-15e4-4105-96e2-3919b2aa6553 admin admin] The token cache is being invalidate because project 444a51f51c53463e8cf6be7cc78525c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:39.703499 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a1093c6e-15e4-4105-96e2-3919b2aa6553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.704338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a1093c6e-15e4-4105-96e2-3919b2aa6553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.706898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1058/2093] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:39 2022] DELETE /identity/v3/projects/444a51f51c53463e8cf6be7cc78525c3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:39.707752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1093c6e-15e4-4105-96e2-3919b2aa6553 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:39.709326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a1093c6e-15e4-4105-96e2-3919b2aa6553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:39.747439 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a50ced-e3b8-41a0-9812-a10c6695328b admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:39.776771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:DELETE=11,keystone:SELECT=84,keystone:INSERT=5 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:39.822493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:39.842923 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1093c6e-15e4-4105-96e2-3919b2aa6553 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:39.851446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6c924-4614-4e3d-a676-3be9dc4a8354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:39.852218 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6c924-4614-4e3d-a676-3be9dc4a8354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:39.852626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6c924-4614-4e3d-a676-3be9dc4a8354 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:39.852975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6c924-4614-4e3d-a676-3be9dc4a8354 admin admin] PATH_INFO: `/v3/projects/baa7b28b556e451e9e3270cede39723e` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:39.853911 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9d500-b648-47ca-a3f1-7741b137d888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:39.854326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6c924-4614-4e3d-a676-3be9dc4a8354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa7b28b556e451e9e3270cede39723e)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:39.854946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9d500-b648-47ca-a3f1-7741b137d888 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:39.855418 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9d500-b648-47ca-a3f1-7741b137d888 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:39.855925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9d500-b648-47ca-a3f1-7741b137d888 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:39.856742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6c924-4614-4e3d-a676-3be9dc4a8354 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:39.857052 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9d500-b648-47ca-a3f1-7741b137d888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:39.860222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9d500-b648-47ca-a3f1-7741b137d888 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:39.873840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1036/2094] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:39.875451 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9d500-b648-47ca-a3f1-7741b137d888 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:39.878265 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4ad9d500-b648-47ca-a3f1-7741b137d888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:39.897690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9d500-b648-47ca-a3f1-7741b137d888 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:39.903693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03837c3-7fb2-42d9-ad6b-7ecb9576989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:39.904755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03837c3-7fb2-42d9-ad6b-7ecb9576989c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:39.905084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03837c3-7fb2-42d9-ad6b-7ecb9576989c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:39.905339 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03837c3-7fb2-42d9-ad6b-7ecb9576989c admin admin] PATH_INFO: `/v3/users/cefe3ea47edc44c1b6f41ce496a8e591` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:39.906529 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03837c3-7fb2-42d9-ad6b-7ecb9576989c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cefe3ea47edc44c1b6f41ce496a8e591)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:39.908722 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03837c3-7fb2-42d9-ad6b-7ecb9576989c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:39.946513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5de6c924-4614-4e3d-a676-3be9dc4a8354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa7b28b556e451e9e3270cede39723e', 'request_id': 'req-5de6c924-4614-4e3d-a676-3be9dc4a8354'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.955402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5de6c924-4614-4e3d-a676-3be9dc4a8354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa7b28b556e451e9e3270cede39723e', 'request_id': 'req-5de6c924-4614-4e3d-a676-3be9dc4a8354'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.965764 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5de6c924-4614-4e3d-a676-3be9dc4a8354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa7b28b556e451e9e3270cede39723e', 'request_id': 'req-5de6c924-4614-4e3d-a676-3be9dc4a8354'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.985894 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5de6c924-4614-4e3d-a676-3be9dc4a8354 admin admin] The token cache is being invalidate because project baa7b28b556e451e9e3270cede39723e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:39.986485 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5de6c924-4614-4e3d-a676-3be9dc4a8354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.987461 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5de6c924-4614-4e3d-a676-3be9dc4a8354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.989841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1059/2095] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:39 2022] DELETE /identity/v3/projects/baa7b28b556e451e9e3270cede39723e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:39.998722 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f03837c3-7fb2-42d9-ad6b-7ecb9576989c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cefe3ea47edc44c1b6f41ce496a8e591'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:39.999758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f03837c3-7fb2-42d9-ad6b-7ecb9576989c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cefe3ea47edc44c1b6f41ce496a8e591'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:40.001194 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6c924-4614-4e3d-a676-3be9dc4a8354 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:40.010622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5de6c924-4614-4e3d-a676-3be9dc4a8354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:40.019273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f03837c3-7fb2-42d9-ad6b-7ecb9576989c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cefe3ea47edc44c1b6f41ce496a8e591'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:40.020092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f03837c3-7fb2-42d9-ad6b-7ecb9576989c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cefe3ea47edc44c1b6f41ce496a8e591'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:40.039023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f03837c3-7fb2-42d9-ad6b-7ecb9576989c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cefe3ea47edc44c1b6f41ce496a8e591'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:40.074220 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1037/2096] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:39 2022] DELETE /identity/v3/users/cefe3ea47edc44c1b6f41ce496a8e591 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:40.076581 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03837c3-7fb2-42d9-ad6b-7ecb9576989c admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:40.079639 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f03837c3-7fb2-42d9-ad6b-7ecb9576989c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:40.220661 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6c924-4614-4e3d-a676-3be9dc4a8354 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:40.249055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03837c3-7fb2-42d9-ad6b-7ecb9576989c admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:40.257568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a6d99-af60-48bd-b886-6903fb1372bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:40.258477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a6d99-af60-48bd-b886-6903fb1372bf admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:40.258895 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a6d99-af60-48bd-b886-6903fb1372bf admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:40.259531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a6d99-af60-48bd-b886-6903fb1372bf admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:40.261389 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a6d99-af60-48bd-b886-6903fb1372bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:40.266455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a6d99-af60-48bd-b886-6903fb1372bf admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:40.278758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1038/2097] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:40.279948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a7276-fd73-4215-84b4-3f179e985e39 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:40.280331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a7276-fd73-4215-84b4-3f179e985e39 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:40.280838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a7276-fd73-4215-84b4-3f179e985e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:40.317445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-7a6a7276-fd73-4215-84b4-3f179e985e39 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:40.319017 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7a6a7276-fd73-4215-84b4-3f179e985e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:40.334491 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1039/2098] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:40.336282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a7276-fd73-4215-84b4-3f179e985e39 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:40.343171 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37730e-e25a-4955-b508-6b1b2afdc67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:40.344221 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37730e-e25a-4955-b508-6b1b2afdc67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:40.344705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37730e-e25a-4955-b508-6b1b2afdc67a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:40.345057 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37730e-e25a-4955-b508-6b1b2afdc67a admin admin] PATH_INFO: `/v3/users/768cf9d74d75492183467067c7989773` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:40.346546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37730e-e25a-4955-b508-6b1b2afdc67a admin admin] RBAC: Authorizing `identity:delete_user(user_id=768cf9d74d75492183467067c7989773)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:40.348916 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a7276-fd73-4215-84b4-3f179e985e39 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:40.349184 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37730e-e25a-4955-b508-6b1b2afdc67a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:40.357074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a133ee9-8e5b-44e6-a38c-e9139cfe9ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:40.357788 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a133ee9-8e5b-44e6-a38c-e9139cfe9ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:40.358065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a133ee9-8e5b-44e6-a38c-e9139cfe9ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:40.358337 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a133ee9-8e5b-44e6-a38c-e9139cfe9ac1 admin admin] PATH_INFO: `/v3/projects/d846a79994cf40a9be1067d1f54fb097/users/7a964c00a664423aa6d793b7235e1a9c/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:40.373518 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:40.394217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a133ee9-8e5b-44e6-a38c-e9139cfe9ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d846a79994cf40a9be1067d1f54fb097, user_id=7a964c00a664423aa6d793b7235e1a9c, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:40.400229 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a133ee9-8e5b-44e6-a38c-e9139cfe9ac1 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:40.426102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1040/2099] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:40 2022] PUT /identity/v3/projects/d846a79994cf40a9be1067d1f54fb097/users/7a964c00a664423aa6d793b7235e1a9c/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:40.435917 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c227e8-d203-476a-8866-29348f80c150 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:40.435917 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c227e8-d203-476a-8866-29348f80c150 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:40.435917 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c227e8-d203-476a-8866-29348f80c150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:40.437287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8e37730e-e25a-4955-b508-6b1b2afdc67a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '768cf9d74d75492183467067c7989773'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:40.438413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8e37730e-e25a-4955-b508-6b1b2afdc67a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '768cf9d74d75492183467067c7989773'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:40.455515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8e37730e-e25a-4955-b508-6b1b2afdc67a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '768cf9d74d75492183467067c7989773'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:40.459846 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-65c227e8-d203-476a-8866-29348f80c150 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:40.461204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-65c227e8-d203-476a-8866-29348f80c150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:40.475319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8e37730e-e25a-4955-b508-6b1b2afdc67a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '768cf9d74d75492183467067c7989773'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:40.475928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:40.488216 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8e37730e-e25a-4955-b508-6b1b2afdc67a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '768cf9d74d75492183467067c7989773'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:40.518801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1060/2100] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:39 2022] DELETE /identity/v3/users/768cf9d74d75492183467067c7989773 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:40.520233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18d8db-074c-41e0-a778-9b056ef097a1 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:40.520555 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18d8db-074c-41e0-a778-9b056ef097a1 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:40.520838 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18d8db-074c-41e0-a778-9b056ef097a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:40.613203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-6d18d8db-074c-41e0-a778-9b056ef097a1 None None] MFA Rules not processed for user `7a964c00a664423aa6d793b7235e1a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:40.615009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6d18d8db-074c-41e0-a778-9b056ef097a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:40.724198 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1041/2101] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:40.731668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c227e8-d203-476a-8866-29348f80c150 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:40.763194 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c227e8-d203-476a-8866-29348f80c150 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:40.771159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1061/2102] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:40.778309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18d8db-074c-41e0-a778-9b056ef097a1 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:40.780677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6d18d8db-074c-41e0-a778-9b056ef097a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:40.912632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440823b5-1877-4ef4-9955-cdb59fb07307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:40.913390 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440823b5-1877-4ef4-9955-cdb59fb07307 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:40.913672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440823b5-1877-4ef4-9955-cdb59fb07307 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:40.914078 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440823b5-1877-4ef4-9955-cdb59fb07307 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:40.914774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18d8db-074c-41e0-a778-9b056ef097a1 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:40.915179 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440823b5-1877-4ef4-9955-cdb59fb07307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:40.915813 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440823b5-1877-4ef4-9955-cdb59fb07307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:40.920164 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440823b5-1877-4ef4-9955-cdb59fb07307 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:40.923110 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af1f27-c20a-4de2-92ca-40e3f98b4199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:40.923985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af1f27-c20a-4de2-92ca-40e3f98b4199 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:40.924506 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af1f27-c20a-4de2-92ca-40e3f98b4199 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:40.924777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af1f27-c20a-4de2-92ca-40e3f98b4199 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:40.925486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af1f27-c20a-4de2-92ca-40e3f98b4199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:40.927685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af1f27-c20a-4de2-92ca-40e3f98b4199 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:40.953740 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1042/2103] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:09:40.955288 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440823b5-1877-4ef4-9955-cdb59fb07307 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:40.972952 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440823b5-1877-4ef4-9955-cdb59fb07307 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:40.985677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d630612-b76c-4416-bce0-a81092e92276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:40.986680 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d630612-b76c-4416-bce0-a81092e92276 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:40.987336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d630612-b76c-4416-bce0-a81092e92276 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:40.987843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d630612-b76c-4416-bce0-a81092e92276 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:40.989376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d630612-b76c-4416-bce0-a81092e92276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:40.992717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1062/2104] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:40 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:40.994186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af1f27-c20a-4de2-92ca-40e3f98b4199 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:40.994869 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d630612-b76c-4416-bce0-a81092e92276 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:41.005655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:41.062704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1043/2105] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:40 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:41.064155 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d630612-b76c-4416-bce0-a81092e92276 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:41.195854 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af1f27-c20a-4de2-92ca-40e3f98b4199 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:41.209512 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d630612-b76c-4416-bce0-a81092e92276 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:41.218548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298a5d7-8586-4e37-8fea-06ebd3070179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:41.219354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298a5d7-8586-4e37-8fea-06ebd3070179 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:41.219775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298a5d7-8586-4e37-8fea-06ebd3070179 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:41.219940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298a5d7-8586-4e37-8fea-06ebd3070179 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:41.220605 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298a5d7-8586-4e37-8fea-06ebd3070179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:41.228319 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298a5d7-8586-4e37-8fea-06ebd3070179 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:41.256554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1044/2106] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:41 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:41.257944 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298a5d7-8586-4e37-8fea-06ebd3070179 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:41.273549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3298a5d7-8586-4e37-8fea-06ebd3070179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:41.274653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc466-a7af-4e11-9faa-b2fa35948d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:41.275384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc466-a7af-4e11-9faa-b2fa35948d3e admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:41.275701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc466-a7af-4e11-9faa-b2fa35948d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:41.275889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc466-a7af-4e11-9faa-b2fa35948d3e admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:41.276574 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fc466-a7af-4e11-9faa-b2fa35948d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:41.278609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fc466-a7af-4e11-9faa-b2fa35948d3e admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:41.289438 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298a5d7-8586-4e37-8fea-06ebd3070179 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:41.296744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:41.297423 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:41.297704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:41.297972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca admin admin] PATH_INFO: `/v3/projects/4cbfff4e29fa4f3f9db65146d105286a` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:41.299344 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cbfff4e29fa4f3f9db65146d105286a)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:41.301483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:41.319475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1063/2107] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:40 2022] POST /identity/v3/users => generated 299 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:41.321468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc466-a7af-4e11-9faa-b2fa35948d3e admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:41.323593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ab9fc466-a7af-4e11-9faa-b2fa35948d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:41.336026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:41.339488 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc466-a7af-4e11-9faa-b2fa35948d3e admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:41.360585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:41.362520 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:41.363146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:41.363314 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47 admin admin] PATH_INFO: `/v3/projects/ca43dabed1f64e4e9a3b746e7d8fc7a2` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:41.364980 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca43dabed1f64e4e9a3b746e7d8fc7a2)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:41.367114 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:41.405390 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cbfff4e29fa4f3f9db65146d105286a', 'request_id': 'req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:41.424358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cbfff4e29fa4f3f9db65146d105286a', 'request_id': 'req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:41.436302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cbfff4e29fa4f3f9db65146d105286a', 'request_id': 'req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:41.459553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca admin admin] The token cache is being invalidate because project 4cbfff4e29fa4f3f9db65146d105286a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:41.460021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:41.461807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:41.462365 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca43dabed1f64e4e9a3b746e7d8fc7a2', 'request_id': 'req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:41.467847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1045/2108] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:41 2022] DELETE /identity/v3/projects/4cbfff4e29fa4f3f9db65146d105286a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:41.469288 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:41.470887 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:41.481282 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca43dabed1f64e4e9a3b746e7d8fc7a2', 'request_id': 'req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:41.495105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca43dabed1f64e4e9a3b746e7d8fc7a2', 'request_id': 'req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:41.532659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47 admin admin] The token cache is being invalidate because project ca43dabed1f64e4e9a3b746e7d8fc7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:41.547977 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:41.547977 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:41.547977 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1064/2109] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:41 2022] DELETE /identity/v3/projects/ca43dabed1f64e4e9a3b746e7d8fc7a2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:41.547977 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:41.547977 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:41.601118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:41.636718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17d5dd-46ea-422a-86b9-8f7f10b558ca admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:41.675972 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35eff9-83ea-4fc2-8b16-757cf57c9f47 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:41.681648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fdc0e-bc2f-4d51-a2aa-ca58fb0a031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:41.682382 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fdc0e-bc2f-4d51-a2aa-ca58fb0a031d admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:41.682815 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fdc0e-bc2f-4d51-a2aa-ca58fb0a031d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:41.683420 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fdc0e-bc2f-4d51-a2aa-ca58fb0a031d admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:41.684583 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fdc0e-bc2f-4d51-a2aa-ca58fb0a031d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:41.686596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fdc0e-bc2f-4d51-a2aa-ca58fb0a031d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:41.699179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1065/2110] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:41.700936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50419ee-57bf-4249-895b-c3d198e3d22a None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:41.701298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50419ee-57bf-4249-895b-c3d198e3d22a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:41.701496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50419ee-57bf-4249-895b-c3d198e3d22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:41.722351 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e3728-0828-4f88-8b63-50b2c53ff913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:41.722351 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e3728-0828-4f88-8b63-50b2c53ff913 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:41.722668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e3728-0828-4f88-8b63-50b2c53ff913 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:41.722950 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e3728-0828-4f88-8b63-50b2c53ff913 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:41.723485 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e3728-0828-4f88-8b63-50b2c53ff913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:41.725171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e3728-0828-4f88-8b63-50b2c53ff913 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:41.725995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-b50419ee-57bf-4249-895b-c3d198e3d22a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:41.727439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b50419ee-57bf-4249-895b-c3d198e3d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:41.736537 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1066/2111] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:41.738261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f290e-637b-498d-a228-902b7ac7f612 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:41.738617 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f290e-637b-498d-a228-902b7ac7f612 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:41.738960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f290e-637b-498d-a228-902b7ac7f612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:41.744226 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1046/2112] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:41.745246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e3728-0828-4f88-8b63-50b2c53ff913 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:41.748349 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fd3e3728-0828-4f88-8b63-50b2c53ff913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:41.770888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-e84f290e-637b-498d-a228-902b7ac7f612 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:41.772250 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e84f290e-637b-498d-a228-902b7ac7f612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:41.782928 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1067/2113] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:41.783887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f290e-637b-498d-a228-902b7ac7f612 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:41.796991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f290e-637b-498d-a228-902b7ac7f612 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:41.801988 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5e737-3855-4126-b347-c3b349e0c219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:41.802673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5e737-3855-4126-b347-c3b349e0c219 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:41.802958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5e737-3855-4126-b347-c3b349e0c219 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:41.803235 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5e737-3855-4126-b347-c3b349e0c219 admin admin] PATH_INFO: `/v3/projects/83520002c1e14977a24ff6f647fd6bc5/users/54e2f40368d7483abd830f2096207e5d/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:41.816786 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:41.820493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5e737-3855-4126-b347-c3b349e0c219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83520002c1e14977a24ff6f647fd6bc5, user_id=54e2f40368d7483abd830f2096207e5d, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:41.823371 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5e737-3855-4126-b347-c3b349e0c219 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:41.834500 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e3728-0828-4f88-8b63-50b2c53ff913 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:41.839839 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1068/2114] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:41 2022] PUT /identity/v3/projects/83520002c1e14977a24ff6f647fd6bc5/users/54e2f40368d7483abd830f2096207e5d/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:41.844598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc150f3-a71c-4f96-8396-8864f4caa548 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:41.844907 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc150f3-a71c-4f96-8396-8864f4caa548 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:41.845163 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc150f3-a71c-4f96-8396-8864f4caa548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:41.875125 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-4bc150f3-a71c-4f96-8396-8864f4caa548 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:41.876816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-4bc150f3-a71c-4f96-8396-8864f4caa548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:41.902732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45993561-582b-44bc-8287-15157755b0ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:41.903627 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45993561-582b-44bc-8287-15157755b0ca service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:41.903995 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45993561-582b-44bc-8287-15157755b0ca service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:41.904392 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45993561-582b-44bc-8287-15157755b0ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:41.906617 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-45993561-582b-44bc-8287-15157755b0ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:41.971491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1069/2115] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:41.976050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc150f3-a71c-4f96-8396-8864f4caa548 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:41.976050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-4bc150f3-a71c-4f96-8396-8864f4caa548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:41.986581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc150f3-a71c-4f96-8396-8864f4caa548 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:41.995607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095ca7f-e5d7-4229-bc58-cdadcd20356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:41.996768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095ca7f-e5d7-4229-bc58-cdadcd20356c admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:41.997101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095ca7f-e5d7-4229-bc58-cdadcd20356c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:41.997378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095ca7f-e5d7-4229-bc58-cdadcd20356c admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:41.998197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095ca7f-e5d7-4229-bc58-cdadcd20356c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:41.999924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095ca7f-e5d7-4229-bc58-cdadcd20356c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:42.009880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45993561-582b-44bc-8287-15157755b0ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:42.017331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1070/2116] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:42.017530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45993561-582b-44bc-8287-15157755b0ca service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:42.017647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b8f3-578b-42b6-9f6c-516592ca1c7b None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:42.017647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b8f3-578b-42b6-9f6c-516592ca1c7b None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:42.017647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b8f3-578b-42b6-9f6c-516592ca1c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:42.025616 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1047/2117] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:42.026753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45993561-582b-44bc-8287-15157755b0ca service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:42.041295 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45993561-582b-44bc-8287-15157755b0ca service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:42.048437 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4299a9-87e0-4c99-bdc0-2e1d5a6b702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:42.049070 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4299a9-87e0-4c99-bdc0-2e1d5a6b702b admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:42.049343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4299a9-87e0-4c99-bdc0-2e1d5a6b702b admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:42.049612 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4299a9-87e0-4c99-bdc0-2e1d5a6b702b admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:42.050271 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4299a9-87e0-4c99-bdc0-2e1d5a6b702b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:42.052066 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4299a9-87e0-4c99-bdc0-2e1d5a6b702b admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:42.054499 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-f2c3b8f3-578b-42b6-9f6c-516592ca1c7b None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:42.056641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f2c3b8f3-578b-42b6-9f6c-516592ca1c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:42.064692 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1048/2118] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:42.065687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4299a9-87e0-4c99-bdc0-2e1d5a6b702b admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:42.079445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1071/2119] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:42.079445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b8f3-578b-42b6-9f6c-516592ca1c7b None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:42.079872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4299a9-87e0-4c99-bdc0-2e1d5a6b702b admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:42.088822 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b8f3-578b-42b6-9f6c-516592ca1c7b None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:42.094006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c48846-e959-4822-b85e-73222f0de252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:42.094690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c48846-e959-4822-b85e-73222f0de252 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:42.095106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c48846-e959-4822-b85e-73222f0de252 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:42.095224 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502548a4-7379-4a7d-b953-ba2e46d0f560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:42.095427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c48846-e959-4822-b85e-73222f0de252 admin admin] PATH_INFO: `/v3/projects/2cfa5138d43a4bd6bfcd6ff3563cce3f/users/2b1ed674b846444e9239d42e7ea03b53/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:42.095791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502548a4-7379-4a7d-b953-ba2e46d0f560 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:42.096103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502548a4-7379-4a7d-b953-ba2e46d0f560 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:42.096412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502548a4-7379-4a7d-b953-ba2e46d0f560 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:42.097547 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502548a4-7379-4a7d-b953-ba2e46d0f560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:42.098048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502548a4-7379-4a7d-b953-ba2e46d0f560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:42.101086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502548a4-7379-4a7d-b953-ba2e46d0f560 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:42.121664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1049/2120] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:09:42.125302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c48846-e959-4822-b85e-73222f0de252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cfa5138d43a4bd6bfcd6ff3563cce3f, user_id=2b1ed674b846444e9239d42e7ea03b53, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:42.127004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502548a4-7379-4a7d-b953-ba2e46d0f560 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:42.134018 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c48846-e959-4822-b85e-73222f0de252 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:42.141550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502548a4-7379-4a7d-b953-ba2e46d0f560 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:42.148497 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11875271-c530-4a17-aab9-6cdb0976de49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:42.149375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875271-c530-4a17-aab9-6cdb0976de49 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:42.149646 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875271-c530-4a17-aab9-6cdb0976de49 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:42.149923 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875271-c530-4a17-aab9-6cdb0976de49 admin admin] PATH_INFO: `/v3/projects/83520002c1e14977a24ff6f647fd6bc5/users/54e2f40368d7483abd830f2096207e5d/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:42.152473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11875271-c530-4a17-aab9-6cdb0976de49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83520002c1e14977a24ff6f647fd6bc5, user_id=54e2f40368d7483abd830f2096207e5d, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:42.155833 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11875271-c530-4a17-aab9-6cdb0976de49 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:42.157175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1072/2121] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:42 2022] PUT /identity/v3/projects/2cfa5138d43a4bd6bfcd6ff3563cce3f/users/2b1ed674b846444e9239d42e7ea03b53/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:42.157764 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c48846-e959-4822-b85e-73222f0de252 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:42.177478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1050/2122] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:42 2022] PUT /identity/v3/projects/83520002c1e14977a24ff6f647fd6bc5/users/54e2f40368d7483abd830f2096207e5d/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:42.178467 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11875271-c530-4a17-aab9-6cdb0976de49 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:42.269136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:42.320524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c48846-e959-4822-b85e-73222f0de252 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:42.340126 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11875271-c530-4a17-aab9-6cdb0976de49 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:42.350133 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba73f7-1629-42df-a125-d608aa28f278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:42.351181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba73f7-1629-42df-a125-d608aa28f278 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:42.351657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba73f7-1629-42df-a125-d608aa28f278 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:42.352041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba73f7-1629-42df-a125-d608aa28f278 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:42.353455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba73f7-1629-42df-a125-d608aa28f278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:42.358265 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba73f7-1629-42df-a125-d608aa28f278 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:42.406574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:42.426414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1051/2123] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:42 2022] POST /identity/v3/projects => generated 355 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:42.429163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f213ed-fdd6-4238-8228-57b195b2d13d None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:42.430181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f213ed-fdd6-4238-8228-57b195b2d13d None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:42.430653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f213ed-fdd6-4238-8228-57b195b2d13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:42.453721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e36917-3d6e-46ea-86d8-66b2decea195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:42.455175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e36917-3d6e-46ea-86d8-66b2decea195 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:42.455963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e36917-3d6e-46ea-86d8-66b2decea195 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:42.456534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e36917-3d6e-46ea-86d8-66b2decea195 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:42.457492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e36917-3d6e-46ea-86d8-66b2decea195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:42.457956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e36917-3d6e-46ea-86d8-66b2decea195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:42.459941 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e36917-3d6e-46ea-86d8-66b2decea195 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:42.467034 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-89f213ed-fdd6-4238-8228-57b195b2d13d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:42.469851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-89f213ed-fdd6-4238-8228-57b195b2d13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:42.477396 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1073/2124] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:09:42.479511 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b4786-4cd7-4a2c-8ddc-3d0deb5b8ed5 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:42.480101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b4786-4cd7-4a2c-8ddc-3d0deb5b8ed5 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:42.480624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b4786-4cd7-4a2c-8ddc-3d0deb5b8ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:42.524999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-126b4786-4cd7-4a2c-8ddc-3d0deb5b8ed5 None None] MFA Rules not processed for user `54e2f40368d7483abd830f2096207e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:42.527378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-126b4786-4cd7-4a2c-8ddc-3d0deb5b8ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:42.623907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1052/2125] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:42.624464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f213ed-fdd6-4238-8228-57b195b2d13d None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:42.659737 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f213ed-fdd6-4238-8228-57b195b2d13d None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:42.669902 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998650a-4a7e-4bb6-aaf5-a6cb7655e8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:42.670565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998650a-4a7e-4bb6-aaf5-a6cb7655e8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:42.671144 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998650a-4a7e-4bb6-aaf5-a6cb7655e8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:42.671144 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998650a-4a7e-4bb6-aaf5-a6cb7655e8f8 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:42.672046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998650a-4a7e-4bb6-aaf5-a6cb7655e8f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:42.674152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998650a-4a7e-4bb6-aaf5-a6cb7655e8f8 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:42.705276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1053/2126] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:42 2022] POST /identity/v3/users => generated 278 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:42.706455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998650a-4a7e-4bb6-aaf5-a6cb7655e8f8 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:42.710667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1074/2127] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:42.712625 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b4786-4cd7-4a2c-8ddc-3d0deb5b8ed5 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:42.714570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-126b4786-4cd7-4a2c-8ddc-3d0deb5b8ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:42.723219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998650a-4a7e-4bb6-aaf5-a6cb7655e8f8 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:42.728496 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078493e-0f42-4aa2-ba66-c5e629987307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:42.729116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078493e-0f42-4aa2-ba66-c5e629987307 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:42.729381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078493e-0f42-4aa2-ba66-c5e629987307 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:42.729647 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078493e-0f42-4aa2-ba66-c5e629987307 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:42.730281 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078493e-0f42-4aa2-ba66-c5e629987307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:42.732925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078493e-0f42-4aa2-ba66-c5e629987307 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:42.776936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1054/2128] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:42 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:42.776936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078493e-0f42-4aa2-ba66-c5e629987307 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:42.807684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b4786-4cd7-4a2c-8ddc-3d0deb5b8ed5 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:42.838850 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:42.877866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078493e-0f42-4aa2-ba66-c5e629987307 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:42.884115 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a8f07-475d-4f23-ba48-1e0751b2c526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:42.884792 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a8f07-475d-4f23-ba48-1e0751b2c526 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:42.885068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a8f07-475d-4f23-ba48-1e0751b2c526 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:42.885334 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a8f07-475d-4f23-ba48-1e0751b2c526 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:42.885989 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a8f07-475d-4f23-ba48-1e0751b2c526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:42.887824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c459fff-41d5-4a2d-ae3a-628f56b8c4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:42.888018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a8f07-475d-4f23-ba48-1e0751b2c526 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:42.888921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c459fff-41d5-4a2d-ae3a-628f56b8c4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:42.889211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c459fff-41d5-4a2d-ae3a-628f56b8c4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:42.889482 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c459fff-41d5-4a2d-ae3a-628f56b8c4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:42.900571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1055/2129] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:42.901446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a8f07-475d-4f23-ba48-1e0751b2c526 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:42.903766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c459fff-41d5-4a2d-ae3a-628f56b8c4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:42.905993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c459fff-41d5-4a2d-ae3a-628f56b8c4c2 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:42.928786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1075/2130] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:42.937759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c459fff-41d5-4a2d-ae3a-628f56b8c4c2 service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:42.959830 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c459fff-41d5-4a2d-ae3a-628f56b8c4c2 service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:42.982926 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b58188-1f99-4e1f-a01a-bdcdde6e0a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:42.987074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b58188-1f99-4e1f-a01a-bdcdde6e0a11 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:42.988090 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b58188-1f99-4e1f-a01a-bdcdde6e0a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:42.988090 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b58188-1f99-4e1f-a01a-bdcdde6e0a11 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:42.988638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b58188-1f99-4e1f-a01a-bdcdde6e0a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:42.990834 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b58188-1f99-4e1f-a01a-bdcdde6e0a11 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:43.025464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a8f07-475d-4f23-ba48-1e0751b2c526 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:43.031710 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b51b3-267e-4900-9508-91ba003ca49d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:43.032358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b51b3-267e-4900-9508-91ba003ca49d service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:43.032661 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b51b3-267e-4900-9508-91ba003ca49d service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:43.032929 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b51b3-267e-4900-9508-91ba003ca49d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:43.034800 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-9d2b51b3-267e-4900-9508-91ba003ca49d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:43.036281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1076/2131] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:42 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:43.037389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b58188-1f99-4e1f-a01a-bdcdde6e0a11 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:43.052799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:43.053398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b58188-1f99-4e1f-a01a-bdcdde6e0a11 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:43.066810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc496599-f1ac-4e30-a33a-c3d7a34dd8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:43.068289 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc496599-f1ac-4e30-a33a-c3d7a34dd8af admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:43.068782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc496599-f1ac-4e30-a33a-c3d7a34dd8af admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:43.069054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc496599-f1ac-4e30-a33a-c3d7a34dd8af admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:43.069733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc496599-f1ac-4e30-a33a-c3d7a34dd8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:43.074014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc496599-f1ac-4e30-a33a-c3d7a34dd8af admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:43.090141 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1077/2132] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:43.091205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc496599-f1ac-4e30-a33a-c3d7a34dd8af admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:43.111472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc496599-f1ac-4e30-a33a-c3d7a34dd8af admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:43.122758 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d074e8-951e-435e-bb5b-8a7f76ab5e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:43.123395 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d074e8-951e-435e-bb5b-8a7f76ab5e49 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:43.123677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d074e8-951e-435e-bb5b-8a7f76ab5e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:43.123949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d074e8-951e-435e-bb5b-8a7f76ab5e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:43.124637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d074e8-951e-435e-bb5b-8a7f76ab5e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:43.128985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d074e8-951e-435e-bb5b-8a7f76ab5e49 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:43.146909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b51b3-267e-4900-9508-91ba003ca49d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:43.148615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b51b3-267e-4900-9508-91ba003ca49d service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:43.162714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1078/2133] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:43.167158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d074e8-951e-435e-bb5b-8a7f76ab5e49 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:43.176272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1056/2134] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:43.178677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b51b3-267e-4900-9508-91ba003ca49d service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:43.183512 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d074e8-951e-435e-bb5b-8a7f76ab5e49 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:43.193357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d7c60-302e-4ac6-8d95-70edf58156fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:43.194345 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d7c60-302e-4ac6-8d95-70edf58156fe admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:43.194757 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d7c60-302e-4ac6-8d95-70edf58156fe admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:43.195190 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d7c60-302e-4ac6-8d95-70edf58156fe admin admin] PATH_INFO: `/v3/projects/2b227e684c0040a29300de14ce50dbb1/users/3dcd2197558c41268b5f6f6879a9588c/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:43.205316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b51b3-267e-4900-9508-91ba003ca49d service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:43.215926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65ce0f-1e5d-4ee8-8dfb-b843138ee174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:43.217068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65ce0f-1e5d-4ee8-8dfb-b843138ee174 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:43.217396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65ce0f-1e5d-4ee8-8dfb-b843138ee174 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:43.217669 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65ce0f-1e5d-4ee8-8dfb-b843138ee174 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:43.218943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65ce0f-1e5d-4ee8-8dfb-b843138ee174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:43.222404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d7c60-302e-4ac6-8d95-70edf58156fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b227e684c0040a29300de14ce50dbb1, user_id=3dcd2197558c41268b5f6f6879a9588c, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:43.222752 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65ce0f-1e5d-4ee8-8dfb-b843138ee174 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:43.227955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d7c60-302e-4ac6-8d95-70edf58156fe admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:43.248662 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1057/2135] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:43.251757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65ce0f-1e5d-4ee8-8dfb-b843138ee174 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:43.266342 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65ce0f-1e5d-4ee8-8dfb-b843138ee174 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:43.270038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1079/2136] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:43 2022] PUT /identity/v3/projects/2b227e684c0040a29300de14ce50dbb1/users/3dcd2197558c41268b5f6f6879a9588c/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:43.287351 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac91c6-a6de-44a4-985b-cfb24b1d96c2 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:43.288197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac91c6-a6de-44a4-985b-cfb24b1d96c2 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:43.288726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac91c6-a6de-44a4-985b-cfb24b1d96c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:43.360365 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c5c0c-8024-41f2-83bc-1f1cd26e4069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:43.360950 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-7eac91c6-a6de-44a4-985b-cfb24b1d96c2 None None] MFA Rules not processed for user `3dcd2197558c41268b5f6f6879a9588c`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:43.362273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c5c0c-8024-41f2-83bc-1f1cd26e4069 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:43.362694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c5c0c-8024-41f2-83bc-1f1cd26e4069 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:43.362808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7eac91c6-a6de-44a4-985b-cfb24b1d96c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:43.363310 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c5c0c-8024-41f2-83bc-1f1cd26e4069 admin admin] PATH_INFO: `/v3/projects/5b8428f702af4fcb85dd13f6e80324f0/users/6475d26f1df74a8f8c0434d959fc71ae/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:43.387826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c5c0c-8024-41f2-83bc-1f1cd26e4069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8428f702af4fcb85dd13f6e80324f0, user_id=6475d26f1df74a8f8c0434d959fc71ae, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:43.391644 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c5c0c-8024-41f2-83bc-1f1cd26e4069 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:43.422454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1058/2137] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:43 2022] PUT /identity/v3/projects/5b8428f702af4fcb85dd13f6e80324f0/users/6475d26f1df74a8f8c0434d959fc71ae/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:43.438327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b004f3-a8c4-4804-83d6-5c8ce7f7da9a None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:43.438773 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b004f3-a8c4-4804-83d6-5c8ce7f7da9a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:43.439151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b004f3-a8c4-4804-83d6-5c8ce7f7da9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:43.528587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-c5b004f3-a8c4-4804-83d6-5c8ce7f7da9a None None] MFA Rules not processed for user `6475d26f1df74a8f8c0434d959fc71ae`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:43.532760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c5b004f3-a8c4-4804-83d6-5c8ce7f7da9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:43.606988 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1080/2138] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:43.665444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1059/2139] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:43.670016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac91c6-a6de-44a4-985b-cfb24b1d96c2 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:43.690639 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b004f3-a8c4-4804-83d6-5c8ce7f7da9a None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:43.693266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c5b004f3-a8c4-4804-83d6-5c8ce7f7da9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:43.702991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac91c6-a6de-44a4-985b-cfb24b1d96c2 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:43.724606 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:43.826539 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:43.853821 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fec14-65ea-41ed-bc3a-1a452366a1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:43.854131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fec14-65ea-41ed-bc3a-1a452366a1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:43.854397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fec14-65ea-41ed-bc3a-1a452366a1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:43.854673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fec14-65ea-41ed-bc3a-1a452366a1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:43.855348 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fec14-65ea-41ed-bc3a-1a452366a1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:43.857460 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fec14-65ea-41ed-bc3a-1a452366a1e0 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:43.864983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b004f3-a8c4-4804-83d6-5c8ce7f7da9a None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:43.869769 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251160ba-af73-4682-b9ab-9a5105d81665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:43.870496 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251160ba-af73-4682-b9ab-9a5105d81665 service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:43.870899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251160ba-af73-4682-b9ab-9a5105d81665 service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:43.871167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251160ba-af73-4682-b9ab-9a5105d81665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:43.928521 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1081/2140] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:43 2022] POST /identity/v3/projects => generated 383 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:09:43.930775 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fec14-65ea-41ed-bc3a-1a452366a1e0 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:44.020888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251160ba-af73-4682-b9ab-9a5105d81665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:44.022602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251160ba-af73-4682-b9ab-9a5105d81665 service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:44.054427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1060/2141] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:44.071087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fec14-65ea-41ed-bc3a-1a452366a1e0 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:44.078378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8a4f8-14cf-45fc-bf55-ce41e31662d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:44.079496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8a4f8-14cf-45fc-bf55-ce41e31662d9 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:44.079967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8a4f8-14cf-45fc-bf55-ce41e31662d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:44.080527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8a4f8-14cf-45fc-bf55-ce41e31662d9 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:44.081378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8a4f8-14cf-45fc-bf55-ce41e31662d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:44.084117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8a4f8-14cf-45fc-bf55-ce41e31662d9 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:44.091743 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251160ba-af73-4682-b9ab-9a5105d81665 service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:44.117222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251160ba-af73-4682-b9ab-9a5105d81665 service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:44.139354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783a290-1597-4784-b651-43d77eb47cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:44.140313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783a290-1597-4784-b651-43d77eb47cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:44.140774 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783a290-1597-4784-b651-43d77eb47cff admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:44.141183 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783a290-1597-4784-b651-43d77eb47cff admin admin] PATH_INFO: `/v3/users/3dcd2197558c41268b5f6f6879a9588c` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:44.143774 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783a290-1597-4784-b651-43d77eb47cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dcd2197558c41268b5f6f6879a9588c)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:44.152645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1082/2142] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:43 2022] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:44.153346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8a4f8-14cf-45fc-bf55-ce41e31662d9 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:44.158873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783a290-1597-4784-b651-43d77eb47cff admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:44.172710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8a4f8-14cf-45fc-bf55-ce41e31662d9 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:44.183750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5c93d-a0c5-471a-b790-d262984927a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:44.184826 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5c93d-a0c5-471a-b790-d262984927a5 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:44.185306 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5c93d-a0c5-471a-b790-d262984927a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:44.185776 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5c93d-a0c5-471a-b790-d262984927a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:44.186918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5c93d-a0c5-471a-b790-d262984927a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:44.191045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5c93d-a0c5-471a-b790-d262984927a5 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:44.214807 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1083/2143] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:44.222897 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5c93d-a0c5-471a-b790-d262984927a5 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:44.253921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5c93d-a0c5-471a-b790-d262984927a5 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:44.260671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31642595-07ce-43f9-aeec-889d43844193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:44.261766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31642595-07ce-43f9-aeec-889d43844193 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:44.262310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31642595-07ce-43f9-aeec-889d43844193 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:44.262802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31642595-07ce-43f9-aeec-889d43844193 admin admin] PATH_INFO: `/v3/projects/d44528d7ad474dcbbdd2c178db966d36/users/832f994dc5c741f2b78d2af2cb6b4a66/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:44.281848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f783a290-1597-4784-b651-43d77eb47cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dcd2197558c41268b5f6f6879a9588c'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:44.283117 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f783a290-1597-4784-b651-43d77eb47cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dcd2197558c41268b5f6f6879a9588c'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:44.286235 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31642595-07ce-43f9-aeec-889d43844193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44528d7ad474dcbbdd2c178db966d36, user_id=832f994dc5c741f2b78d2af2cb6b4a66, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:44.290594 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31642595-07ce-43f9-aeec-889d43844193 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:44.302201 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f783a290-1597-4784-b651-43d77eb47cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dcd2197558c41268b5f6f6879a9588c'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:44.302901 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f783a290-1597-4784-b651-43d77eb47cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dcd2197558c41268b5f6f6879a9588c'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:44.312260 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f783a290-1597-4784-b651-43d77eb47cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dcd2197558c41268b5f6f6879a9588c'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:44.313506 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1084/2144] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:44 2022] PUT /identity/v3/projects/d44528d7ad474dcbbdd2c178db966d36/users/832f994dc5c741f2b78d2af2cb6b4a66/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:44.320390 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31642595-07ce-43f9-aeec-889d43844193 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:44.322827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-31642595-07ce-43f9-aeec-889d43844193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:44.369499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1061/2145] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:44 2022] DELETE /identity/v3/users/3dcd2197558c41268b5f6f6879a9588c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:44.376934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72869c33-7fa3-4806-8df9-4b513a1182e9 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:44.377736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72869c33-7fa3-4806-8df9-4b513a1182e9 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:44.378272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72869c33-7fa3-4806-8df9-4b513a1182e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:44.413186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-72869c33-7fa3-4806-8df9-4b513a1182e9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:44.415152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-72869c33-7fa3-4806-8df9-4b513a1182e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:44.430468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31642595-07ce-43f9-aeec-889d43844193 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:44.474747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:44.502140 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:44.520063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1062/2146] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:44.529048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addabf7b-8108-47e0-8e55-aa35b1d0b71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:44.530060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addabf7b-8108-47e0-8e55-aa35b1d0b71d admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:44.530741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addabf7b-8108-47e0-8e55-aa35b1d0b71d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:44.531182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addabf7b-8108-47e0-8e55-aa35b1d0b71d admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:44.532309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addabf7b-8108-47e0-8e55-aa35b1d0b71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:44.533840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72869c33-7fa3-4806-8df9-4b513a1182e9 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:44.535170 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addabf7b-8108-47e0-8e55-aa35b1d0b71d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:44.536013 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-72869c33-7fa3-4806-8df9-4b513a1182e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:44.550040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1085/2147] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:44.555580 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addabf7b-8108-47e0-8e55-aa35b1d0b71d admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:44.572262 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addabf7b-8108-47e0-8e55-aa35b1d0b71d admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:44.578515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c0b55-2f7e-4e49-bb48-f9c58f7e0d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:44.580901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c0b55-2f7e-4e49-bb48-f9c58f7e0d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:44.581430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c0b55-2f7e-4e49-bb48-f9c58f7e0d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:44.582600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c0b55-2f7e-4e49-bb48-f9c58f7e0d0d admin admin] PATH_INFO: `/v3/projects/d44528d7ad474dcbbdd2c178db966d36/users/832f994dc5c741f2b78d2af2cb6b4a66/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:44.586653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c0b55-2f7e-4e49-bb48-f9c58f7e0d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44528d7ad474dcbbdd2c178db966d36, user_id=832f994dc5c741f2b78d2af2cb6b4a66, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:44.592008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c0b55-2f7e-4e49-bb48-f9c58f7e0d0d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:44.607757 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1086/2148] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:44 2022] PUT /identity/v3/projects/d44528d7ad474dcbbdd2c178db966d36/users/832f994dc5c741f2b78d2af2cb6b4a66/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:44.618303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab0c5-bb68-4281-8631-9e587fdc9b14 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:44.618585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab0c5-bb68-4281-8631-9e587fdc9b14 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:44.618914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab0c5-bb68-4281-8631-9e587fdc9b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:44.635708 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72869c33-7fa3-4806-8df9-4b513a1182e9 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:44.650546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-629ab0c5-bb68-4281-8631-9e587fdc9b14 None None] MFA Rules not processed for user `832f994dc5c741f2b78d2af2cb6b4a66`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:44.651899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-629ab0c5-bb68-4281-8631-9e587fdc9b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:44.715292 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee103b-b701-42f9-be0c-c3079e37fc10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:44.716464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee103b-b701-42f9-be0c-c3079e37fc10 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:44.716852 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee103b-b701-42f9-be0c-c3079e37fc10 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:44.717851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee103b-b701-42f9-be0c-c3079e37fc10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:44.755296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1087/2149] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:44.767399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ab0c5-bb68-4281-8631-9e587fdc9b14 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:44.769213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-629ab0c5-bb68-4281-8631-9e587fdc9b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:44.841776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee103b-b701-42f9-be0c-c3079e37fc10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:44.844066 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee103b-b701-42f9-be0c-c3079e37fc10 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:44.863151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ab0c5-bb68-4281-8631-9e587fdc9b14 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:44.865320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1063/2150] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:44.872639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f1bba-e93d-486d-ab68-8c51eaa88d30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:44.873449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f1bba-e93d-486d-ab68-8c51eaa88d30 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:44.873734 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f1bba-e93d-486d-ab68-8c51eaa88d30 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:44.874012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f1bba-e93d-486d-ab68-8c51eaa88d30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:44.886944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f1bba-e93d-486d-ab68-8c51eaa88d30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:44.889664 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f1bba-e93d-486d-ab68-8c51eaa88d30 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:44.906548 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1088/2151] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:09:45.041042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee103b-b701-42f9-be0c-c3079e37fc10 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:45.042983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f9ee103b-b701-42f9-be0c-c3079e37fc10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:45.063398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee103b-b701-42f9-be0c-c3079e37fc10 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:45.067970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f376d8-5732-4f67-8275-e9433a255303 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:45.068650 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f376d8-5732-4f67-8275-e9433a255303 service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:45.069444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f376d8-5732-4f67-8275-e9433a255303 service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:45.069721 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f376d8-5732-4f67-8275-e9433a255303 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:45.072325 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d3f376d8-5732-4f67-8275-e9433a255303 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:45.130628 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:45.171966 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f376d8-5732-4f67-8275-e9433a255303 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:45.173527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f376d8-5732-4f67-8275-e9433a255303 service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:45.197578 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1064/2152] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:09:45.518563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f1bba-e93d-486d-ab68-8c51eaa88d30 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:45.534329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f1bba-e93d-486d-ab68-8c51eaa88d30 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:45.542119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edc3e7-c079-4351-afe6-3ad74ae62eba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:45.542750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edc3e7-c079-4351-afe6-3ad74ae62eba service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:45.543034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edc3e7-c079-4351-afe6-3ad74ae62eba service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:45.543312 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edc3e7-c079-4351-afe6-3ad74ae62eba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:45.545294 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e8edc3e7-c079-4351-afe6-3ad74ae62eba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:45.569873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f376d8-5732-4f67-8275-e9433a255303 service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:45.571374 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d3f376d8-5732-4f67-8275-e9433a255303 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:45.612346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f376d8-5732-4f67-8275-e9433a255303 service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:45.643129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c0275-ee03-49bd-8098-449d99916018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:45.643695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c0275-ee03-49bd-8098-449d99916018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:45.643987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c0275-ee03-49bd-8098-449d99916018 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:45.644270 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c0275-ee03-49bd-8098-449d99916018 admin admin] PATH_INFO: `/v3/projects/2b227e684c0040a29300de14ce50dbb1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:45.646413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c0275-ee03-49bd-8098-449d99916018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b227e684c0040a29300de14ce50dbb1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:45.648495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c0275-ee03-49bd-8098-449d99916018 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:45.710179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:45.740683 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edc3e7-c079-4351-afe6-3ad74ae62eba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:45.742370 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edc3e7-c079-4351-afe6-3ad74ae62eba service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:45.771667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1089/2153] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:45.789787 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ab7c0275-ee03-49bd-8098-449d99916018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b227e684c0040a29300de14ce50dbb1', 'request_id': 'req-ab7c0275-ee03-49bd-8098-449d99916018'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:45.805975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ab7c0275-ee03-49bd-8098-449d99916018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b227e684c0040a29300de14ce50dbb1', 'request_id': 'req-ab7c0275-ee03-49bd-8098-449d99916018'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:45.814512 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ab7c0275-ee03-49bd-8098-449d99916018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b227e684c0040a29300de14ce50dbb1', 'request_id': 'req-ab7c0275-ee03-49bd-8098-449d99916018'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:45.847241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ab7c0275-ee03-49bd-8098-449d99916018 admin admin] The token cache is being invalidate because project 2b227e684c0040a29300de14ce50dbb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:45.847541 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ab7c0275-ee03-49bd-8098-449d99916018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:45.848282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ab7c0275-ee03-49bd-8098-449d99916018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:45.855493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1065/2154] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:45 2022] DELETE /identity/v3/projects/2b227e684c0040a29300de14ce50dbb1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:45.860215 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f61cc-2ee5-43e2-98ad-07412e88d671 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:45.860215 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f61cc-2ee5-43e2-98ad-07412e88d671 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:45.860215 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f61cc-2ee5-43e2-98ad-07412e88d671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:45.905960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-c40f61cc-2ee5-43e2-98ad-07412e88d671 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:45.907407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c40f61cc-2ee5-43e2-98ad-07412e88d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:46.080928 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1090/2155] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:46.089908 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68d657-e85d-4ffd-b208-7399adff3894 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:46.090190 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68d657-e85d-4ffd-b208-7399adff3894 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:46.090521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68d657-e85d-4ffd-b208-7399adff3894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:46.145508 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ab68d657-e85d-4ffd-b208-7399adff3894 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:46.146782 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ab68d657-e85d-4ffd-b208-7399adff3894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:46.176051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1066/2156] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:46.176396 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f61cc-2ee5-43e2-98ad-07412e88d671 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:46.191478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f61cc-2ee5-43e2-98ad-07412e88d671 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:46.202657 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7abcb-197f-4811-86fc-a17692a7f93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:46.203299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7abcb-197f-4811-86fc-a17692a7f93c admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:46.203934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7abcb-197f-4811-86fc-a17692a7f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:46.203934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7abcb-197f-4811-86fc-a17692a7f93c admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:46.204535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7abcb-197f-4811-86fc-a17692a7f93c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:46.204844 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7abcb-197f-4811-86fc-a17692a7f93c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:46.206496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7abcb-197f-4811-86fc-a17692a7f93c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:46.226000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1091/2157] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:09:46.232321 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68d657-e85d-4ffd-b208-7399adff3894 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:46.245720 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68d657-e85d-4ffd-b208-7399adff3894 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:46.268340 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292526b9-b91b-40b3-b3ea-8b1954af0194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:46.269881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292526b9-b91b-40b3-b3ea-8b1954af0194 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:46.270213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292526b9-b91b-40b3-b3ea-8b1954af0194 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:46.270670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292526b9-b91b-40b3-b3ea-8b1954af0194 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:46.271417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292526b9-b91b-40b3-b3ea-8b1954af0194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:46.278958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292526b9-b91b-40b3-b3ea-8b1954af0194 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:46.303596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7abcb-197f-4811-86fc-a17692a7f93c admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:46.306959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-2ec7abcb-197f-4811-86fc-a17692a7f93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:46.334274 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1067/2158] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:46 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:09:46.335814 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292526b9-b91b-40b3-b3ea-8b1954af0194 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:46.343297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7abcb-197f-4811-86fc-a17692a7f93c admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:46.477640 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc350e08-177c-4184-a0ea-7c0b60a45927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:46.478368 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350e08-177c-4184-a0ea-7c0b60a45927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:46.478649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350e08-177c-4184-a0ea-7c0b60a45927 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:46.478925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350e08-177c-4184-a0ea-7c0b60a45927 admin admin] PATH_INFO: `/v3/users/6475d26f1df74a8f8c0434d959fc71ae` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:46.481264 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc350e08-177c-4184-a0ea-7c0b60a45927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6475d26f1df74a8f8c0434d959fc71ae)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:46.484253 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc350e08-177c-4184-a0ea-7c0b60a45927 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:46.545719 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292526b9-b91b-40b3-b3ea-8b1954af0194 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:46.563596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab547ac7-918c-4181-8192-f4a0eb5dfe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:46.565079 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab547ac7-918c-4181-8192-f4a0eb5dfe77 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:46.565381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab547ac7-918c-4181-8192-f4a0eb5dfe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:46.565630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab547ac7-918c-4181-8192-f4a0eb5dfe77 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:46.566379 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab547ac7-918c-4181-8192-f4a0eb5dfe77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:46.573949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab547ac7-918c-4181-8192-f4a0eb5dfe77 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:46.619233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-bc350e08-177c-4184-a0ea-7c0b60a45927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6475d26f1df74a8f8c0434d959fc71ae'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:46.620616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-bc350e08-177c-4184-a0ea-7c0b60a45927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6475d26f1df74a8f8c0434d959fc71ae'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:46.635623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1068/2159] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:46 2022] POST /identity/v3/users => generated 292 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:46.637441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab547ac7-918c-4181-8192-f4a0eb5dfe77 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:46.641816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-bc350e08-177c-4184-a0ea-7c0b60a45927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6475d26f1df74a8f8c0434d959fc71ae'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:46.645263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ab547ac7-918c-4181-8192-f4a0eb5dfe77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:46.667175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab547ac7-918c-4181-8192-f4a0eb5dfe77 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:46.677959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77f732-82d6-42ab-961e-a015c9143789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:46.678592 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77f732-82d6-42ab-961e-a015c9143789 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:46.678950 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77f732-82d6-42ab-961e-a015c9143789 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:46.679448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77f732-82d6-42ab-961e-a015c9143789 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:46.680129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77f732-82d6-42ab-961e-a015c9143789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:46.682793 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77f732-82d6-42ab-961e-a015c9143789 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:46.688748 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-bc350e08-177c-4184-a0ea-7c0b60a45927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6475d26f1df74a8f8c0434d959fc71ae'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:46.698949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1069/2160] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:46.699606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:46.700590 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77f732-82d6-42ab-961e-a015c9143789 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:46.712598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-bc350e08-177c-4184-a0ea-7c0b60a45927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6475d26f1df74a8f8c0434d959fc71ae'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:46.736991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1092/2161] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:46 2022] DELETE /identity/v3/users/6475d26f1df74a8f8c0434d959fc71ae => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:46.741945 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77f732-82d6-42ab-961e-a015c9143789 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:46.743903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6810dd-403f-4a0d-8593-95faa108b735 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:46.743903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6810dd-403f-4a0d-8593-95faa108b735 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:46.744509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6810dd-403f-4a0d-8593-95faa108b735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:46.788345 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-df6810dd-403f-4a0d-8593-95faa108b735 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:46.790484 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-df6810dd-403f-4a0d-8593-95faa108b735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:46.791047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:46.880045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1093/2162] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:46.928296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6810dd-403f-4a0d-8593-95faa108b735 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:46.931287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-df6810dd-403f-4a0d-8593-95faa108b735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:47.004647 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6592e-6652-4027-a951-48a46e83cafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:47.005822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6592e-6652-4027-a951-48a46e83cafa admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:47.006400 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6592e-6652-4027-a951-48a46e83cafa admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:47.006956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6592e-6652-4027-a951-48a46e83cafa admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:47.008242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6592e-6652-4027-a951-48a46e83cafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:47.015461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6592e-6652-4027-a951-48a46e83cafa admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:47.047754 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1070/2163] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:47.049429 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6592e-6652-4027-a951-48a46e83cafa admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:47.060986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-27a6592e-6652-4027-a951-48a46e83cafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:47.078756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6810dd-403f-4a0d-8593-95faa108b735 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:47.085338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba57d7f-1fed-4b98-8b9d-42fb55413b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:47.085979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba57d7f-1fed-4b98-8b9d-42fb55413b29 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:47.086256 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba57d7f-1fed-4b98-8b9d-42fb55413b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:47.086525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba57d7f-1fed-4b98-8b9d-42fb55413b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:47.100586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba57d7f-1fed-4b98-8b9d-42fb55413b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:47.102060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba57d7f-1fed-4b98-8b9d-42fb55413b29 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:47.114794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1094/2164] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:47.115716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba57d7f-1fed-4b98-8b9d-42fb55413b29 service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:47.127593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba57d7f-1fed-4b98-8b9d-42fb55413b29 service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:47.132782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b813df8-04e8-4b6d-91db-2c2defe33044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:47.133468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b813df8-04e8-4b6d-91db-2c2defe33044 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:47.134391 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b813df8-04e8-4b6d-91db-2c2defe33044 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:47.134522 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b813df8-04e8-4b6d-91db-2c2defe33044 admin admin] PATH_INFO: `/v3/projects/750029f186014827bcf5b332d61d8b02/users/564e35cfb0694b839ccad10f30510c9c/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:47.162259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b813df8-04e8-4b6d-91db-2c2defe33044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750029f186014827bcf5b332d61d8b02, user_id=564e35cfb0694b839ccad10f30510c9c, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:47.167568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b813df8-04e8-4b6d-91db-2c2defe33044 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:47.204844 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1095/2165] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:47 2022] PUT /identity/v3/projects/750029f186014827bcf5b332d61d8b02/users/564e35cfb0694b839ccad10f30510c9c/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:47.210624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf848b5f-ddc0-48ed-ab1f-65d2398393fc None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:47.210624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf848b5f-ddc0-48ed-ab1f-65d2398393fc None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:47.211056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf848b5f-ddc0-48ed-ab1f-65d2398393fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:47.257880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6592e-6652-4027-a951-48a46e83cafa admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:47.301810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-bf848b5f-ddc0-48ed-ab1f-65d2398393fc None None] MFA Rules not processed for user `564e35cfb0694b839ccad10f30510c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:47.305503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-bf848b5f-ddc0-48ed-ab1f-65d2398393fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:47.442641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003f1b3-b42a-4034-9927-aabd84f8ae7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:47.446164 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003f1b3-b42a-4034-9927-aabd84f8ae7e service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:47.452725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003f1b3-b42a-4034-9927-aabd84f8ae7e service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:47.455415 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003f1b3-b42a-4034-9927-aabd84f8ae7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:47.463470 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c003f1b3-b42a-4034-9927-aabd84f8ae7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:47.495582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1096/2166] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:47.502468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf848b5f-ddc0-48ed-ab1f-65d2398393fc None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:47.518311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:47.691145 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf848b5f-ddc0-48ed-ab1f-65d2398393fc None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:47.701201 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003f1b3-b42a-4034-9927-aabd84f8ae7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:47.705107 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003f1b3-b42a-4034-9927-aabd84f8ae7e service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:47.719208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e330d0f-febf-427c-9ccd-6e15c6af063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:47.719868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e330d0f-febf-427c-9ccd-6e15c6af063b admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:47.720151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e330d0f-febf-427c-9ccd-6e15c6af063b admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:47.720442 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e330d0f-febf-427c-9ccd-6e15c6af063b admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:47.721117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e330d0f-febf-427c-9ccd-6e15c6af063b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:47.723121 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e330d0f-febf-427c-9ccd-6e15c6af063b admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:47.728310 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1071/2167] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:47.818252 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1097/2168] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:47 2022] POST /identity/v3/projects => generated 385 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:09:47.819608 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003f1b3-b42a-4034-9927-aabd84f8ae7e service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:47.831012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003f1b3-b42a-4034-9927-aabd84f8ae7e service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:47.853263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:47.957454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882352c-8902-4f05-895b-38d7a58a67da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:47.958350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882352c-8902-4f05-895b-38d7a58a67da admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:47.961761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882352c-8902-4f05-895b-38d7a58a67da admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:47.961917 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882352c-8902-4f05-895b-38d7a58a67da admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:47.962740 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882352c-8902-4f05-895b-38d7a58a67da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:47.974185 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e330d0f-febf-427c-9ccd-6e15c6af063b admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:47.974385 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882352c-8902-4f05-895b-38d7a58a67da admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:47.975697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-3e330d0f-febf-427c-9ccd-6e15c6af063b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:48.010734 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e330d0f-febf-427c-9ccd-6e15c6af063b admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:48.020973 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:48.022475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:48.022475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:48.022475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd admin admin] PATH_INFO: `/v3/projects/5b8428f702af4fcb85dd13f6e80324f0` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:48.023736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b8428f702af4fcb85dd13f6e80324f0)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:48.026688 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:48.030968 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1072/2169] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:47 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:48.036966 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882352c-8902-4f05-895b-38d7a58a67da admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:48.050530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882352c-8902-4f05-895b-38d7a58a67da admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:48.066689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf137e6-ecae-4f8e-8e4d-efa823773a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:48.067430 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf137e6-ecae-4f8e-8e4d-efa823773a7d admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:48.067837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf137e6-ecae-4f8e-8e4d-efa823773a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:48.069070 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf137e6-ecae-4f8e-8e4d-efa823773a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:48.069547 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf137e6-ecae-4f8e-8e4d-efa823773a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:48.073950 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf137e6-ecae-4f8e-8e4d-efa823773a7d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:48.100966 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1073/2170] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:09:48.107410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf137e6-ecae-4f8e-8e4d-efa823773a7d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:48.134622 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf137e6-ecae-4f8e-8e4d-efa823773a7d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:48.142419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b8428f702af4fcb85dd13f6e80324f0', 'request_id': 'req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:48.151106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b8428f702af4fcb85dd13f6e80324f0', 'request_id': 'req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:48.158218 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b8428f702af4fcb85dd13f6e80324f0', 'request_id': 'req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:48.174704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd admin admin] The token cache is being invalidate because project 5b8428f702af4fcb85dd13f6e80324f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:48.175154 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:48.176071 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:48.181455 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1098/2171] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:47 2022] DELETE /identity/v3/projects/5b8428f702af4fcb85dd13f6e80324f0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:48.183375 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:48.185325 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:48.251110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718196a-3830-4f41-b8a6-7d9556bba3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:48.251750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718196a-3830-4f41-b8a6-7d9556bba3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:48.254703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718196a-3830-4f41-b8a6-7d9556bba3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:48.255089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718196a-3830-4f41-b8a6-7d9556bba3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:48.255794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718196a-3830-4f41-b8a6-7d9556bba3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:48.263578 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718196a-3830-4f41-b8a6-7d9556bba3b0 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:48.291786 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1074/2172] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:48.296023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718196a-3830-4f41-b8a6-7d9556bba3b0 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:48.310821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6718196a-3830-4f41-b8a6-7d9556bba3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:48.317791 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b36b5-ee4a-40d4-9192-f8d348a187fd admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:48.325828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c6606-d0f0-4259-8255-170ae4bc93de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:48.326499 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c6606-d0f0-4259-8255-170ae4bc93de admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:48.326781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c6606-d0f0-4259-8255-170ae4bc93de admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:48.327055 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c6606-d0f0-4259-8255-170ae4bc93de admin admin] PATH_INFO: `/v3/users/832f994dc5c741f2b78d2af2cb6b4a66` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:48.327512 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718196a-3830-4f41-b8a6-7d9556bba3b0 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:48.328254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c6606-d0f0-4259-8255-170ae4bc93de admin admin] RBAC: Authorizing `identity:delete_user(user_id=832f994dc5c741f2b78d2af2cb6b4a66)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:48.330448 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c6606-d0f0-4259-8255-170ae4bc93de admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:48.333160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbe33f-ac35-4274-8871-871eedb3af9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:48.334125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbe33f-ac35-4274-8871-871eedb3af9a admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:48.334987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbe33f-ac35-4274-8871-871eedb3af9a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:48.335677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbe33f-ac35-4274-8871-871eedb3af9a admin admin] PATH_INFO: `/v3/projects/36ab7e3ac2ea4086bd58178748e72322/users/0f90081aa2014d158f7050e59fe99366/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:48.352777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:48.359634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbe33f-ac35-4274-8871-871eedb3af9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ab7e3ac2ea4086bd58178748e72322, user_id=0f90081aa2014d158f7050e59fe99366, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:48.362736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbe33f-ac35-4274-8871-871eedb3af9a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:48.392117 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1075/2173] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:48 2022] PUT /identity/v3/projects/36ab7e3ac2ea4086bd58178748e72322/users/0f90081aa2014d158f7050e59fe99366/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:48.406668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36d45-0e5a-45f1-b453-48032da90d9b None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:48.407129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36d45-0e5a-45f1-b453-48032da90d9b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:48.407534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36d45-0e5a-45f1-b453-48032da90d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:48.416552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-828c6606-d0f0-4259-8255-170ae4bc93de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832f994dc5c741f2b78d2af2cb6b4a66'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:48.422176 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-828c6606-d0f0-4259-8255-170ae4bc93de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832f994dc5c741f2b78d2af2cb6b4a66'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:48.440918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-828c6606-d0f0-4259-8255-170ae4bc93de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832f994dc5c741f2b78d2af2cb6b4a66'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:48.455742 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-3bb36d45-0e5a-45f1-b453-48032da90d9b None None] MFA Rules not processed for user `0f90081aa2014d158f7050e59fe99366`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:48.457290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3bb36d45-0e5a-45f1-b453-48032da90d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:48.465200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-828c6606-d0f0-4259-8255-170ae4bc93de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832f994dc5c741f2b78d2af2cb6b4a66'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:48.480765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-828c6606-d0f0-4259-8255-170ae4bc93de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832f994dc5c741f2b78d2af2cb6b4a66'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:48.494270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1099/2174] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:48 2022] DELETE /identity/v3/users/832f994dc5c741f2b78d2af2cb6b4a66 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:48.544462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:48.562187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c6606-d0f0-4259-8255-170ae4bc93de admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:48.564050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-828c6606-d0f0-4259-8255-170ae4bc93de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:48.564697 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1076/2175] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:09:48.732512 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c6606-d0f0-4259-8255-170ae4bc93de admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:48.756637 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d46964-a3fe-4ff4-97f5-3188d23b0e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:48.757477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d46964-a3fe-4ff4-97f5-3188d23b0e2b admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:48.758003 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d46964-a3fe-4ff4-97f5-3188d23b0e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:48.758629 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d46964-a3fe-4ff4-97f5-3188d23b0e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:48.761059 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d46964-a3fe-4ff4-97f5-3188d23b0e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:48.769855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d46964-a3fe-4ff4-97f5-3188d23b0e2b admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:48.848416 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1100/2176] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:48 2022] POST /identity/v3/projects => generated 385 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:48.852617 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb36d45-0e5a-45f1-b453-48032da90d9b None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:49.011442 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb36d45-0e5a-45f1-b453-48032da90d9b None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:49.148982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e9471-f586-4d78-bf23-165c8c274ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:49.149917 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e9471-f586-4d78-bf23-165c8c274ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:49.150472 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e9471-f586-4d78-bf23-165c8c274ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:49.150815 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e9471-f586-4d78-bf23-165c8c274ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:49.151417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e9471-f586-4d78-bf23-165c8c274ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:49.153557 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e9471-f586-4d78-bf23-165c8c274ce2 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:49.193308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1077/2177] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:48 2022] POST /identity/v3/users => generated 299 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:49.198404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d46964-a3fe-4ff4-97f5-3188d23b0e2b admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:49.219505 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d46964-a3fe-4ff4-97f5-3188d23b0e2b admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:49.220880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e9471-f586-4d78-bf23-165c8c274ce2 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:49.230387 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ef3e9471-f586-4d78-bf23-165c8c274ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:49.234313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f2acb-6fdb-4324-a721-827a99a7031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:49.234946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2acb-6fdb-4324-a721-827a99a7031e admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:49.235452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2acb-6fdb-4324-a721-827a99a7031e admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:49.235725 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2acb-6fdb-4324-a721-827a99a7031e admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:49.236421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f2acb-6fdb-4324-a721-827a99a7031e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:49.238165 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f2acb-6fdb-4324-a721-827a99a7031e admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:49.257123 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e9471-f586-4d78-bf23-165c8c274ce2 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:49.262661 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1101/2178] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:49.264995 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d004b0-efbb-4273-9f00-98a6e61607d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:49.266623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d004b0-efbb-4273-9f00-98a6e61607d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:49.267482 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d004b0-efbb-4273-9f00-98a6e61607d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:49.267597 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f2acb-6fdb-4324-a721-827a99a7031e admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:49.269796 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d004b0-efbb-4273-9f00-98a6e61607d5 admin admin] PATH_INFO: `/v3/projects/d44528d7ad474dcbbdd2c178db966d36` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:49.272622 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d004b0-efbb-4273-9f00-98a6e61607d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d44528d7ad474dcbbdd2c178db966d36)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:49.275677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d004b0-efbb-4273-9f00-98a6e61607d5 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:49.299069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f2acb-6fdb-4324-a721-827a99a7031e admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:49.326271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6a3f1-bed6-4846-ad2c-13cea444218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:49.326271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6a3f1-bed6-4846-ad2c-13cea444218e admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:49.326630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6a3f1-bed6-4846-ad2c-13cea444218e admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:49.327413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6a3f1-bed6-4846-ad2c-13cea444218e admin admin] PATH_INFO: `/v3/projects/bfc2e40838e14e60b0893a7e8b43d27d/users/b2336127dc83490f932ddfdaa3346fb4/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:49.386239 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6a3f1-bed6-4846-ad2c-13cea444218e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc2e40838e14e60b0893a7e8b43d27d, user_id=b2336127dc83490f932ddfdaa3346fb4, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:49.390099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6a3f1-bed6-4846-ad2c-13cea444218e admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:49.437117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1102/2179] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:49 2022] PUT /identity/v3/projects/bfc2e40838e14e60b0893a7e8b43d27d/users/b2336127dc83490f932ddfdaa3346fb4/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:09:49.440950 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-23d004b0-efbb-4273-9f00-98a6e61607d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd44528d7ad474dcbbdd2c178db966d36', 'request_id': 'req-23d004b0-efbb-4273-9f00-98a6e61607d5'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:49.442059 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6a3f1-bed6-4846-ad2c-13cea444218e admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:49.463419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-23d004b0-efbb-4273-9f00-98a6e61607d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd44528d7ad474dcbbdd2c178db966d36', 'request_id': 'req-23d004b0-efbb-4273-9f00-98a6e61607d5'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:49.486882 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-23d004b0-efbb-4273-9f00-98a6e61607d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd44528d7ad474dcbbdd2c178db966d36', 'request_id': 'req-23d004b0-efbb-4273-9f00-98a6e61607d5'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:49.554988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-23d004b0-efbb-4273-9f00-98a6e61607d5 admin admin] The token cache is being invalidate because project d44528d7ad474dcbbdd2c178db966d36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:49.555448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-23d004b0-efbb-4273-9f00-98a6e61607d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:49.557084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-23d004b0-efbb-4273-9f00-98a6e61607d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:49.567261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1078/2180] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:49 2022] DELETE /identity/v3/projects/d44528d7ad474dcbbdd2c178db966d36 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:49.568315 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b1691-55c9-4c7b-831e-6a5a0ba429da None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:49.568625 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b1691-55c9-4c7b-831e-6a5a0ba429da None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:49.568894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b1691-55c9-4c7b-831e-6a5a0ba429da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:49.579240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:49.621073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-528b1691-55c9-4c7b-831e-6a5a0ba429da None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:49.622743 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-528b1691-55c9-4c7b-831e-6a5a0ba429da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:49.630951 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6a3f1-bed6-4846-ad2c-13cea444218e admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:49.646090 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f70aa5-115a-448f-a57a-0e459ff1efe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:49.647849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f70aa5-115a-448f-a57a-0e459ff1efe7 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:49.649683 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f70aa5-115a-448f-a57a-0e459ff1efe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:49.651575 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1079/2181] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:49.652256 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f70aa5-115a-448f-a57a-0e459ff1efe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:49.653585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f70aa5-115a-448f-a57a-0e459ff1efe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:49.657563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f70aa5-115a-448f-a57a-0e459ff1efe7 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:49.661530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a53d1-b28a-48ad-a0b8-4fc32576998e None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:49.662420 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a53d1-b28a-48ad-a0b8-4fc32576998e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:49.663077 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a53d1-b28a-48ad-a0b8-4fc32576998e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:49.692102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1103/2182] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:49.693530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f70aa5-115a-448f-a57a-0e459ff1efe7 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:49.697491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b9f70aa5-115a-448f-a57a-0e459ff1efe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:49.726860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f70aa5-115a-448f-a57a-0e459ff1efe7 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:49.731554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-e03a53d1-b28a-48ad-a0b8-4fc32576998e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:49.732840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-e03a53d1-b28a-48ad-a0b8-4fc32576998e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:49.734193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897730b0-d418-495b-bb74-a3d395bf7d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:49.735448 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897730b0-d418-495b-bb74-a3d395bf7d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:49.736038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897730b0-d418-495b-bb74-a3d395bf7d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:49.736429 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897730b0-d418-495b-bb74-a3d395bf7d99 admin admin] PATH_INFO: `/v3/projects/bfc2e40838e14e60b0893a7e8b43d27d/users/b2336127dc83490f932ddfdaa3346fb4/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:49.739552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897730b0-d418-495b-bb74-a3d395bf7d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc2e40838e14e60b0893a7e8b43d27d, user_id=b2336127dc83490f932ddfdaa3346fb4, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:49.743550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897730b0-d418-495b-bb74-a3d395bf7d99 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:49.754836 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1080/2183] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:09:49.759285 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a53d1-b28a-48ad-a0b8-4fc32576998e None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:49.760263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1104/2184] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:49 2022] PUT /identity/v3/projects/bfc2e40838e14e60b0893a7e8b43d27d/users/b2336127dc83490f932ddfdaa3346fb4/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:49.769566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:49.774454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59434d5d-b9e6-4965-bedb-98e56fad72c7 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:49.775114 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59434d5d-b9e6-4965-bedb-98e56fad72c7 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:49.775676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59434d5d-b9e6-4965-bedb-98e56fad72c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:49.780723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a53d1-b28a-48ad-a0b8-4fc32576998e None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:49.827877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-59434d5d-b9e6-4965-bedb-98e56fad72c7 None None] MFA Rules not processed for user `b2336127dc83490f932ddfdaa3346fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:49.829301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-59434d5d-b9e6-4965-bedb-98e56fad72c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:49.917526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a50074-9691-4ed1-844d-c8294a472cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:49.919282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a50074-9691-4ed1-844d-c8294a472cec admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:49.919719 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a50074-9691-4ed1-844d-c8294a472cec admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:49.920168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a50074-9691-4ed1-844d-c8294a472cec admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:49.921656 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a50074-9691-4ed1-844d-c8294a472cec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:49.922224 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a50074-9691-4ed1-844d-c8294a472cec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:49.925342 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a50074-9691-4ed1-844d-c8294a472cec admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:49.945881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1081/2185] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:09:49.951095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a50074-9691-4ed1-844d-c8294a472cec admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:49.968605 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a50074-9691-4ed1-844d-c8294a472cec admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:49.976558 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0df2d-71c1-4421-bc62-4d34d65dccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:49.978076 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0df2d-71c1-4421-bc62-4d34d65dccca admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:49.978799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0df2d-71c1-4421-bc62-4d34d65dccca admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:49.979270 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0df2d-71c1-4421-bc62-4d34d65dccca admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:49.980679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0df2d-71c1-4421-bc62-4d34d65dccca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:49.983943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0df2d-71c1-4421-bc62-4d34d65dccca admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:50.048802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1105/2186] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:50.055245 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1082/2187] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:49 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:50.060366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59434d5d-b9e6-4965-bedb-98e56fad72c7 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:50.061712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0df2d-71c1-4421-bc62-4d34d65dccca admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:50.064563 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-aab0df2d-71c1-4421-bc62-4d34d65dccca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:50.094312 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59434d5d-b9e6-4965-bedb-98e56fad72c7 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:50.232176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0df2d-71c1-4421-bc62-4d34d65dccca admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:50.238159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a3394-ea43-450b-9d75-92ff64c70107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:50.239257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a3394-ea43-450b-9d75-92ff64c70107 service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:50.239610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a3394-ea43-450b-9d75-92ff64c70107 service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:50.240036 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a3394-ea43-450b-9d75-92ff64c70107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:50.243154 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6a0a3394-ea43-450b-9d75-92ff64c70107 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:50.245091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45e84d-5156-4a5c-8572-e6c3c9a3864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:50.245725 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45e84d-5156-4a5c-8572-e6c3c9a3864f admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:50.246120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45e84d-5156-4a5c-8572-e6c3c9a3864f admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:50.246278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45e84d-5156-4a5c-8572-e6c3c9a3864f admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:50.247026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45e84d-5156-4a5c-8572-e6c3c9a3864f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:50.250044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45e84d-5156-4a5c-8572-e6c3c9a3864f admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:50.285605 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1106/2188] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:50 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:50.288109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45e84d-5156-4a5c-8572-e6c3c9a3864f admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:50.303912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45e84d-5156-4a5c-8572-e6c3c9a3864f admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:50.311825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e354dc7-d9e0-46d3-9704-2453073bc173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:50.312759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e354dc7-d9e0-46d3-9704-2453073bc173 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:50.313138 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e354dc7-d9e0-46d3-9704-2453073bc173 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:50.313581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e354dc7-d9e0-46d3-9704-2453073bc173 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:50.314611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e354dc7-d9e0-46d3-9704-2453073bc173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:50.316772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e354dc7-d9e0-46d3-9704-2453073bc173 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:50.331091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1107/2189] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:09:50.337584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e354dc7-d9e0-46d3-9704-2453073bc173 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:50.352876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e354dc7-d9e0-46d3-9704-2453073bc173 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:50.362076 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057d44f-b1aa-4268-9626-a111ffe314e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:50.362076 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057d44f-b1aa-4268-9626-a111ffe314e9 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:50.362076 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057d44f-b1aa-4268-9626-a111ffe314e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:50.362076 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057d44f-b1aa-4268-9626-a111ffe314e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:50.362783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057d44f-b1aa-4268-9626-a111ffe314e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:50.365215 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057d44f-b1aa-4268-9626-a111ffe314e9 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:50.377717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1108/2190] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:09:50.383164 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057d44f-b1aa-4268-9626-a111ffe314e9 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:50.411155 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a3394-ea43-450b-9d75-92ff64c70107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:50.414859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057d44f-b1aa-4268-9626-a111ffe314e9 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:50.415210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a3394-ea43-450b-9d75-92ff64c70107 service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:50.427475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70ee1b-dcee-4b82-9c7b-ce5d4df3cfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:50.428533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70ee1b-dcee-4b82-9c7b-ce5d4df3cfee admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:50.431141 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70ee1b-dcee-4b82-9c7b-ce5d4df3cfee admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:50.431726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70ee1b-dcee-4b82-9c7b-ce5d4df3cfee admin admin] PATH_INFO: `/v3/projects/8fab585d703a41cd9f24faa22ca630c6/users/787e03cbac0941fc9775f3953e7ffa75/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:50.439689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1083/2191] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:50.456919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70ee1b-dcee-4b82-9c7b-ce5d4df3cfee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fab585d703a41cd9f24faa22ca630c6, user_id=787e03cbac0941fc9775f3953e7ffa75, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:50.460452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70ee1b-dcee-4b82-9c7b-ce5d4df3cfee admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:50.463367 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:50.492663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1109/2192] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:50 2022] PUT /identity/v3/projects/8fab585d703a41cd9f24faa22ca630c6/users/787e03cbac0941fc9775f3953e7ffa75/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:50.508480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617ce14-8801-4e32-9c56-ad7a818766a5 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:50.508869 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617ce14-8801-4e32-9c56-ad7a818766a5 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:50.509242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617ce14-8801-4e32-9c56-ad7a818766a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:50.583514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-8617ce14-8801-4e32-9c56-ad7a818766a5 None None] MFA Rules not processed for user `787e03cbac0941fc9775f3953e7ffa75`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:50.589789 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-8617ce14-8801-4e32-9c56-ad7a818766a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:50.669567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:50.891029 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1084/2193] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:50.906342 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70ee1b-dcee-4b82-9c7b-ce5d4df3cfee admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:50.912293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9f70ee1b-dcee-4b82-9c7b-ce5d4df3cfee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:51.041034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70ee1b-dcee-4b82-9c7b-ce5d4df3cfee admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:51.060927 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5ad9c-cc6f-4cac-8547-606074cacfec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:51.062545 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5ad9c-cc6f-4cac-8547-606074cacfec service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:51.062833 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5ad9c-cc6f-4cac-8547-606074cacfec service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:51.063235 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5ad9c-cc6f-4cac-8547-606074cacfec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:51.098630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5ad9c-cc6f-4cac-8547-606074cacfec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:51.100537 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5ad9c-cc6f-4cac-8547-606074cacfec service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:51.123465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1110/2194] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:51.586176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1652d-5294-458f-90f3-51947b4e4c0b None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:51.586730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1652d-5294-458f-90f3-51947b4e4c0b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:51.586730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1652d-5294-458f-90f3-51947b4e4c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:51.656828 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-e2a1652d-5294-458f-90f3-51947b4e4c0b None None] MFA Rules not processed for user `2b1ed674b846444e9239d42e7ea03b53`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:51.661896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-e2a1652d-5294-458f-90f3-51947b4e4c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:51.850383 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1085/2195] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:51.877381 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5ad9c-cc6f-4cac-8547-606074cacfec service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:51.879702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-fad5ad9c-cc6f-4cac-8547-606074cacfec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:52.090510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5ad9c-cc6f-4cac-8547-606074cacfec service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:52.097034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b98c0-e30a-45b4-8fc5-20d604d2b6f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:52.098017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b98c0-e30a-45b4-8fc5-20d604d2b6f7 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:52.098398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b98c0-e30a-45b4-8fc5-20d604d2b6f7 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:52.098800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b98c0-e30a-45b4-8fc5-20d604d2b6f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:52.110032 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b98c0-e30a-45b4-8fc5-20d604d2b6f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:52.111669 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b98c0-e30a-45b4-8fc5-20d604d2b6f7 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:52.127366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1111/2196] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:52.712428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1652d-5294-458f-90f3-51947b4e4c0b None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:52.723169 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1652d-5294-458f-90f3-51947b4e4c0b None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:52.728124 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d8087-5bfe-4d74-871a-e4c0f3295864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:52.728947 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8087-5bfe-4d74-871a-e4c0f3295864 service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:52.729477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8087-5bfe-4d74-871a-e4c0f3295864 service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:52.729816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8087-5bfe-4d74-871a-e4c0f3295864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:52.732021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-562d8087-5bfe-4d74-871a-e4c0f3295864 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:52.821142 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d8087-5bfe-4d74-871a-e4c0f3295864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:52.821142 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d8087-5bfe-4d74-871a-e4c0f3295864 service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:52.845762 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1086/2197] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:53.411282 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b98c0-e30a-45b4-8fc5-20d604d2b6f7 service nova] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:53.413619 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-aa0b98c0-e30a-45b4-8fc5-20d604d2b6f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:53.602140 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b98c0-e30a-45b4-8fc5-20d604d2b6f7 service nova] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:53.616642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2dfbd-86f5-4a23-8628-ca2387c246a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:53.617324 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2dfbd-86f5-4a23-8628-ca2387c246a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:53.617599 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2dfbd-86f5-4a23-8628-ca2387c246a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:53.617893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2dfbd-86f5-4a23-8628-ca2387c246a2 admin admin] PATH_INFO: `/v3/users/e7755bd5e3934c98b7ef535ffc8d82cd` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:53.619729 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2dfbd-86f5-4a23-8628-ca2387c246a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7755bd5e3934c98b7ef535ffc8d82cd)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:53.622538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2dfbd-86f5-4a23-8628-ca2387c246a2 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:53.673657 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:INSERT=1,keystone:SELECT=95,keystone:DELETE=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:53.722225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-50c2dfbd-86f5-4a23-8628-ca2387c246a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7755bd5e3934c98b7ef535ffc8d82cd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:53.723319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-50c2dfbd-86f5-4a23-8628-ca2387c246a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7755bd5e3934c98b7ef535ffc8d82cd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:53.744540 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-50c2dfbd-86f5-4a23-8628-ca2387c246a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7755bd5e3934c98b7ef535ffc8d82cd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:53.798733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-50c2dfbd-86f5-4a23-8628-ca2387c246a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7755bd5e3934c98b7ef535ffc8d82cd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:53.816925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-50c2dfbd-86f5-4a23-8628-ca2387c246a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7755bd5e3934c98b7ef535ffc8d82cd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:53.849182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1112/2198] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:53 2022] DELETE /identity/v3/users/e7755bd5e3934c98b7ef535ffc8d82cd => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:53.853642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f2373-fcd5-4735-9ec5-449e749bd3e9 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:53.854116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f2373-fcd5-4735-9ec5-449e749bd3e9 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:53.854289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f2373-fcd5-4735-9ec5-449e749bd3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:53.888953 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-6c1f2373-fcd5-4735-9ec5-449e749bd3e9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:53.890612 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6c1f2373-fcd5-4735-9ec5-449e749bd3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:53.976469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:54.015669 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1087/2199] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:54.030182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2dfbd-86f5-4a23-8628-ca2387c246a2 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:54.032509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-50c2dfbd-86f5-4a23-8628-ca2387c246a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:54.071984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f2373-fcd5-4735-9ec5-449e749bd3e9 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:54.073832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6c1f2373-fcd5-4735-9ec5-449e749bd3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:54.125683 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2dfbd-86f5-4a23-8628-ca2387c246a2 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:54.131470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5afc0-8f83-4686-a5ea-961c7aefb89f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:54.132356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5afc0-8f83-4686-a5ea-961c7aefb89f service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:54.132754 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5afc0-8f83-4686-a5ea-961c7aefb89f service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:54.133078 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5afc0-8f83-4686-a5ea-961c7aefb89f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:54.155106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5afc0-8f83-4686-a5ea-961c7aefb89f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:54.157742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5afc0-8f83-4686-a5ea-961c7aefb89f service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:54.164836 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f2373-fcd5-4735-9ec5-449e749bd3e9 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:54.171693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1113/2200] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:54.174510 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737281b-8527-4734-8ed0-3cb351168a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:54.175480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737281b-8527-4734-8ed0-3cb351168a51 service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:54.175861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737281b-8527-4734-8ed0-3cb351168a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:54.176227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737281b-8527-4734-8ed0-3cb351168a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:54.178364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5737281b-8527-4734-8ed0-3cb351168a51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:54.290483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737281b-8527-4734-8ed0-3cb351168a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:54.294123 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737281b-8527-4734-8ed0-3cb351168a51 service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:54.313506 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1088/2201] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:54.501286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5afc0-8f83-4686-a5ea-961c7aefb89f service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:54.507507 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-14f5afc0-8f83-4686-a5ea-961c7aefb89f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:54.564624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5afc0-8f83-4686-a5ea-961c7aefb89f service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:54.598197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf2ac6-1b0b-492f-be8c-1785d697c30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:54.601877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf2ac6-1b0b-492f-be8c-1785d697c30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:54.603597 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf2ac6-1b0b-492f-be8c-1785d697c30c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:54.606198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf2ac6-1b0b-492f-be8c-1785d697c30c admin admin] PATH_INFO: `/v3/users/787e03cbac0941fc9775f3953e7ffa75` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:54.613334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf2ac6-1b0b-492f-be8c-1785d697c30c admin admin] RBAC: Authorizing `identity:delete_user(user_id=787e03cbac0941fc9775f3953e7ffa75)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:54.620252 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf2ac6-1b0b-492f-be8c-1785d697c30c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:54.745272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1dbf2ac6-1b0b-492f-be8c-1785d697c30c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '787e03cbac0941fc9775f3953e7ffa75'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:54.747398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1dbf2ac6-1b0b-492f-be8c-1785d697c30c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '787e03cbac0941fc9775f3953e7ffa75'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:54.785704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1dbf2ac6-1b0b-492f-be8c-1785d697c30c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '787e03cbac0941fc9775f3953e7ffa75'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:54.820746 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa991d-e7bb-4a17-864f-7113b79e2faf None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:54.821042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa991d-e7bb-4a17-864f-7113b79e2faf None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:54.821330 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa991d-e7bb-4a17-864f-7113b79e2faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:54.832420 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1dbf2ac6-1b0b-492f-be8c-1785d697c30c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '787e03cbac0941fc9775f3953e7ffa75'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:54.851164 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-5cfa991d-e7bb-4a17-864f-7113b79e2faf None None] MFA Rules not processed for user `2b1ed674b846444e9239d42e7ea03b53`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:54.854570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1dbf2ac6-1b0b-492f-be8c-1785d697c30c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '787e03cbac0941fc9775f3953e7ffa75'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:54.858198 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5cfa991d-e7bb-4a17-864f-7113b79e2faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:54.863230 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1114/2202] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:54 2022] DELETE /identity/v3/users/787e03cbac0941fc9775f3953e7ffa75 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:54.866707 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf2ac6-1b0b-492f-be8c-1785d697c30c admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:54.877347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1dbf2ac6-1b0b-492f-be8c-1785d697c30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:54.980205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1089/2203] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:54.981981 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e51f1-16be-4af4-adaa-c5db097b6961 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:54.982439 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e51f1-16be-4af4-adaa-c5db097b6961 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:54.982771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e51f1-16be-4af4-adaa-c5db097b6961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:54.987377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:55.062747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-b17e51f1-16be-4af4-adaa-c5db097b6961 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:55.064297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b17e51f1-16be-4af4-adaa-c5db097b6961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:55.165899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf2ac6-1b0b-492f-be8c-1785d697c30c admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:55.189186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961ad22-52f6-42e5-a565-99fa024c4f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:55.189951 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961ad22-52f6-42e5-a565-99fa024c4f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:55.190242 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961ad22-52f6-42e5-a565-99fa024c4f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:55.190705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961ad22-52f6-42e5-a565-99fa024c4f4c admin admin] PATH_INFO: `/v3/projects/9aaf4c2e02864102ac859a0d6e399383` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:55.192402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961ad22-52f6-42e5-a565-99fa024c4f4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aaf4c2e02864102ac859a0d6e399383)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:55.194633 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961ad22-52f6-42e5-a565-99fa024c4f4c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:55.210279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:55.244048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1090/2204] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:55.257700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e51f1-16be-4af4-adaa-c5db097b6961 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:55.259799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b17e51f1-16be-4af4-adaa-c5db097b6961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:55.296814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1961ad22-52f6-42e5-a565-99fa024c4f4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aaf4c2e02864102ac859a0d6e399383', 'request_id': 'req-1961ad22-52f6-42e5-a565-99fa024c4f4c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:55.308948 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1961ad22-52f6-42e5-a565-99fa024c4f4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aaf4c2e02864102ac859a0d6e399383', 'request_id': 'req-1961ad22-52f6-42e5-a565-99fa024c4f4c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:55.324874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1961ad22-52f6-42e5-a565-99fa024c4f4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aaf4c2e02864102ac859a0d6e399383', 'request_id': 'req-1961ad22-52f6-42e5-a565-99fa024c4f4c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:55.344925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1961ad22-52f6-42e5-a565-99fa024c4f4c admin admin] The token cache is being invalidate because project 9aaf4c2e02864102ac859a0d6e399383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:55.346117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1961ad22-52f6-42e5-a565-99fa024c4f4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:55.347287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1961ad22-52f6-42e5-a565-99fa024c4f4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:55.349784 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1115/2205] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:54 2022] DELETE /identity/v3/projects/9aaf4c2e02864102ac859a0d6e399383 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:55.356233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961ad22-52f6-42e5-a565-99fa024c4f4c admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:55.373210 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1961ad22-52f6-42e5-a565-99fa024c4f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:55.389810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e51f1-16be-4af4-adaa-c5db097b6961 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:55.532470 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa1c32-8eea-4888-905d-210fed6bf2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:55.532966 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa1c32-8eea-4888-905d-210fed6bf2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:55.533171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa1c32-8eea-4888-905d-210fed6bf2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:55.533581 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa1c32-8eea-4888-905d-210fed6bf2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:55.536489 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-36aa1c32-8eea-4888-905d-210fed6bf2f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:55.551970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961ad22-52f6-42e5-a565-99fa024c4f4c admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:55.567087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa1c32-8eea-4888-905d-210fed6bf2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:55.569390 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa1c32-8eea-4888-905d-210fed6bf2f9 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:55.573026 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d2a67-a4ea-4850-8532-769f5675dade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:55.573950 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d2a67-a4ea-4850-8532-769f5675dade admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:55.575131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d2a67-a4ea-4850-8532-769f5675dade admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:55.575615 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d2a67-a4ea-4850-8532-769f5675dade admin admin] PATH_INFO: `/v3/users/7a964c00a664423aa6d793b7235e1a9c` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:55.577823 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d2a67-a4ea-4850-8532-769f5675dade admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a964c00a664423aa6d793b7235e1a9c)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:55.580451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d2a67-a4ea-4850-8532-769f5675dade admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:55.583834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1091/2206] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:09:55.756658 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c87d2a67-a4ea-4850-8532-769f5675dade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a964c00a664423aa6d793b7235e1a9c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:55.759287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c87d2a67-a4ea-4850-8532-769f5675dade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a964c00a664423aa6d793b7235e1a9c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:55.763852 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:55.792498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c87d2a67-a4ea-4850-8532-769f5675dade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a964c00a664423aa6d793b7235e1a9c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:55.857716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c87d2a67-a4ea-4850-8532-769f5675dade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a964c00a664423aa6d793b7235e1a9c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:55.871947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c87d2a67-a4ea-4850-8532-769f5675dade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a964c00a664423aa6d793b7235e1a9c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:55.894346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1116/2207] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:55 2022] DELETE /identity/v3/users/7a964c00a664423aa6d793b7235e1a9c => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:56.025926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa1c32-8eea-4888-905d-210fed6bf2f9 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:56.028204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-36aa1c32-8eea-4888-905d-210fed6bf2f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:56.051834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa1c32-8eea-4888-905d-210fed6bf2f9 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:56.274686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f2113-8d50-4308-a6fc-6ffeb6fc394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:56.282513 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f2113-8d50-4308-a6fc-6ffeb6fc394d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:56.282947 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f2113-8d50-4308-a6fc-6ffeb6fc394d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:56.283330 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f2113-8d50-4308-a6fc-6ffeb6fc394d admin admin] PATH_INFO: `/v3/projects/8fab585d703a41cd9f24faa22ca630c6` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:56.286437 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f2113-8d50-4308-a6fc-6ffeb6fc394d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fab585d703a41cd9f24faa22ca630c6)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:56.294903 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f2113-8d50-4308-a6fc-6ffeb6fc394d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:56.426939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:56.431018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-985f2113-8d50-4308-a6fc-6ffeb6fc394d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fab585d703a41cd9f24faa22ca630c6', 'request_id': 'req-985f2113-8d50-4308-a6fc-6ffeb6fc394d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:56.453852 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-985f2113-8d50-4308-a6fc-6ffeb6fc394d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fab585d703a41cd9f24faa22ca630c6', 'request_id': 'req-985f2113-8d50-4308-a6fc-6ffeb6fc394d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:56.468046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-985f2113-8d50-4308-a6fc-6ffeb6fc394d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fab585d703a41cd9f24faa22ca630c6', 'request_id': 'req-985f2113-8d50-4308-a6fc-6ffeb6fc394d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:56.495485 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-985f2113-8d50-4308-a6fc-6ffeb6fc394d admin admin] The token cache is being invalidate because project 8fab585d703a41cd9f24faa22ca630c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:56.495933 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-985f2113-8d50-4308-a6fc-6ffeb6fc394d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:56.497304 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-985f2113-8d50-4308-a6fc-6ffeb6fc394d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:56.503984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1092/2208] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:56 2022] DELETE /identity/v3/projects/8fab585d703a41cd9f24faa22ca630c6 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:56.505686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9710d7-70ad-4c8e-b5d1-7153c9eef75e None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:56.506074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9710d7-70ad-4c8e-b5d1-7153c9eef75e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:56.506397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9710d7-70ad-4c8e-b5d1-7153c9eef75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:56.539956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-3e9710d7-70ad-4c8e-b5d1-7153c9eef75e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:56.541739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-3e9710d7-70ad-4c8e-b5d1-7153c9eef75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:56.617258 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f2113-8d50-4308-a6fc-6ffeb6fc394d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:56.619496 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-985f2113-8d50-4308-a6fc-6ffeb6fc394d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:56.643557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1117/2209] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:56.652233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3646c8-9c99-4afe-bcfc-6d139d9200e4 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:56.652967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3646c8-9c99-4afe-bcfc-6d139d9200e4 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:56.654149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3646c8-9c99-4afe-bcfc-6d139d9200e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:56.717804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-6b3646c8-9c99-4afe-bcfc-6d139d9200e4 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:56.719050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6b3646c8-9c99-4afe-bcfc-6d139d9200e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:56.749123 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1118/2210] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:09:56.750328 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3646c8-9c99-4afe-bcfc-6d139d9200e4 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:56.773678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3646c8-9c99-4afe-bcfc-6d139d9200e4 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:56.786839 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d595e-fb4a-4ced-9935-8184d58b6dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:56.788293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d595e-fb4a-4ced-9935-8184d58b6dfa admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:56.789207 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d595e-fb4a-4ced-9935-8184d58b6dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:56.789722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d595e-fb4a-4ced-9935-8184d58b6dfa admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:56.790532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d595e-fb4a-4ced-9935-8184d58b6dfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:56.790997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d595e-fb4a-4ced-9935-8184d58b6dfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:56.799690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d595e-fb4a-4ced-9935-8184d58b6dfa admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:56.804668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f2113-8d50-4308-a6fc-6ffeb6fc394d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:56.814504 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e11a3-1ca3-4625-86e0-7e8b4b71d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:56.814845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1119/2211] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:09:56.815648 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e11a3-1ca3-4625-86e0-7e8b4b71d456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:56.815933 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e11a3-1ca3-4625-86e0-7e8b4b71d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:56.816207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e11a3-1ca3-4625-86e0-7e8b4b71d456 admin admin] PATH_INFO: `/v3/projects/d846a79994cf40a9be1067d1f54fb097` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:56.817465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e11a3-1ca3-4625-86e0-7e8b4b71d456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d846a79994cf40a9be1067d1f54fb097)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:56.819544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e11a3-1ca3-4625-86e0-7e8b4b71d456 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:56.819865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d595e-fb4a-4ced-9935-8184d58b6dfa admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:56.821767 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-247d595e-fb4a-4ced-9935-8184d58b6dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:56.917418 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d595e-fb4a-4ced-9935-8184d58b6dfa admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:56.927913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-808e11a3-1ca3-4625-86e0-7e8b4b71d456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd846a79994cf40a9be1067d1f54fb097', 'request_id': 'req-808e11a3-1ca3-4625-86e0-7e8b4b71d456'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:56.945654 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-808e11a3-1ca3-4625-86e0-7e8b4b71d456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd846a79994cf40a9be1067d1f54fb097', 'request_id': 'req-808e11a3-1ca3-4625-86e0-7e8b4b71d456'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:56.967285 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-808e11a3-1ca3-4625-86e0-7e8b4b71d456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd846a79994cf40a9be1067d1f54fb097', 'request_id': 'req-808e11a3-1ca3-4625-86e0-7e8b4b71d456'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:56.983624 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-808e11a3-1ca3-4625-86e0-7e8b4b71d456 admin admin] The token cache is being invalidate because project d846a79994cf40a9be1067d1f54fb097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:56.984091 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-808e11a3-1ca3-4625-86e0-7e8b4b71d456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:56.985081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-808e11a3-1ca3-4625-86e0-7e8b4b71d456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:56.987977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1093/2212] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:56 2022] DELETE /identity/v3/projects/d846a79994cf40a9be1067d1f54fb097 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:09:56.989273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e11a3-1ca3-4625-86e0-7e8b4b71d456 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:56.991467 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-808e11a3-1ca3-4625-86e0-7e8b4b71d456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:57.052275 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e2b8c-a4d9-4e1b-b99c-af7c36ee267c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:57.055926 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e2b8c-a4d9-4e1b-b99c-af7c36ee267c service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:57.056247 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e2b8c-a4d9-4e1b-b99c-af7c36ee267c service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:57.058555 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e2b8c-a4d9-4e1b-b99c-af7c36ee267c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:57.063021 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a89e2b8c-a4d9-4e1b-b99c-af7c36ee267c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:57.103819 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e11a3-1ca3-4625-86e0-7e8b4b71d456 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:57.106656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:57.111478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc13573-d5e0-4ade-80b5-42ad3b4cde75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:57.112559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc13573-d5e0-4ade-80b5-42ad3b4cde75 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:57.112945 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc13573-d5e0-4ade-80b5-42ad3b4cde75 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:57.113222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc13573-d5e0-4ade-80b5-42ad3b4cde75 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:57.114124 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc13573-d5e0-4ade-80b5-42ad3b4cde75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:57.116620 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc13573-d5e0-4ade-80b5-42ad3b4cde75 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:57.130731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:57.172160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1094/2213] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:56 2022] POST /identity/v3/projects => generated 399 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:57.172160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc13573-d5e0-4ade-80b5-42ad3b4cde75 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:57.188419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-adc13573-d5e0-4ade-80b5-42ad3b4cde75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:57.253758 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e2b8c-a4d9-4e1b-b99c-af7c36ee267c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:57.256125 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e2b8c-a4d9-4e1b-b99c-af7c36ee267c service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:57.283525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1120/2214] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:57.284765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e2b8c-a4d9-4e1b-b99c-af7c36ee267c service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:57.326036 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e2b8c-a4d9-4e1b-b99c-af7c36ee267c service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:57.362248 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc13573-d5e0-4ade-80b5-42ad3b4cde75 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:57.373090 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3728b-270b-46a8-b5c5-874d04f5d57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:57.374337 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3728b-270b-46a8-b5c5-874d04f5d57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:57.374703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3728b-270b-46a8-b5c5-874d04f5d57e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:57.375176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3728b-270b-46a8-b5c5-874d04f5d57e admin admin] PATH_INFO: `/v3/users/54e2f40368d7483abd830f2096207e5d` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:57.379015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3728b-270b-46a8-b5c5-874d04f5d57e admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e2f40368d7483abd830f2096207e5d)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:57.381968 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3728b-270b-46a8-b5c5-874d04f5d57e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:57.488418 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b340fcf-2f9c-4f3f-b5f3-2f9f8bbb5c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:57.489247 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b340fcf-2f9c-4f3f-b5f3-2f9f8bbb5c4c admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:57.489676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b340fcf-2f9c-4f3f-b5f3-2f9f8bbb5c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:57.490234 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b340fcf-2f9c-4f3f-b5f3-2f9f8bbb5c4c admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:57.491034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b340fcf-2f9c-4f3f-b5f3-2f9f8bbb5c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:57.495473 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b340fcf-2f9c-4f3f-b5f3-2f9f8bbb5c4c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:57.535088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1121/2215] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:57 2022] POST /identity/v3/users => generated 300 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:57.537010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b340fcf-2f9c-4f3f-b5f3-2f9f8bbb5c4c admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:57.554661 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b340fcf-2f9c-4f3f-b5f3-2f9f8bbb5c4c admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:57.572100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483d47c-933e-40a2-a18b-c521b190e224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:57.573001 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d47c-933e-40a2-a18b-c521b190e224 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:57.573281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d47c-933e-40a2-a18b-c521b190e224 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:57.573554 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d47c-933e-40a2-a18b-c521b190e224 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:57.574277 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483d47c-933e-40a2-a18b-c521b190e224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:57.587020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483d47c-933e-40a2-a18b-c521b190e224 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:57.601159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-05e3728b-270b-46a8-b5c5-874d04f5d57e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e2f40368d7483abd830f2096207e5d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:57.602001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-05e3728b-270b-46a8-b5c5-874d04f5d57e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e2f40368d7483abd830f2096207e5d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:57.621862 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-05e3728b-270b-46a8-b5c5-874d04f5d57e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e2f40368d7483abd830f2096207e5d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:57.623118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-05e3728b-270b-46a8-b5c5-874d04f5d57e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e2f40368d7483abd830f2096207e5d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:57.628952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1122/2216] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:57.637514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483d47c-933e-40a2-a18b-c521b190e224 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:57.640063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b483d47c-933e-40a2-a18b-c521b190e224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:57.658121 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483d47c-933e-40a2-a18b-c521b190e224 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:57.665362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5162125-c902-42af-bf70-bee46e8e4cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:57.666514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5162125-c902-42af-bf70-bee46e8e4cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:57.667177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5162125-c902-42af-bf70-bee46e8e4cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:57.667597 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5162125-c902-42af-bf70-bee46e8e4cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:57.667980 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-05e3728b-270b-46a8-b5c5-874d04f5d57e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e2f40368d7483abd830f2096207e5d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:57.669344 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5162125-c902-42af-bf70-bee46e8e4cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:57.671686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5162125-c902-42af-bf70-bee46e8e4cb5 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:57.721214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1123/2217] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:57.722422 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5162125-c902-42af-bf70-bee46e8e4cb5 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:57.756640 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1095/2218] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:57 2022] DELETE /identity/v3/users/54e2f40368d7483abd830f2096207e5d => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:57.762700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5162125-c902-42af-bf70-bee46e8e4cb5 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:57.951705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fad3c-78e1-443f-901f-e2cb421840a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:57.953484 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fad3c-78e1-443f-901f-e2cb421840a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:57.953765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fad3c-78e1-443f-901f-e2cb421840a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:57.955408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fad3c-78e1-443f-901f-e2cb421840a2 admin admin] PATH_INFO: `/v3/projects/5aabb43e80334e4d8f93a847f5f49f29/users/e911a82860d04fd1a2bd221ac816b63e/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:58.029036 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fad3c-78e1-443f-901f-e2cb421840a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aabb43e80334e4d8f93a847f5f49f29, user_id=e911a82860d04fd1a2bd221ac816b63e, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:58.035015 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fad3c-78e1-443f-901f-e2cb421840a2 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:58.103027 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1124/2219] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:57 2022] PUT /identity/v3/projects/5aabb43e80334e4d8f93a847f5f49f29/users/e911a82860d04fd1a2bd221ac816b63e/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:58.114587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62797f-6173-4dd2-97b8-9501d0fac66c None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:58.115445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62797f-6173-4dd2-97b8-9501d0fac66c None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:58.115445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62797f-6173-4dd2-97b8-9501d0fac66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:58.181187 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-9f62797f-6173-4dd2-97b8-9501d0fac66c None None] MFA Rules not processed for user `e911a82860d04fd1a2bd221ac816b63e`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:58.183151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-9f62797f-6173-4dd2-97b8-9501d0fac66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:58.265942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fad3c-78e1-443f-901f-e2cb421840a2 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:58.268348 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c68fad3c-78e1-443f-901f-e2cb421840a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:58.277579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:58.302891 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:58.316417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1096/2220] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 07 13:09:58.329083 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62797f-6173-4dd2-97b8-9501d0fac66c None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:58.330706 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-9f62797f-6173-4dd2-97b8-9501d0fac66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:58.382182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fad3c-78e1-443f-901f-e2cb421840a2 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:58.390496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba718b-87e2-4fea-aa3f-a5052003ea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:58.391380 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba718b-87e2-4fea-aa3f-a5052003ea3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:58.391626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba718b-87e2-4fea-aa3f-a5052003ea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:58.392082 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba718b-87e2-4fea-aa3f-a5052003ea3b admin admin] PATH_INFO: `/v3/users/4ecb461a2d4743d3a1a3c989fb4e7ab0` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:58.395961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba718b-87e2-4fea-aa3f-a5052003ea3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ecb461a2d4743d3a1a3c989fb4e7ab0)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:58.398889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba718b-87e2-4fea-aa3f-a5052003ea3b admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:58.503084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62797f-6173-4dd2-97b8-9501d0fac66c None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:58.508722 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597028e-a472-4df3-bc83-0644d0f23f5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:58.509718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597028e-a472-4df3-bc83-0644d0f23f5d service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:58.510072 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597028e-a472-4df3-bc83-0644d0f23f5d service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:58.510507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597028e-a472-4df3-bc83-0644d0f23f5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:58.520020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-78ba718b-87e2-4fea-aa3f-a5052003ea3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ecb461a2d4743d3a1a3c989fb4e7ab0'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:58.520754 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-78ba718b-87e2-4fea-aa3f-a5052003ea3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ecb461a2d4743d3a1a3c989fb4e7ab0'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:58.524141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597028e-a472-4df3-bc83-0644d0f23f5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:58.526672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597028e-a472-4df3-bc83-0644d0f23f5d service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:58.531807 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-78ba718b-87e2-4fea-aa3f-a5052003ea3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ecb461a2d4743d3a1a3c989fb4e7ab0'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:58.540524 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1097/2221] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:58 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:09:58.553857 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-78ba718b-87e2-4fea-aa3f-a5052003ea3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ecb461a2d4743d3a1a3c989fb4e7ab0'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:58.566830 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-78ba718b-87e2-4fea-aa3f-a5052003ea3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ecb461a2d4743d3a1a3c989fb4e7ab0'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:58.586203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1125/2222] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:58 2022] DELETE /identity/v3/users/4ecb461a2d4743d3a1a3c989fb4e7ab0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:09:58.588860 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf7605-fa96-4ad2-bd34-b2de88811b64 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:58.589261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf7605-fa96-4ad2-bd34-b2de88811b64 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:58.589633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf7605-fa96-4ad2-bd34-b2de88811b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:58.622450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-dabf7605-fa96-4ad2-bd34-b2de88811b64 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:58.624053 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-dabf7605-fa96-4ad2-bd34-b2de88811b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:58.729253 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba718b-87e2-4fea-aa3f-a5052003ea3b admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:58.731606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-78ba718b-87e2-4fea-aa3f-a5052003ea3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:58.815154 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1098/2223] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:09:58.825681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf7605-fa96-4ad2-bd34-b2de88811b64 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:58.830669 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-dabf7605-fa96-4ad2-bd34-b2de88811b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:58.883200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba718b-87e2-4fea-aa3f-a5052003ea3b admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:58.889842 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bf3b2-a7e2-47c3-b250-2fbf9ad38455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:58.890509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bf3b2-a7e2-47c3-b250-2fbf9ad38455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:58.890785 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bf3b2-a7e2-47c3-b250-2fbf9ad38455 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:58.891055 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bf3b2-a7e2-47c3-b250-2fbf9ad38455 admin admin] PATH_INFO: `/v3/projects/83520002c1e14977a24ff6f647fd6bc5` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:58.897080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bf3b2-a7e2-47c3-b250-2fbf9ad38455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83520002c1e14977a24ff6f647fd6bc5)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:58.899911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bf3b2-a7e2-47c3-b250-2fbf9ad38455 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:58.989213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf7605-fa96-4ad2-bd34-b2de88811b64 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:58.993337 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07184176-8160-445f-939d-76e9eb15242c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:58.993945 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:58.994412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07184176-8160-445f-939d-76e9eb15242c service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:58.994690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07184176-8160-445f-939d-76e9eb15242c service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:58.994961 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07184176-8160-445f-939d-76e9eb15242c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:59.013342 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07184176-8160-445f-939d-76e9eb15242c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:59.015280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07184176-8160-445f-939d-76e9eb15242c service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:59.026662 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1099/2224] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:09:59.058787 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-937bf3b2-a7e2-47c3-b250-2fbf9ad38455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83520002c1e14977a24ff6f647fd6bc5', 'request_id': 'req-937bf3b2-a7e2-47c3-b250-2fbf9ad38455'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:59.083890 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-937bf3b2-a7e2-47c3-b250-2fbf9ad38455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83520002c1e14977a24ff6f647fd6bc5', 'request_id': 'req-937bf3b2-a7e2-47c3-b250-2fbf9ad38455'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:59.101253 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-937bf3b2-a7e2-47c3-b250-2fbf9ad38455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83520002c1e14977a24ff6f647fd6bc5', 'request_id': 'req-937bf3b2-a7e2-47c3-b250-2fbf9ad38455'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:59.141128 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-937bf3b2-a7e2-47c3-b250-2fbf9ad38455 admin admin] The token cache is being invalidate because project 83520002c1e14977a24ff6f647fd6bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:59.141421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-937bf3b2-a7e2-47c3-b250-2fbf9ad38455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:59.142147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-937bf3b2-a7e2-47c3-b250-2fbf9ad38455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:59.144981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1126/2225] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:58 2022] DELETE /identity/v3/projects/83520002c1e14977a24ff6f647fd6bc5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:09:59.150394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1172a2-b83f-487b-b0af-84bab01e5de3 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:59.150956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1172a2-b83f-487b-b0af-84bab01e5de3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:59.150956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1172a2-b83f-487b-b0af-84bab01e5de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:59.179102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-3c1172a2-b83f-487b-b0af-84bab01e5de3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:59.180337 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3c1172a2-b83f-487b-b0af-84bab01e5de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:59.273765 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:59.338659 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1100/2226] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:59.347225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83886387-f4ae-4a2b-9ab0-c92d0d138bd4 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:59.347625 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83886387-f4ae-4a2b-9ab0-c92d0d138bd4 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:59.348143 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83886387-f4ae-4a2b-9ab0-c92d0d138bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:59.386368 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-83886387-f4ae-4a2b-9ab0-c92d0d138bd4 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:59.388400 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-83886387-f4ae-4a2b-9ab0-c92d0d138bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:59.399800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1127/2227] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:09:59.404479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1172a2-b83f-487b-b0af-84bab01e5de3 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:59.416093 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83886387-f4ae-4a2b-9ab0-c92d0d138bd4 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:59.421286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-83886387-f4ae-4a2b-9ab0-c92d0d138bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:59.433091 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1172a2-b83f-487b-b0af-84bab01e5de3 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:59.444956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83886387-f4ae-4a2b-9ab0-c92d0d138bd4 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:59.449442 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027779c-527d-4f12-a170-c12a5ab4d131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:59.450444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027779c-527d-4f12-a170-c12a5ab4d131 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:59.450925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d26b6f-2587-4879-9459-878deba3fc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:59.451149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027779c-527d-4f12-a170-c12a5ab4d131 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:59.451728 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027779c-527d-4f12-a170-c12a5ab4d131 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:59.452875 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d26b6f-2587-4879-9459-878deba3fc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:59.453009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d26b6f-2587-4879-9459-878deba3fc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:59.453514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d26b6f-2587-4879-9459-878deba3fc35 admin admin] PATH_INFO: `/v3/users/564e35cfb0694b839ccad10f30510c9c` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:59.454726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027779c-527d-4f12-a170-c12a5ab4d131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:09:59.455182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d26b6f-2587-4879-9459-878deba3fc35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=564e35cfb0694b839ccad10f30510c9c)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:59.455604 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027779c-527d-4f12-a170-c12a5ab4d131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:59.457773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d26b6f-2587-4879-9459-878deba3fc35 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:59.457896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027779c-527d-4f12-a170-c12a5ab4d131 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:59.479822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1101/2228] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:09:59.485944 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027779c-527d-4f12-a170-c12a5ab4d131 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:59.511273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027779c-527d-4f12-a170-c12a5ab4d131 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:59.522590 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05567332-65f6-43bb-a949-79270f0d1217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:59.523378 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05567332-65f6-43bb-a949-79270f0d1217 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:59.523556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05567332-65f6-43bb-a949-79270f0d1217 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:59.523831 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05567332-65f6-43bb-a949-79270f0d1217 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:59.524521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05567332-65f6-43bb-a949-79270f0d1217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:59.526702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05567332-65f6-43bb-a949-79270f0d1217 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:59.562761 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-63d26b6f-2587-4879-9459-878deba3fc35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564e35cfb0694b839ccad10f30510c9c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:59.563609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-63d26b6f-2587-4879-9459-878deba3fc35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564e35cfb0694b839ccad10f30510c9c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:59.569567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1102/2229] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:09:59 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:59.570242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05567332-65f6-43bb-a949-79270f0d1217 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:59.571879 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-05567332-65f6-43bb-a949-79270f0d1217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:59.579830 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-63d26b6f-2587-4879-9459-878deba3fc35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564e35cfb0694b839ccad10f30510c9c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:59.597611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-63d26b6f-2587-4879-9459-878deba3fc35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564e35cfb0694b839ccad10f30510c9c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:59.607040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-63d26b6f-2587-4879-9459-878deba3fc35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564e35cfb0694b839ccad10f30510c9c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:59.614691 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1128/2230] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:59 2022] DELETE /identity/v3/users/564e35cfb0694b839ccad10f30510c9c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:59.615783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d26b6f-2587-4879-9459-878deba3fc35 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:59.617177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-63d26b6f-2587-4879-9459-878deba3fc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:59.677273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05567332-65f6-43bb-a949-79270f0d1217 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:59.700601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d26b6f-2587-4879-9459-878deba3fc35 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:59.705609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85140ca3-789a-463d-b1d4-4634f75e4a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:59.706231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85140ca3-789a-463d-b1d4-4634f75e4a24 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:59.706532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85140ca3-789a-463d-b1d4-4634f75e4a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:59.706764 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85140ca3-789a-463d-b1d4-4634f75e4a24 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:59.707403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85140ca3-789a-463d-b1d4-4634f75e4a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:59.709467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85140ca3-789a-463d-b1d4-4634f75e4a24 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:59.739111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1129/2231] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:09:59 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:09:59.739111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c7cc6-905e-4dc5-97eb-5880d9193707 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:59.739111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c7cc6-905e-4dc5-97eb-5880d9193707 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:59.739111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c7cc6-905e-4dc5-97eb-5880d9193707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:59.748314 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9649472-95e9-495c-a0d0-475e204dc7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:59.749005 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9649472-95e9-495c-a0d0-475e204dc7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:59.749286 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9649472-95e9-495c-a0d0-475e204dc7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:59.749557 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9649472-95e9-495c-a0d0-475e204dc7b8 admin admin] PATH_INFO: `/v3/projects/4aeb564898ff4b55af8c7a4dac82ce7f` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:59.750712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9649472-95e9-495c-a0d0-475e204dc7b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aeb564898ff4b55af8c7a4dac82ce7f)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:59.752105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=79,keystone:DELETE=16,keystone:INSERT=5 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:59.752746 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9649472-95e9-495c-a0d0-475e204dc7b8 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:59.758608 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-233c7cc6-905e-4dc5-97eb-5880d9193707 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:59.760473 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-233c7cc6-905e-4dc5-97eb-5880d9193707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:59.770627 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1130/2232] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:59.771518 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c7cc6-905e-4dc5-97eb-5880d9193707 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:59.783453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c7cc6-905e-4dc5-97eb-5880d9193707 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:59.789033 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47de78-6d34-497a-a691-d5195821b175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:59.789847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47de78-6d34-497a-a691-d5195821b175 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:59.790164 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47de78-6d34-497a-a691-d5195821b175 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:59.790436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47de78-6d34-497a-a691-d5195821b175 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:59.791099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47de78-6d34-497a-a691-d5195821b175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:59.792957 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47de78-6d34-497a-a691-d5195821b175 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:59.805398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1131/2233] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:59.809408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47de78-6d34-497a-a691-d5195821b175 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:59.811544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a9649472-95e9-495c-a0d0-475e204dc7b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aeb564898ff4b55af8c7a4dac82ce7f', 'request_id': 'req-a9649472-95e9-495c-a0d0-475e204dc7b8'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:59.811676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8e47de78-6d34-497a-a691-d5195821b175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:59.821599 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a9649472-95e9-495c-a0d0-475e204dc7b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aeb564898ff4b55af8c7a4dac82ce7f', 'request_id': 'req-a9649472-95e9-495c-a0d0-475e204dc7b8'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:59.824255 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:59.831317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a9649472-95e9-495c-a0d0-475e204dc7b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aeb564898ff4b55af8c7a4dac82ce7f', 'request_id': 'req-a9649472-95e9-495c-a0d0-475e204dc7b8'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:59.845861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a9649472-95e9-495c-a0d0-475e204dc7b8 admin admin] The token cache is being invalidate because project 4aeb564898ff4b55af8c7a4dac82ce7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:09:59.846219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a9649472-95e9-495c-a0d0-475e204dc7b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:59.846882 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a9649472-95e9-495c-a0d0-475e204dc7b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:09:59.851959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1103/2234] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:09:59 2022] DELETE /identity/v3/projects/4aeb564898ff4b55af8c7a4dac82ce7f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:09:59.851959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9649472-95e9-495c-a0d0-475e204dc7b8 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:59.851959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a9649472-95e9-495c-a0d0-475e204dc7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:59.885426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47de78-6d34-497a-a691-d5195821b175 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:59.941744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9649472-95e9-495c-a0d0-475e204dc7b8 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:59.946426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cadd2-b5a2-42bb-833b-ee10e5898cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:59.947113 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043fae7-84eb-42b6-950f-df642f9149b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:59.947453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cadd2-b5a2-42bb-833b-ee10e5898cda service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:59.947730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043fae7-84eb-42b6-950f-df642f9149b8 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:59.947925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cadd2-b5a2-42bb-833b-ee10e5898cda service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:59.948020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043fae7-84eb-42b6-950f-df642f9149b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:59.948301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043fae7-84eb-42b6-950f-df642f9149b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:59.948450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cadd2-b5a2-42bb-833b-ee10e5898cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:59.949007 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043fae7-84eb-42b6-950f-df642f9149b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:59.950839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043fae7-84eb-42b6-950f-df642f9149b8 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:59.951624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d16cadd2-b5a2-42bb-833b-ee10e5898cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:59.966883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1104/2235] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:09:59.966883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043fae7-84eb-42b6-950f-df642f9149b8 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:59.968489 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4043fae7-84eb-42b6-950f-df642f9149b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:59.972939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cadd2-b5a2-42bb-833b-ee10e5898cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:59.975363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cadd2-b5a2-42bb-833b-ee10e5898cda service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:59.984876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043fae7-84eb-42b6-950f-df642f9149b8 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:59.989642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1132/2236] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:59.990559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cadd2-b5a2-42bb-833b-ee10e5898cda service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:59.991396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44cbb2-790f-437a-8a64-900c503bba7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:59.992082 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44cbb2-790f-437a-8a64-900c503bba7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:59.992461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44cbb2-790f-437a-8a64-900c503bba7d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:59.992796 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44cbb2-790f-437a-8a64-900c503bba7d admin admin] PATH_INFO: `/v3/users/cf7af78331d346908992013b93e49a86` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:59.994108 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44cbb2-790f-437a-8a64-900c503bba7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf7af78331d346908992013b93e49a86)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:59.996128 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44cbb2-790f-437a-8a64-900c503bba7d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:00.008349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cadd2-b5a2-42bb-833b-ee10e5898cda service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:00.015047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6d5f2-dd7c-48f7-98c8-8811e2fba81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:00.015733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6d5f2-dd7c-48f7-98c8-8811e2fba81d admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:00.016092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6d5f2-dd7c-48f7-98c8-8811e2fba81d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:00.016272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6d5f2-dd7c-48f7-98c8-8811e2fba81d admin admin] PATH_INFO: `/v3/projects/aeb8f73859c1457f8124f235a4c56eff/users/25ece953419c47cc90fb0ca4273c3d15/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:00.034161 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6d5f2-dd7c-48f7-98c8-8811e2fba81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb8f73859c1457f8124f235a4c56eff, user_id=25ece953419c47cc90fb0ca4273c3d15, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:00.036851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6d5f2-dd7c-48f7-98c8-8811e2fba81d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:00.053699 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1133/2237] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:09:59 2022] PUT /identity/v3/projects/aeb8f73859c1457f8124f235a4c56eff/users/25ece953419c47cc90fb0ca4273c3d15/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:00.066489 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d031cf4-65a5-49be-b8c7-175af3dce283 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:00.066749 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d031cf4-65a5-49be-b8c7-175af3dce283 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:00.067070 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d031cf4-65a5-49be-b8c7-175af3dce283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:00.092992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3e44cbb2-790f-437a-8a64-900c503bba7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf7af78331d346908992013b93e49a86'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:00.094031 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3e44cbb2-790f-437a-8a64-900c503bba7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf7af78331d346908992013b93e49a86'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:00.104928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3e44cbb2-790f-437a-8a64-900c503bba7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf7af78331d346908992013b93e49a86'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:00.106396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3e44cbb2-790f-437a-8a64-900c503bba7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf7af78331d346908992013b93e49a86'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:00.109151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-2d031cf4-65a5-49be-b8c7-175af3dce283 None None] MFA Rules not processed for user `25ece953419c47cc90fb0ca4273c3d15`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:00.110565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-2d031cf4-65a5-49be-b8c7-175af3dce283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:00.118775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3e44cbb2-790f-437a-8a64-900c503bba7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf7af78331d346908992013b93e49a86'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:00.149679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1105/2238] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:09:59 2022] DELETE /identity/v3/users/cf7af78331d346908992013b93e49a86 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:00.209305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1134/2239] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:00.222993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44cbb2-790f-437a-8a64-900c503bba7d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:00.224870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3e44cbb2-790f-437a-8a64-900c503bba7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:00.329549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:00.368433 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44cbb2-790f-437a-8a64-900c503bba7d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:00.377244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e692f59-45cc-43f5-80af-57d13ec2a655 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f332ac2346f0444a8d336ed2b3121be2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:00.377486 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e692f59-45cc-43f5-80af-57d13ec2a655 service glance] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:00.377942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e692f59-45cc-43f5-80af-57d13ec2a655 service glance] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:00.378220 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e692f59-45cc-43f5-80af-57d13ec2a655 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:00.491160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e692f59-45cc-43f5-80af-57d13ec2a655 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:00.493948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e692f59-45cc-43f5-80af-57d13ec2a655 service glance] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:00.519268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1106/2240] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:00.645394 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d031cf4-65a5-49be-b8c7-175af3dce283 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:00.652589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-2d031cf4-65a5-49be-b8c7-175af3dce283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:00.714910 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:00.762628 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e692f59-45cc-43f5-80af-57d13ec2a655 service glance] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:00.764904 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2e692f59-45cc-43f5-80af-57d13ec2a655 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:00.860852 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d031cf4-65a5-49be-b8c7-175af3dce283 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:00.885063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e692f59-45cc-43f5-80af-57d13ec2a655 service glance] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:00.890597 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de28c0-be96-4f64-92a2-fc23c9727fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:00.891246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de28c0-be96-4f64-92a2-fc23c9727fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:00.891518 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de28c0-be96-4f64-92a2-fc23c9727fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:00.891787 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de28c0-be96-4f64-92a2-fc23c9727fd7 admin admin] PATH_INFO: `/v3/projects/750029f186014827bcf5b332d61d8b02` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:00.893002 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de28c0-be96-4f64-92a2-fc23c9727fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=750029f186014827bcf5b332d61d8b02)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:00.895381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de28c0-be96-4f64-92a2-fc23c9727fd7 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:00.945582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba1ca6-882f-406d-89b6-5318367adac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:00.946253 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba1ca6-882f-406d-89b6-5318367adac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:00.946531 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba1ca6-882f-406d-89b6-5318367adac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:00.946860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba1ca6-882f-406d-89b6-5318367adac8 admin admin] PATH_INFO: `/v3/projects/0778c26163664ba28b4bbaa974ad018e` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:00.948022 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba1ca6-882f-406d-89b6-5318367adac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0778c26163664ba28b4bbaa974ad018e)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:00.950334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba1ca6-882f-406d-89b6-5318367adac8 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:00.987554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-16de28c0-be96-4f64-92a2-fc23c9727fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750029f186014827bcf5b332d61d8b02', 'request_id': 'req-16de28c0-be96-4f64-92a2-fc23c9727fd7'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:01.000175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-16de28c0-be96-4f64-92a2-fc23c9727fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750029f186014827bcf5b332d61d8b02', 'request_id': 'req-16de28c0-be96-4f64-92a2-fc23c9727fd7'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:01.013867 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-16de28c0-be96-4f64-92a2-fc23c9727fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750029f186014827bcf5b332d61d8b02', 'request_id': 'req-16de28c0-be96-4f64-92a2-fc23c9727fd7'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:01.042272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-16de28c0-be96-4f64-92a2-fc23c9727fd7 admin admin] The token cache is being invalidate because project 750029f186014827bcf5b332d61d8b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:01.043738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-16de28c0-be96-4f64-92a2-fc23c9727fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:01.045765 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-16de28c0-be96-4f64-92a2-fc23c9727fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:01.050154 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1107/2241] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:00 2022] DELETE /identity/v3/projects/750029f186014827bcf5b332d61d8b02 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:01.054275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de28c0-be96-4f64-92a2-fc23c9727fd7 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:01.058715 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-16de28c0-be96-4f64-92a2-fc23c9727fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:01.062471 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-aaba1ca6-882f-406d-89b6-5318367adac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0778c26163664ba28b4bbaa974ad018e', 'request_id': 'req-aaba1ca6-882f-406d-89b6-5318367adac8'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:01.077596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-aaba1ca6-882f-406d-89b6-5318367adac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0778c26163664ba28b4bbaa974ad018e', 'request_id': 'req-aaba1ca6-882f-406d-89b6-5318367adac8'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:01.091900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-aaba1ca6-882f-406d-89b6-5318367adac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0778c26163664ba28b4bbaa974ad018e', 'request_id': 'req-aaba1ca6-882f-406d-89b6-5318367adac8'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:01.115235 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:01.145933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-aaba1ca6-882f-406d-89b6-5318367adac8 admin admin] The token cache is being invalidate because project 0778c26163664ba28b4bbaa974ad018e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:01.148474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-aaba1ca6-882f-406d-89b6-5318367adac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:01.153816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-aaba1ca6-882f-406d-89b6-5318367adac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:01.160976 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1135/2242] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:00 2022] DELETE /identity/v3/projects/0778c26163664ba28b4bbaa974ad018e => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:01.169073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead3ff1-7c33-49ab-a592-bba6ec813710 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:01.170009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead3ff1-7c33-49ab-a592-bba6ec813710 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:01.172039 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead3ff1-7c33-49ab-a592-bba6ec813710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:01.211279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de28c0-be96-4f64-92a2-fc23c9727fd7 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:01.264857 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-8ead3ff1-7c33-49ab-a592-bba6ec813710 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:01.269697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8ead3ff1-7c33-49ab-a592-bba6ec813710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:01.328573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523ce81-b22f-44f2-b00b-faa90524f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:01.330264 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523ce81-b22f-44f2-b00b-faa90524f9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:01.330937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523ce81-b22f-44f2-b00b-faa90524f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:01.331558 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523ce81-b22f-44f2-b00b-faa90524f9e5 admin admin] PATH_INFO: `/v3/users/0f90081aa2014d158f7050e59fe99366` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:01.333170 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523ce81-b22f-44f2-b00b-faa90524f9e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f90081aa2014d158f7050e59fe99366)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:01.335572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523ce81-b22f-44f2-b00b-faa90524f9e5 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:01.485034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:01.571005 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8523ce81-b22f-44f2-b00b-faa90524f9e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f90081aa2014d158f7050e59fe99366'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:01.576993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8523ce81-b22f-44f2-b00b-faa90524f9e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f90081aa2014d158f7050e59fe99366'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:01.581693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1136/2243] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:01.586908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435765ce-ad79-405c-881b-647412a15b53 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:01.595953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435765ce-ad79-405c-881b-647412a15b53 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:01.596451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435765ce-ad79-405c-881b-647412a15b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:01.608104 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8523ce81-b22f-44f2-b00b-faa90524f9e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f90081aa2014d158f7050e59fe99366'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:01.608825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8523ce81-b22f-44f2-b00b-faa90524f9e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f90081aa2014d158f7050e59fe99366'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:01.647466 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8523ce81-b22f-44f2-b00b-faa90524f9e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f90081aa2014d158f7050e59fe99366'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:01.685034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-435765ce-ad79-405c-881b-647412a15b53 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:01.688318 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-435765ce-ad79-405c-881b-647412a15b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:01.710037 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1137/2244] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:01.717082 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435765ce-ad79-405c-881b-647412a15b53 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:01.720490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1108/2245] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:01 2022] DELETE /identity/v3/users/0f90081aa2014d158f7050e59fe99366 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:01.740991 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435765ce-ad79-405c-881b-647412a15b53 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:01.928251 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a093532-1462-4ede-93ec-a78d5294b16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:01.928917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a093532-1462-4ede-93ec-a78d5294b16d admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:01.929189 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a093532-1462-4ede-93ec-a78d5294b16d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:01.929463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a093532-1462-4ede-93ec-a78d5294b16d admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:01.930122 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a093532-1462-4ede-93ec-a78d5294b16d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:10:01.931439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a093532-1462-4ede-93ec-a78d5294b16d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:01.940362 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a093532-1462-4ede-93ec-a78d5294b16d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:01.971277 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1138/2246] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:10:01.975936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523ce81-b22f-44f2-b00b-faa90524f9e5 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:01.992399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523ce81-b22f-44f2-b00b-faa90524f9e5 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:02.000591 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac1c62-78e9-4c3c-9150-1f03b2fdf2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:02.001259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac1c62-78e9-4c3c-9150-1f03b2fdf2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:02.001863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac1c62-78e9-4c3c-9150-1f03b2fdf2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:02.001863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac1c62-78e9-4c3c-9150-1f03b2fdf2c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:02.002510 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac1c62-78e9-4c3c-9150-1f03b2fdf2c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:02.004767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac1c62-78e9-4c3c-9150-1f03b2fdf2c0 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:02.085556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1109/2247] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:10:01 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:10:02.090964 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a093532-1462-4ede-93ec-a78d5294b16d admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:02.112568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a093532-1462-4ede-93ec-a78d5294b16d admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:02.251158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f5216-65eb-4ef7-aff3-83e1a8554d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:02.252148 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f5216-65eb-4ef7-aff3-83e1a8554d43 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:02.252300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f5216-65eb-4ef7-aff3-83e1a8554d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:02.252519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f5216-65eb-4ef7-aff3-83e1a8554d43 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:02.253425 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f5216-65eb-4ef7-aff3-83e1a8554d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:02.256787 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f5216-65eb-4ef7-aff3-83e1a8554d43 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:02.314322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1139/2248] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:10:02 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:02.315618 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac1c62-78e9-4c3c-9150-1f03b2fdf2c0 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:02.335331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac1c62-78e9-4c3c-9150-1f03b2fdf2c0 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:02.369303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ca0f2-315a-40c0-9f36-16e83f712ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:02.369940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ca0f2-315a-40c0-9f36-16e83f712ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:02.370226 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ca0f2-315a-40c0-9f36-16e83f712ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:02.370516 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ca0f2-315a-40c0-9f36-16e83f712ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:02.371177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ca0f2-315a-40c0-9f36-16e83f712ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:02.372989 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ca0f2-315a-40c0-9f36-16e83f712ab7 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:02.414688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1110/2249] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:10:02.420216 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f5216-65eb-4ef7-aff3-83e1a8554d43 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:02.434636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f5216-65eb-4ef7-aff3-83e1a8554d43 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:02.442041 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf4468-ddd2-4e2a-852d-f19b619a9fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:02.442982 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf4468-ddd2-4e2a-852d-f19b619a9fee admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:02.444450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf4468-ddd2-4e2a-852d-f19b619a9fee admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:02.444942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf4468-ddd2-4e2a-852d-f19b619a9fee admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:02.445709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf4468-ddd2-4e2a-852d-f19b619a9fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:02.448233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf4468-ddd2-4e2a-852d-f19b619a9fee admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:02.482533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1140/2250] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:10:02.489712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ca0f2-315a-40c0-9f36-16e83f712ab7 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:02.510744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ca0f2-315a-40c0-9f36-16e83f712ab7 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:02.529574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62d1ec-b5b7-4ba9-a6a1-9048031dc60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:02.537079 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62d1ec-b5b7-4ba9-a6a1-9048031dc60e admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:02.537079 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62d1ec-b5b7-4ba9-a6a1-9048031dc60e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:02.537079 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62d1ec-b5b7-4ba9-a6a1-9048031dc60e admin admin] PATH_INFO: `/v3/projects/0050ce324be141a8988d4d4e51efd4c2/users/f1f4dbb1139a4cecaaf70f35b7b09d3d/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:02.577690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:02.590347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62d1ec-b5b7-4ba9-a6a1-9048031dc60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0050ce324be141a8988d4d4e51efd4c2, user_id=f1f4dbb1139a4cecaaf70f35b7b09d3d, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:02.594584 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62d1ec-b5b7-4ba9-a6a1-9048031dc60e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:02.629009 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1111/2251] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:02 2022] PUT /identity/v3/projects/0050ce324be141a8988d4d4e51efd4c2/users/f1f4dbb1139a4cecaaf70f35b7b09d3d/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:02.665234 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf0972-b629-4ed0-b942-5ad2087a76b1 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:02.665709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf0972-b629-4ed0-b942-5ad2087a76b1 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:02.666154 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf0972-b629-4ed0-b942-5ad2087a76b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:02.722122 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62d1ec-b5b7-4ba9-a6a1-9048031dc60e admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:02.724870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6b62d1ec-b5b7-4ba9-a6a1-9048031dc60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:02.727031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-aabf0972-b629-4ed0-b942-5ad2087a76b1 None None] MFA Rules not processed for user `f1f4dbb1139a4cecaaf70f35b7b09d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:02.729573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-aabf0972-b629-4ed0-b942-5ad2087a76b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:02.830435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:02.872999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1141/2252] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:02.873758 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf0972-b629-4ed0-b942-5ad2087a76b1 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:02.889171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62d1ec-b5b7-4ba9-a6a1-9048031dc60e admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:02.904445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf0972-b629-4ed0-b942-5ad2087a76b1 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:02.909920 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563920e1-9eb0-4bca-9370-d2c3a472cb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:02.910579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563920e1-9eb0-4bca-9370-d2c3a472cb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:02.910854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563920e1-9eb0-4bca-9370-d2c3a472cb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:02.911227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563920e1-9eb0-4bca-9370-d2c3a472cb0d admin admin] PATH_INFO: `/v3/projects/36ab7e3ac2ea4086bd58178748e72322` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:02.913951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563920e1-9eb0-4bca-9370-d2c3a472cb0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ab7e3ac2ea4086bd58178748e72322)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:02.918847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc6954-db17-42ae-8b7f-cfd8b0e84888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:02.919355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563920e1-9eb0-4bca-9370-d2c3a472cb0d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:02.920057 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc6954-db17-42ae-8b7f-cfd8b0e84888 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:02.920722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc6954-db17-42ae-8b7f-cfd8b0e84888 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:02.921222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc6954-db17-42ae-8b7f-cfd8b0e84888 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:02.929022 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc6954-db17-42ae-8b7f-cfd8b0e84888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:02.929022 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc6954-db17-42ae-8b7f-cfd8b0e84888 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:02.973534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1142/2253] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:10:02 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:02.978058 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc6954-db17-42ae-8b7f-cfd8b0e84888 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:03.012057 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-563920e1-9eb0-4bca-9370-d2c3a472cb0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ab7e3ac2ea4086bd58178748e72322', 'request_id': 'req-563920e1-9eb0-4bca-9370-d2c3a472cb0d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:03.029246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-563920e1-9eb0-4bca-9370-d2c3a472cb0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ab7e3ac2ea4086bd58178748e72322', 'request_id': 'req-563920e1-9eb0-4bca-9370-d2c3a472cb0d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:03.037206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-563920e1-9eb0-4bca-9370-d2c3a472cb0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ab7e3ac2ea4086bd58178748e72322', 'request_id': 'req-563920e1-9eb0-4bca-9370-d2c3a472cb0d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:03.055525 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-563920e1-9eb0-4bca-9370-d2c3a472cb0d admin admin] The token cache is being invalidate because project 36ab7e3ac2ea4086bd58178748e72322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:03.056602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-563920e1-9eb0-4bca-9370-d2c3a472cb0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:03.057618 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-563920e1-9eb0-4bca-9370-d2c3a472cb0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:03.064171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1112/2254] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:02 2022] DELETE /identity/v3/projects/36ab7e3ac2ea4086bd58178748e72322 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:03.069115 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563920e1-9eb0-4bca-9370-d2c3a472cb0d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:03.070847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-563920e1-9eb0-4bca-9370-d2c3a472cb0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:03.133628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc6954-db17-42ae-8b7f-cfd8b0e84888 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:03.236016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563920e1-9eb0-4bca-9370-d2c3a472cb0d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:03.244922 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307ddf0-be06-40ef-950c-73775643c5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:03.245604 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307ddf0-be06-40ef-950c-73775643c5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:03.245884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307ddf0-be06-40ef-950c-73775643c5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:03.246158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307ddf0-be06-40ef-950c-73775643c5f3 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:03.246875 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307ddf0-be06-40ef-950c-73775643c5f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:03.251391 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307ddf0-be06-40ef-950c-73775643c5f3 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:03.254195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bffb3b-df57-4653-8515-791a1d876237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:03.254195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bffb3b-df57-4653-8515-791a1d876237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:03.254195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bffb3b-df57-4653-8515-791a1d876237 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:03.254751 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bffb3b-df57-4653-8515-791a1d876237 admin admin] PATH_INFO: `/v3/users/b2336127dc83490f932ddfdaa3346fb4` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:03.258085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bffb3b-df57-4653-8515-791a1d876237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2336127dc83490f932ddfdaa3346fb4)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:03.260239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bffb3b-df57-4653-8515-791a1d876237 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:03.312931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1143/2255] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:10:02 2022] POST /identity/v3/users => generated 294 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:10:03.317566 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307ddf0-be06-40ef-950c-73775643c5f3 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:03.332845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1307ddf0-be06-40ef-950c-73775643c5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:03.343694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:03.374826 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307ddf0-be06-40ef-950c-73775643c5f3 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:03.391659 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-15bffb3b-df57-4653-8515-791a1d876237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2336127dc83490f932ddfdaa3346fb4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:03.392624 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-15bffb3b-df57-4653-8515-791a1d876237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2336127dc83490f932ddfdaa3346fb4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:03.398012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e36748-11e9-45cc-86ae-3e16bab360e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:03.400625 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e36748-11e9-45cc-86ae-3e16bab360e8 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:03.403456 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e36748-11e9-45cc-86ae-3e16bab360e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:03.403872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e36748-11e9-45cc-86ae-3e16bab360e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:03.404948 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e36748-11e9-45cc-86ae-3e16bab360e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:03.410780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e36748-11e9-45cc-86ae-3e16bab360e8 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:03.411616 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-15bffb3b-df57-4653-8515-791a1d876237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2336127dc83490f932ddfdaa3346fb4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:03.415104 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-15bffb3b-df57-4653-8515-791a1d876237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2336127dc83490f932ddfdaa3346fb4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:03.439221 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-15bffb3b-df57-4653-8515-791a1d876237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2336127dc83490f932ddfdaa3346fb4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:03.456075 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1144/2256] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:03.461227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e36748-11e9-45cc-86ae-3e16bab360e8 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:03.467595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-09e36748-11e9-45cc-86ae-3e16bab360e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:03.522019 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e36748-11e9-45cc-86ae-3e16bab360e8 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:03.527736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1113/2257] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:03 2022] DELETE /identity/v3/users/b2336127dc83490f932ddfdaa3346fb4 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:03.538054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9355f-4b7d-45fb-8fc9-5249a49b5b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:03.538703 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9355f-4b7d-45fb-8fc9-5249a49b5b0c admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:03.538988 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9355f-4b7d-45fb-8fc9-5249a49b5b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:03.539263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9355f-4b7d-45fb-8fc9-5249a49b5b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:03.539929 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9355f-4b7d-45fb-8fc9-5249a49b5b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:03.542870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9355f-4b7d-45fb-8fc9-5249a49b5b0c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:03.561075 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1145/2258] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:03.565544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bffb3b-df57-4653-8515-791a1d876237 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:03.777560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bffb3b-df57-4653-8515-791a1d876237 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:03.789376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802985b5-b83d-4899-b909-ce15e567d343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:03.791244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802985b5-b83d-4899-b909-ce15e567d343 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:03.791660 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802985b5-b83d-4899-b909-ce15e567d343 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:03.791989 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802985b5-b83d-4899-b909-ce15e567d343 admin admin] PATH_INFO: `/v3/projects/b1800893b5094b8bbdb61dca29ce14e4/users/5f719d191c9f4f44b26bea2482d38a87/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:03.820951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802985b5-b83d-4899-b909-ce15e567d343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1800893b5094b8bbdb61dca29ce14e4, user_id=5f719d191c9f4f44b26bea2482d38a87, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:03.823949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802985b5-b83d-4899-b909-ce15e567d343 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:03.857066 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf862d-eb7a-45c4-a6c3-62b7ea6969bf None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:03.857426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf862d-eb7a-45c4-a6c3-62b7ea6969bf None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:03.857629 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf862d-eb7a-45c4-a6c3-62b7ea6969bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:03.860336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1114/2259] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:03 2022] PUT /identity/v3/projects/b1800893b5094b8bbdb61dca29ce14e4/users/5f719d191c9f4f44b26bea2482d38a87/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:03.908057 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-56bf862d-eb7a-45c4-a6c3-62b7ea6969bf None None] MFA Rules not processed for user `5f719d191c9f4f44b26bea2482d38a87`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:03.909807 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-56bf862d-eb7a-45c4-a6c3-62b7ea6969bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:03.954922 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:04.009918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1146/2260] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:04.015556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802985b5-b83d-4899-b909-ce15e567d343 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:04.135528 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802985b5-b83d-4899-b909-ce15e567d343 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:04.168494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20589598-e5f9-41a4-88ec-375c960ae5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:04.168494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20589598-e5f9-41a4-88ec-375c960ae5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:04.168494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20589598-e5f9-41a4-88ec-375c960ae5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:04.168494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20589598-e5f9-41a4-88ec-375c960ae5b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:04.169277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20589598-e5f9-41a4-88ec-375c960ae5b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:04.169277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20589598-e5f9-41a4-88ec-375c960ae5b0 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:04.206557 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1115/2261] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:10:04 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:04.211126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf862d-eb7a-45c4-a6c3-62b7ea6969bf None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:04.230114 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf862d-eb7a-45c4-a6c3-62b7ea6969bf None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:04.356775 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684970af-f896-428f-96df-2ad8f14ec21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:04.358128 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684970af-f896-428f-96df-2ad8f14ec21b admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:04.358736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684970af-f896-428f-96df-2ad8f14ec21b admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:04.359116 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684970af-f896-428f-96df-2ad8f14ec21b admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:04.359882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684970af-f896-428f-96df-2ad8f14ec21b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:04.362523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684970af-f896-428f-96df-2ad8f14ec21b admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:04.395157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1147/2262] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:10:04 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:04.400017 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20589598-e5f9-41a4-88ec-375c960ae5b0 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:04.411412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20589598-e5f9-41a4-88ec-375c960ae5b0 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:04.416817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c13ef1-dab9-4554-b887-396b8305f96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:04.417647 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c13ef1-dab9-4554-b887-396b8305f96c admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:04.417795 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c13ef1-dab9-4554-b887-396b8305f96c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:04.417995 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c13ef1-dab9-4554-b887-396b8305f96c admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:04.418789 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c13ef1-dab9-4554-b887-396b8305f96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:04.420849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c13ef1-dab9-4554-b887-396b8305f96c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:04.422460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:04.437350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1116/2263] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:04.441133 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684970af-f896-428f-96df-2ad8f14ec21b admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:04.454839 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684970af-f896-428f-96df-2ad8f14ec21b admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:04.463617 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c45b6a-e333-4295-b42b-8796335ad2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:04.464444 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c45b6a-e333-4295-b42b-8796335ad2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:04.464797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c45b6a-e333-4295-b42b-8796335ad2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:04.465143 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c45b6a-e333-4295-b42b-8796335ad2ae admin admin] PATH_INFO: `/v3/projects/7e4251e2c5ca41bfab1906700a4d8db1/users/db0453e98f784f649c37ca8397445da6/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:04.484543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c45b6a-e333-4295-b42b-8796335ad2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4251e2c5ca41bfab1906700a4d8db1, user_id=db0453e98f784f649c37ca8397445da6, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:04.487638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c45b6a-e333-4295-b42b-8796335ad2ae admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:04.507488 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1148/2264] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:04 2022] PUT /identity/v3/projects/7e4251e2c5ca41bfab1906700a4d8db1/users/db0453e98f784f649c37ca8397445da6/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:04.512204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c13ef1-dab9-4554-b887-396b8305f96c admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:04.524304 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c13ef1-dab9-4554-b887-396b8305f96c admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:04.613416 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c45b6a-e333-4295-b42b-8796335ad2ae admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:04.615226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d2c45b6a-e333-4295-b42b-8796335ad2ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:04.628762 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78b249-53b1-4b8a-be65-477aff1321de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:04.629730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b249-53b1-4b8a-be65-477aff1321de admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:04.630208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b249-53b1-4b8a-be65-477aff1321de admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:04.630718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b249-53b1-4b8a-be65-477aff1321de admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:04.632953 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78b249-53b1-4b8a-be65-477aff1321de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:04.640611 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78b249-53b1-4b8a-be65-477aff1321de admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:04.680693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1117/2265] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:04.682080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78b249-53b1-4b8a-be65-477aff1321de admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:04.687217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4e78b249-53b1-4b8a-be65-477aff1321de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:04.728215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78b249-53b1-4b8a-be65-477aff1321de admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:04.735627 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec172c4-4486-4083-b661-039c024caea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:04.736707 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec172c4-4486-4083-b661-039c024caea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:04.737206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec172c4-4486-4083-b661-039c024caea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:04.737656 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec172c4-4486-4083-b661-039c024caea5 admin admin] PATH_INFO: `/v3/projects/bfc2e40838e14e60b0893a7e8b43d27d` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:04.739350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec172c4-4486-4083-b661-039c024caea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc2e40838e14e60b0893a7e8b43d27d)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:04.743601 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec172c4-4486-4083-b661-039c024caea5 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:04.830832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c45b6a-e333-4295-b42b-8796335ad2ae admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:04.853530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf416c-a339-4387-b5be-b31fcab18e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:04.854347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf416c-a339-4387-b5be-b31fcab18e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:04.854633 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf416c-a339-4387-b5be-b31fcab18e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:04.854906 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf416c-a339-4387-b5be-b31fcab18e38 admin admin] PATH_INFO: `/v3/users/e911a82860d04fd1a2bd221ac816b63e` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:04.859808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf416c-a339-4387-b5be-b31fcab18e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e911a82860d04fd1a2bd221ac816b63e)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:04.865435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf416c-a339-4387-b5be-b31fcab18e38 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:04.888454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-eec172c4-4486-4083-b661-039c024caea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc2e40838e14e60b0893a7e8b43d27d', 'request_id': 'req-eec172c4-4486-4083-b661-039c024caea5'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:04.930905 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-eec172c4-4486-4083-b661-039c024caea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc2e40838e14e60b0893a7e8b43d27d', 'request_id': 'req-eec172c4-4486-4083-b661-039c024caea5'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:04.942338 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-eec172c4-4486-4083-b661-039c024caea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc2e40838e14e60b0893a7e8b43d27d', 'request_id': 'req-eec172c4-4486-4083-b661-039c024caea5'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:04.968438 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:04.977006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-eec172c4-4486-4083-b661-039c024caea5 admin admin] The token cache is being invalidate because project bfc2e40838e14e60b0893a7e8b43d27d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:04.977459 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-eec172c4-4486-4083-b661-039c024caea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:04.979811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-eec172c4-4486-4083-b661-039c024caea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:04.984141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1118/2266] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:04 2022] DELETE /identity/v3/projects/bfc2e40838e14e60b0893a7e8b43d27d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:04.985225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec172c4-4486-4083-b661-039c024caea5 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:04.991366 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5faf416c-a339-4387-b5be-b31fcab18e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e911a82860d04fd1a2bd221ac816b63e'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:04.991601 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-eec172c4-4486-4083-b661-039c024caea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:04.992275 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5faf416c-a339-4387-b5be-b31fcab18e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e911a82860d04fd1a2bd221ac816b63e'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:05.003828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5faf416c-a339-4387-b5be-b31fcab18e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e911a82860d04fd1a2bd221ac816b63e'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:05.023309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5faf416c-a339-4387-b5be-b31fcab18e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e911a82860d04fd1a2bd221ac816b63e'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:05.036149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-5faf416c-a339-4387-b5be-b31fcab18e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e911a82860d04fd1a2bd221ac816b63e'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:05.045789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1149/2267] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:04 2022] DELETE /identity/v3/users/e911a82860d04fd1a2bd221ac816b63e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:10:05.047892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b8a7e-a5f3-4e0d-8ed9-051ecae986ee None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:05.048194 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b8a7e-a5f3-4e0d-8ed9-051ecae986ee None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:05.048587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b8a7e-a5f3-4e0d-8ed9-051ecae986ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:05.089088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-ea7b8a7e-a5f3-4e0d-8ed9-051ecae986ee None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:05.091732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ea7b8a7e-a5f3-4e0d-8ed9-051ecae986ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:05.154936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec172c4-4486-4083-b661-039c024caea5 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:05.215067 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:05.227008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1150/2268] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:05.228830 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9cf8c-7b32-4f40-ad1f-147cd8f49cb1 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:05.231260 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9cf8c-7b32-4f40-ad1f-147cd8f49cb1 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:05.231813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9cf8c-7b32-4f40-ad1f-147cd8f49cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:05.305051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-dfe9cf8c-7b32-4f40-ad1f-147cd8f49cb1 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:05.311278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-dfe9cf8c-7b32-4f40-ad1f-147cd8f49cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:05.330704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1151/2269] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:05.332105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0044c-426a-4950-9fd0-91c5ecb1ebb9 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:05.332347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0044c-426a-4950-9fd0-91c5ecb1ebb9 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:05.332649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0044c-426a-4950-9fd0-91c5ecb1ebb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:05.336427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b58b8-8bd2-474f-b2d4-4c421b7e55b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:05.341971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b58b8-8bd2-474f-b2d4-4c421b7e55b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:05.342618 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b58b8-8bd2-474f-b2d4-4c421b7e55b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:05.343105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b58b8-8bd2-474f-b2d4-4c421b7e55b4 admin admin] PATH_INFO: `/v3/projects/7e4251e2c5ca41bfab1906700a4d8db1/users/db0453e98f784f649c37ca8397445da6/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:05.345627 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b58b8-8bd2-474f-b2d4-4c421b7e55b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4251e2c5ca41bfab1906700a4d8db1, user_id=db0453e98f784f649c37ca8397445da6, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:05.349244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b58b8-8bd2-474f-b2d4-4c421b7e55b4 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:05.376980 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1119/2270] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:04 2022] PUT /identity/v3/projects/7e4251e2c5ca41bfab1906700a4d8db1/users/db0453e98f784f649c37ca8397445da6/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:05.378540 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b58b8-8bd2-474f-b2d4-4c421b7e55b4 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:05.384558 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b35b58b8-8bd2-474f-b2d4-4c421b7e55b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:05.395353 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-9bf0044c-426a-4950-9fd0-91c5ecb1ebb9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:05.397168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9bf0044c-426a-4950-9fd0-91c5ecb1ebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:05.553140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b58b8-8bd2-474f-b2d4-4c421b7e55b4 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:05.559141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a317dee-915f-440b-b63a-1c178da675e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:05.560263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a317dee-915f-440b-b63a-1c178da675e5 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:05.560586 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a317dee-915f-440b-b63a-1c178da675e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:05.560761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a317dee-915f-440b-b63a-1c178da675e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:05.607335 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1152/2271] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:05.610273 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64c2e4-262c-47ac-b2b3-98fac3d2c016 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:05.610570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64c2e4-262c-47ac-b2b3-98fac3d2c016 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:05.610850 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64c2e4-262c-47ac-b2b3-98fac3d2c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:05.652320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-9b64c2e4-262c-47ac-b2b3-98fac3d2c016 None None] MFA Rules not processed for user `db0453e98f784f649c37ca8397445da6`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:05.653847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9b64c2e4-262c-47ac-b2b3-98fac3d2c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:05.699713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a317dee-915f-440b-b63a-1c178da675e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:05.702202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a317dee-915f-440b-b63a-1c178da675e5 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:05.716868 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1120/2272] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:05.717782 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a317dee-915f-440b-b63a-1c178da675e5 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:05.731838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a317dee-915f-440b-b63a-1c178da675e5 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:05.739225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f9387-5847-43da-9ccd-334a4303e20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:05.740145 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f9387-5847-43da-9ccd-334a4303e20b admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:05.740756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:05.740955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f9387-5847-43da-9ccd-334a4303e20b admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:05.742530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f9387-5847-43da-9ccd-334a4303e20b admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:05.744120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f9387-5847-43da-9ccd-334a4303e20b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:10:05.744795 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f9387-5847-43da-9ccd-334a4303e20b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:05.747482 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f9387-5847-43da-9ccd-334a4303e20b admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:05.776766 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1121/2273] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:10:05.778401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f9387-5847-43da-9ccd-334a4303e20b admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:05.793074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f9387-5847-43da-9ccd-334a4303e20b admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:05.802686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33ed3e-c28b-4cab-bea9-6bbfb70edbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:05.803434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33ed3e-c28b-4cab-bea9-6bbfb70edbcc admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:05.803958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33ed3e-c28b-4cab-bea9-6bbfb70edbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:05.804267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33ed3e-c28b-4cab-bea9-6bbfb70edbcc admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:05.805348 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33ed3e-c28b-4cab-bea9-6bbfb70edbcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:05.808024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33ed3e-c28b-4cab-bea9-6bbfb70edbcc admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:05.842520 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1153/2274] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:05.865397 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1122/2275] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:10:05 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:05.867758 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64c2e4-262c-47ac-b2b3-98fac3d2c016 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:05.869424 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33ed3e-c28b-4cab-bea9-6bbfb70edbcc admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:05.870421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9b64c2e4-262c-47ac-b2b3-98fac3d2c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:05.957451 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:06.045633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33ed3e-c28b-4cab-bea9-6bbfb70edbcc admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:06.054382 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ad041-634c-4b91-9711-0c673f5529d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:06.055906 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ad041-634c-4b91-9711-0c673f5529d7 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:06.057354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ad041-634c-4b91-9711-0c673f5529d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:06.057660 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ad041-634c-4b91-9711-0c673f5529d7 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:06.060226 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ad041-634c-4b91-9711-0c673f5529d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:06.064303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ad041-634c-4b91-9711-0c673f5529d7 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:06.078835 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64c2e4-262c-47ac-b2b3-98fac3d2c016 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:06.110793 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1123/2276] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:10:05 2022] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:06.116780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ad041-634c-4b91-9711-0c673f5529d7 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:06.131101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ad041-634c-4b91-9711-0c673f5529d7 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:06.142311 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72910ff4-d253-4b89-9e73-850d8ac592d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:06.144699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72910ff4-d253-4b89-9e73-850d8ac592d4 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:06.145362 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72910ff4-d253-4b89-9e73-850d8ac592d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:06.145804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72910ff4-d253-4b89-9e73-850d8ac592d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:06.146601 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72910ff4-d253-4b89-9e73-850d8ac592d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:06.149287 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72910ff4-d253-4b89-9e73-850d8ac592d4 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:06.183681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1124/2277] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:06.190615 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72910ff4-d253-4b89-9e73-850d8ac592d4 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:06.210250 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72910ff4-d253-4b89-9e73-850d8ac592d4 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:06.220546 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3565c9-201f-4d0b-ba23-70e008dd506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:06.221638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3565c9-201f-4d0b-ba23-70e008dd506e admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:06.222135 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3565c9-201f-4d0b-ba23-70e008dd506e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:06.222360 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7f8a5-5e56-47ba-a2ea-553346bb27aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:06.222629 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3565c9-201f-4d0b-ba23-70e008dd506e admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:06.223742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7f8a5-5e56-47ba-a2ea-553346bb27aa service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:06.223902 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3565c9-201f-4d0b-ba23-70e008dd506e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:06.224509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7f8a5-5e56-47ba-a2ea-553346bb27aa service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:06.225401 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7f8a5-5e56-47ba-a2ea-553346bb27aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:06.226835 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3565c9-201f-4d0b-ba23-70e008dd506e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:06.256482 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1125/2278] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:06.258820 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3565c9-201f-4d0b-ba23-70e008dd506e admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:06.280717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3565c9-201f-4d0b-ba23-70e008dd506e admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:06.287543 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983e9a6-4de4-4659-82c6-b20656ba6ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:06.288851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983e9a6-4de4-4659-82c6-b20656ba6ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:06.289864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983e9a6-4de4-4659-82c6-b20656ba6ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:06.290296 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983e9a6-4de4-4659-82c6-b20656ba6ac4 admin admin] PATH_INFO: `/v3/projects/6d8df9df35d04aafaa6bf2e6e10e926e/users/fe7af97b43dd427c8db9d6963cee2492/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:06.319254 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983e9a6-4de4-4659-82c6-b20656ba6ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8df9df35d04aafaa6bf2e6e10e926e, user_id=fe7af97b43dd427c8db9d6963cee2492, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:06.322962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983e9a6-4de4-4659-82c6-b20656ba6ac4 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:06.347704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1126/2279] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:06 2022] PUT /identity/v3/projects/6d8df9df35d04aafaa6bf2e6e10e926e/users/fe7af97b43dd427c8db9d6963cee2492/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:10:06.350270 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983e9a6-4de4-4659-82c6-b20656ba6ac4 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:06.353225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a983e9a6-4de4-4659-82c6-b20656ba6ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:06.361157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7f8a5-5e56-47ba-a2ea-553346bb27aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:06.364493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7f8a5-5e56-47ba-a2ea-553346bb27aa service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:06.376721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1154/2280] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:06.378079 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207ea10-d54d-4bae-b52e-af551c36a8fe None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:06.378368 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207ea10-d54d-4bae-b52e-af551c36a8fe None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:06.378646 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207ea10-d54d-4bae-b52e-af551c36a8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:06.416238 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-5207ea10-d54d-4bae-b52e-af551c36a8fe None None] MFA Rules not processed for user `fe7af97b43dd427c8db9d6963cee2492`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:06.417648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5207ea10-d54d-4bae-b52e-af551c36a8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:06.468024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:06.512807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983e9a6-4de4-4659-82c6-b20656ba6ac4 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:06.520348 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:06.521260 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:06.521732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:06.522206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a admin admin] PATH_INFO: `/v3/projects/5aabb43e80334e4d8f93a847f5f49f29` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:06.524250 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aabb43e80334e4d8f93a847f5f49f29)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:06.536819 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:06.537009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1155/2281] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:06.565908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207ea10-d54d-4bae-b52e-af551c36a8fe None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:06.567953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5207ea10-d54d-4bae-b52e-af551c36a8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:06.627487 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aabb43e80334e4d8f93a847f5f49f29', 'request_id': 'req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:06.650382 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aabb43e80334e4d8f93a847f5f49f29', 'request_id': 'req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:06.665285 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aabb43e80334e4d8f93a847f5f49f29', 'request_id': 'req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:06.682357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207ea10-d54d-4bae-b52e-af551c36a8fe None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:06.710856 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a admin admin] The token cache is being invalidate because project 5aabb43e80334e4d8f93a847f5f49f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:06.711614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:06.713950 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:06.717602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1127/2282] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:06 2022] DELETE /identity/v3/projects/5aabb43e80334e4d8f93a847f5f49f29 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:06.762121 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150669b0-528f-4afc-b65f-9d8ca4bd7dab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:06.762611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150669b0-528f-4afc-b65f-9d8ca4bd7dab service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:06.763108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150669b0-528f-4afc-b65f-9d8ca4bd7dab service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:06.763535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150669b0-528f-4afc-b65f-9d8ca4bd7dab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:06.766522 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-150669b0-528f-4afc-b65f-9d8ca4bd7dab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:06.897403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150669b0-528f-4afc-b65f-9d8ca4bd7dab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:06.900077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150669b0-528f-4afc-b65f-9d8ca4bd7dab service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:06.932042 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1156/2283] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:10:08.058995 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:08.070187 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:08.090911 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:08.103839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb567a-7bdc-4cbf-ab47-fdb9226d6c6a admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:08.116203 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6566d7-0ea5-44ce-b63e-93c5100c6cb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:08.117955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6566d7-0ea5-44ce-b63e-93c5100c6cb8 service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:08.118780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6566d7-0ea5-44ce-b63e-93c5100c6cb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:08.119515 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6566d7-0ea5-44ce-b63e-93c5100c6cb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:08.123780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-cb6566d7-0ea5-44ce-b63e-93c5100c6cb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:08.234084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6566d7-0ea5-44ce-b63e-93c5100c6cb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:08.251402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6566d7-0ea5-44ce-b63e-93c5100c6cb8 service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:08.276932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1128/2284] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:13.086796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150669b0-528f-4afc-b65f-9d8ca4bd7dab service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:13.088614 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-150669b0-528f-4afc-b65f-9d8ca4bd7dab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:13.102836 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150669b0-528f-4afc-b65f-9d8ca4bd7dab service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:13.107681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5111cd-a296-4377-a979-8d19e33c4286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:13.108526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5111cd-a296-4377-a979-8d19e33c4286 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:13.108812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5111cd-a296-4377-a979-8d19e33c4286 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:13.109151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5111cd-a296-4377-a979-8d19e33c4286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:13.111383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-2b5111cd-a296-4377-a979-8d19e33c4286 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:13.194505 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:13.239665 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5111cd-a296-4377-a979-8d19e33c4286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:13.242596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5111cd-a296-4377-a979-8d19e33c4286 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:13.265039 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1157/2285] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:16.314176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6566d7-0ea5-44ce-b63e-93c5100c6cb8 service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:16.316075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-cb6566d7-0ea5-44ce-b63e-93c5100c6cb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:16.423220 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6566d7-0ea5-44ce-b63e-93c5100c6cb8 service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:16.429374 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93a891-580f-490b-ba81-4a1a069880cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:16.430459 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93a891-580f-490b-ba81-4a1a069880cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:16.430757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93a891-580f-490b-ba81-4a1a069880cd admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:16.431031 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93a891-580f-490b-ba81-4a1a069880cd admin admin] PATH_INFO: `/v3/users/f1f4dbb1139a4cecaaf70f35b7b09d3d` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:16.432312 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93a891-580f-490b-ba81-4a1a069880cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f4dbb1139a4cecaaf70f35b7b09d3d)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:16.434373 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93a891-580f-490b-ba81-4a1a069880cd admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:16.535016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-af93a891-580f-490b-ba81-4a1a069880cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f4dbb1139a4cecaaf70f35b7b09d3d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:16.536001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-af93a891-580f-490b-ba81-4a1a069880cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f4dbb1139a4cecaaf70f35b7b09d3d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:16.550838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-af93a891-580f-490b-ba81-4a1a069880cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f4dbb1139a4cecaaf70f35b7b09d3d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:16.552001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-af93a891-580f-490b-ba81-4a1a069880cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f4dbb1139a4cecaaf70f35b7b09d3d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:16.582280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-af93a891-580f-490b-ba81-4a1a069880cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f4dbb1139a4cecaaf70f35b7b09d3d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:16.629559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1129/2286] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:16 2022] DELETE /identity/v3/users/f1f4dbb1139a4cecaaf70f35b7b09d3d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:16.635517 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a05fd-1288-42b6-b3e5-d136deac6f8d None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:16.636342 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a05fd-1288-42b6-b3e5-d136deac6f8d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:16.636789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a05fd-1288-42b6-b3e5-d136deac6f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:16.674299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-366a05fd-1288-42b6-b3e5-d136deac6f8d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:16.675753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-366a05fd-1288-42b6-b3e5-d136deac6f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:16.781329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1158/2287] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:16.793506 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93a891-580f-490b-ba81-4a1a069880cd admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:16.795446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-af93a891-580f-490b-ba81-4a1a069880cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:16.832713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:16.897791 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93a891-580f-490b-ba81-4a1a069880cd admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:16.905136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5a7d3-1d28-461a-9f7e-41e0a0f1b9c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:16.905585 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5a7d3-1d28-461a-9f7e-41e0a0f1b9c8 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:16.905910 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5a7d3-1d28-461a-9f7e-41e0a0f1b9c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:16.906178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5a7d3-1d28-461a-9f7e-41e0a0f1b9c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:16.918556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5a7d3-1d28-461a-9f7e-41e0a0f1b9c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:16.920683 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5a7d3-1d28-461a-9f7e-41e0a0f1b9c8 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:16.937107 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1130/2288] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:17.562808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a05fd-1288-42b6-b3e5-d136deac6f8d None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:17.565048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-366a05fd-1288-42b6-b3e5-d136deac6f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:17.580721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a05fd-1288-42b6-b3e5-d136deac6f8d None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:17.601556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01d434-a310-4f92-a534-f097df957d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:17.602508 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01d434-a310-4f92-a534-f097df957d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:17.602959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01d434-a310-4f92-a534-f097df957d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:17.603383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01d434-a310-4f92-a534-f097df957d7c admin admin] PATH_INFO: `/v3/projects/0050ce324be141a8988d4d4e51efd4c2` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:17.605136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01d434-a310-4f92-a534-f097df957d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0050ce324be141a8988d4d4e51efd4c2)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:17.607838 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01d434-a310-4f92-a534-f097df957d7c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:17.665606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-0f01d434-a310-4f92-a534-f097df957d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0050ce324be141a8988d4d4e51efd4c2', 'request_id': 'req-0f01d434-a310-4f92-a534-f097df957d7c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:17.675791 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-0f01d434-a310-4f92-a534-f097df957d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0050ce324be141a8988d4d4e51efd4c2', 'request_id': 'req-0f01d434-a310-4f92-a534-f097df957d7c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:17.685651 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-0f01d434-a310-4f92-a534-f097df957d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0050ce324be141a8988d4d4e51efd4c2', 'request_id': 'req-0f01d434-a310-4f92-a534-f097df957d7c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:17.703251 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-0f01d434-a310-4f92-a534-f097df957d7c admin admin] The token cache is being invalidate because project 0050ce324be141a8988d4d4e51efd4c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:17.703700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-0f01d434-a310-4f92-a534-f097df957d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:17.705284 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-0f01d434-a310-4f92-a534-f097df957d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:17.706772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1159/2289] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:17 2022] DELETE /identity/v3/projects/0050ce324be141a8988d4d4e51efd4c2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:17.711235 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5a7d3-1d28-461a-9f7e-41e0a0f1b9c8 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:17.726094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5a7d3-1d28-461a-9f7e-41e0a0f1b9c8 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:17.814225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba32d7-b1e4-4549-ad95-eca59aaacd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:17.814912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba32d7-b1e4-4549-ad95-eca59aaacd21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:17.815625 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba32d7-b1e4-4549-ad95-eca59aaacd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:17.816138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba32d7-b1e4-4549-ad95-eca59aaacd21 admin admin] PATH_INFO: `/v3/users/5f719d191c9f4f44b26bea2482d38a87` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:17.817467 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba32d7-b1e4-4549-ad95-eca59aaacd21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f719d191c9f4f44b26bea2482d38a87)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:17.820115 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba32d7-b1e4-4549-ad95-eca59aaacd21 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:17.923989 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-98ba32d7-b1e4-4549-ad95-eca59aaacd21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f719d191c9f4f44b26bea2482d38a87'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:17.925166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-98ba32d7-b1e4-4549-ad95-eca59aaacd21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f719d191c9f4f44b26bea2482d38a87'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:17.940260 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-98ba32d7-b1e4-4549-ad95-eca59aaacd21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f719d191c9f4f44b26bea2482d38a87'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:17.941480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-98ba32d7-b1e4-4549-ad95-eca59aaacd21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f719d191c9f4f44b26bea2482d38a87'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:17.960843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-98ba32d7-b1e4-4549-ad95-eca59aaacd21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f719d191c9f4f44b26bea2482d38a87'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:17.992411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1131/2290] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:17 2022] DELETE /identity/v3/users/5f719d191c9f4f44b26bea2482d38a87 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:18.586341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01d434-a310-4f92-a534-f097df957d7c admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:18.589521 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0f01d434-a310-4f92-a534-f097df957d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:18.643397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01d434-a310-4f92-a534-f097df957d7c admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:18.812659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ab64e-5d0f-4fc6-b915-b8ab96439192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:18.814573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ab64e-5d0f-4fc6-b915-b8ab96439192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:18.814924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ab64e-5d0f-4fc6-b915-b8ab96439192 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:18.815261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ab64e-5d0f-4fc6-b915-b8ab96439192 admin admin] PATH_INFO: `/v3/projects/b1800893b5094b8bbdb61dca29ce14e4` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:18.817695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ab64e-5d0f-4fc6-b915-b8ab96439192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1800893b5094b8bbdb61dca29ce14e4)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:18.822264 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ab64e-5d0f-4fc6-b915-b8ab96439192 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:18.837467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:18.918493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-461ab64e-5d0f-4fc6-b915-b8ab96439192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1800893b5094b8bbdb61dca29ce14e4', 'request_id': 'req-461ab64e-5d0f-4fc6-b915-b8ab96439192'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:18.933735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-461ab64e-5d0f-4fc6-b915-b8ab96439192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1800893b5094b8bbdb61dca29ce14e4', 'request_id': 'req-461ab64e-5d0f-4fc6-b915-b8ab96439192'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:18.941332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-461ab64e-5d0f-4fc6-b915-b8ab96439192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1800893b5094b8bbdb61dca29ce14e4', 'request_id': 'req-461ab64e-5d0f-4fc6-b915-b8ab96439192'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:18.961058 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-461ab64e-5d0f-4fc6-b915-b8ab96439192 admin admin] The token cache is being invalidate because project b1800893b5094b8bbdb61dca29ce14e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:18.961446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-461ab64e-5d0f-4fc6-b915-b8ab96439192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:18.963097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-461ab64e-5d0f-4fc6-b915-b8ab96439192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:18.968189 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1160/2291] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:18 2022] DELETE /identity/v3/projects/b1800893b5094b8bbdb61dca29ce14e4 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:18.970026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba32d7-b1e4-4549-ad95-eca59aaacd21 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:18.972878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-98ba32d7-b1e4-4549-ad95-eca59aaacd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:18.989658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba32d7-b1e4-4549-ad95-eca59aaacd21 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:19.074394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:19.104809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f931f-eb29-4f77-bc18-246bfdb26ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:19.104809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f931f-eb29-4f77-bc18-246bfdb26ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:19.104809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f931f-eb29-4f77-bc18-246bfdb26ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:19.104809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f931f-eb29-4f77-bc18-246bfdb26ec9 admin admin] PATH_INFO: `/v3/users/db0453e98f784f649c37ca8397445da6` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:19.105188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f931f-eb29-4f77-bc18-246bfdb26ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0453e98f784f649c37ca8397445da6)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:19.105872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f931f-eb29-4f77-bc18-246bfdb26ec9 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:19.181805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-756f931f-eb29-4f77-bc18-246bfdb26ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0453e98f784f649c37ca8397445da6'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:19.182736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-756f931f-eb29-4f77-bc18-246bfdb26ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0453e98f784f649c37ca8397445da6'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:19.198694 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-756f931f-eb29-4f77-bc18-246bfdb26ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0453e98f784f649c37ca8397445da6'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:19.199568 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-756f931f-eb29-4f77-bc18-246bfdb26ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0453e98f784f649c37ca8397445da6'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:19.210019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-756f931f-eb29-4f77-bc18-246bfdb26ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0453e98f784f649c37ca8397445da6'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:19.236916 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1132/2292] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:18 2022] DELETE /identity/v3/users/db0453e98f784f649c37ca8397445da6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:19.807044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ab64e-5d0f-4fc6-b915-b8ab96439192 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:19.808663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-461ab64e-5d0f-4fc6-b915-b8ab96439192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:19.823265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ab64e-5d0f-4fc6-b915-b8ab96439192 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:19.964476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4113637-bf87-4063-9ab1-7aa76f792251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:19.965338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4113637-bf87-4063-9ab1-7aa76f792251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:19.965765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4113637-bf87-4063-9ab1-7aa76f792251 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:19.966691 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4113637-bf87-4063-9ab1-7aa76f792251 admin admin] PATH_INFO: `/v3/projects/7e4251e2c5ca41bfab1906700a4d8db1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:19.968809 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4113637-bf87-4063-9ab1-7aa76f792251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e4251e2c5ca41bfab1906700a4d8db1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:19.972121 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4113637-bf87-4063-9ab1-7aa76f792251 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:20.067333 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e4113637-bf87-4063-9ab1-7aa76f792251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e4251e2c5ca41bfab1906700a4d8db1', 'request_id': 'req-e4113637-bf87-4063-9ab1-7aa76f792251'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:20.079334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e4113637-bf87-4063-9ab1-7aa76f792251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e4251e2c5ca41bfab1906700a4d8db1', 'request_id': 'req-e4113637-bf87-4063-9ab1-7aa76f792251'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:20.089673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e4113637-bf87-4063-9ab1-7aa76f792251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e4251e2c5ca41bfab1906700a4d8db1', 'request_id': 'req-e4113637-bf87-4063-9ab1-7aa76f792251'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:20.116061 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e4113637-bf87-4063-9ab1-7aa76f792251 admin admin] The token cache is being invalidate because project 7e4251e2c5ca41bfab1906700a4d8db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:20.116805 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e4113637-bf87-4063-9ab1-7aa76f792251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:20.117933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e4113637-bf87-4063-9ab1-7aa76f792251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:20.120669 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1161/2293] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:19 2022] DELETE /identity/v3/projects/7e4251e2c5ca41bfab1906700a4d8db1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:20.130672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef265da-db52-4d35-9ecb-8b98cb3761ab None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:20.132135 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef265da-db52-4d35-9ecb-8b98cb3761ab None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:20.132973 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef265da-db52-4d35-9ecb-8b98cb3761ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:20.157367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-fef265da-db52-4d35-9ecb-8b98cb3761ab None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:20.158900 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fef265da-db52-4d35-9ecb-8b98cb3761ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:20.165502 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4113637-bf87-4063-9ab1-7aa76f792251 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:20.167016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e4113637-bf87-4063-9ab1-7aa76f792251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:20.205370 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:20.279236 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4113637-bf87-4063-9ab1-7aa76f792251 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:20.284763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29538be0-1bd0-4b53-a683-a09258a26cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:20.285005 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1133/2294] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:20.285488 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29538be0-1bd0-4b53-a683-a09258a26cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:20.285774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29538be0-1bd0-4b53-a683-a09258a26cce admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:20.286050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29538be0-1bd0-4b53-a683-a09258a26cce admin admin] PATH_INFO: `/v3/users/fe7af97b43dd427c8db9d6963cee2492` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:20.287246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29538be0-1bd0-4b53-a683-a09258a26cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7af97b43dd427c8db9d6963cee2492)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:20.289297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd4680-3237-4a9f-98ef-a1d03aa07a8f None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:20.290264 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd4680-3237-4a9f-98ef-a1d03aa07a8f None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:20.290711 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd4680-3237-4a9f-98ef-a1d03aa07a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:20.291069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29538be0-1bd0-4b53-a683-a09258a26cce admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:20.344349 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-75fd4680-3237-4a9f-98ef-a1d03aa07a8f None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:20.350710 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-75fd4680-3237-4a9f-98ef-a1d03aa07a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:20.372433 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1134/2295] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:20.378059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd4680-3237-4a9f-98ef-a1d03aa07a8f None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:20.404903 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd4680-3237-4a9f-98ef-a1d03aa07a8f None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:20.432177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedd2cb-046e-4a37-a7ff-3efcc0ca7cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:20.436847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedd2cb-046e-4a37-a7ff-3efcc0ca7cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:20.439856 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedd2cb-046e-4a37-a7ff-3efcc0ca7cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:20.440317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedd2cb-046e-4a37-a7ff-3efcc0ca7cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:20.441500 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bedd2cb-046e-4a37-a7ff-3efcc0ca7cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:10:20.441844 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bedd2cb-046e-4a37-a7ff-3efcc0ca7cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:20.443949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bedd2cb-046e-4a37-a7ff-3efcc0ca7cd0 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:20.450733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-29538be0-1bd0-4b53-a683-a09258a26cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7af97b43dd427c8db9d6963cee2492'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:20.451863 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-29538be0-1bd0-4b53-a683-a09258a26cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7af97b43dd427c8db9d6963cee2492'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:20.467558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-29538be0-1bd0-4b53-a683-a09258a26cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7af97b43dd427c8db9d6963cee2492'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:20.470591 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1135/2296] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:10:20.475959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedd2cb-046e-4a37-a7ff-3efcc0ca7cd0 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:20.479631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6bedd2cb-046e-4a37-a7ff-3efcc0ca7cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:20.495283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-29538be0-1bd0-4b53-a683-a09258a26cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7af97b43dd427c8db9d6963cee2492'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:20.511936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-29538be0-1bd0-4b53-a683-a09258a26cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7af97b43dd427c8db9d6963cee2492'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:20.513333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedd2cb-046e-4a37-a7ff-3efcc0ca7cd0 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:20.519796 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e44584-22a9-4e1c-a640-85f103a2a5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:20.520539 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44584-22a9-4e1c-a640-85f103a2a5ed admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:20.520857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44584-22a9-4e1c-a640-85f103a2a5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:20.521125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44584-22a9-4e1c-a640-85f103a2a5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:20.521776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e44584-22a9-4e1c-a640-85f103a2a5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:20.523739 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e44584-22a9-4e1c-a640-85f103a2a5ed admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:20.529240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1162/2297] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:20 2022] DELETE /identity/v3/users/fe7af97b43dd427c8db9d6963cee2492 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:20.534671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc2e09-3122-4ceb-9fc4-7b8b8ba0bb05 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:20.535405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc2e09-3122-4ceb-9fc4-7b8b8ba0bb05 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:20.536107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc2e09-3122-4ceb-9fc4-7b8b8ba0bb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:20.587110 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-ebbc2e09-3122-4ceb-9fc4-7b8b8ba0bb05 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:20.587667 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1136/2298] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:10:20 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:20.588802 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e44584-22a9-4e1c-a640-85f103a2a5ed admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:20.589559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ebbc2e09-3122-4ceb-9fc4-7b8b8ba0bb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:20.657336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:20.741203 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e44584-22a9-4e1c-a640-85f103a2a5ed admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:20.754660 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0710735-59d8-40bf-a20b-e7a65d23f988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:20.754660 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0710735-59d8-40bf-a20b-e7a65d23f988 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:20.754660 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0710735-59d8-40bf-a20b-e7a65d23f988 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:20.754660 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0710735-59d8-40bf-a20b-e7a65d23f988 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:20.755146 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0710735-59d8-40bf-a20b-e7a65d23f988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:20.755146 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0710735-59d8-40bf-a20b-e7a65d23f988 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:20.789710 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1137/2299] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:10:20 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:20.795631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0710735-59d8-40bf-a20b-e7a65d23f988 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:20.805531 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1163/2300] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:20.806990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc2e09-3122-4ceb-9fc4-7b8b8ba0bb05 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:20.809603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ebbc2e09-3122-4ceb-9fc4-7b8b8ba0bb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:20.824545 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0710735-59d8-40bf-a20b-e7a65d23f988 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:20.835540 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9ec0d-f217-451c-9f39-23e3fd7ef024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:20.836409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9ec0d-f217-451c-9f39-23e3fd7ef024 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:20.836802 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9ec0d-f217-451c-9f39-23e3fd7ef024 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:20.837170 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9ec0d-f217-451c-9f39-23e3fd7ef024 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:20.837945 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9ec0d-f217-451c-9f39-23e3fd7ef024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:20.840602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9ec0d-f217-451c-9f39-23e3fd7ef024 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:20.867189 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1138/2301] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:20.869552 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9ec0d-f217-451c-9f39-23e3fd7ef024 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:20.901722 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9ec0d-f217-451c-9f39-23e3fd7ef024 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:20.913692 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ec1a3-69f7-4f0f-a0da-6bba7557d8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:20.914469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ec1a3-69f7-4f0f-a0da-6bba7557d8ac admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:20.914920 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ec1a3-69f7-4f0f-a0da-6bba7557d8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:20.915300 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ec1a3-69f7-4f0f-a0da-6bba7557d8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:20.916078 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ec1a3-69f7-4f0f-a0da-6bba7557d8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:20.920439 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ec1a3-69f7-4f0f-a0da-6bba7557d8ac admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:20.945151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1139/2302] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:20.959241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ec1a3-69f7-4f0f-a0da-6bba7557d8ac admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:20.974154 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ec1a3-69f7-4f0f-a0da-6bba7557d8ac admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:20.980979 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96b372-1f89-4966-b8d5-7ac1bf453b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:20.982081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96b372-1f89-4966-b8d5-7ac1bf453b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:20.982573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96b372-1f89-4966-b8d5-7ac1bf453b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:20.983136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96b372-1f89-4966-b8d5-7ac1bf453b58 admin admin] PATH_INFO: `/v3/projects/b1bea19989614024a2fab7373b905887/users/485ec7065a5b4edabee3169c4c4b706d/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:20.984650 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:21.005090 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96b372-1f89-4966-b8d5-7ac1bf453b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1bea19989614024a2fab7373b905887, user_id=485ec7065a5b4edabee3169c4c4b706d, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:21.008614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96b372-1f89-4966-b8d5-7ac1bf453b58 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:21.030536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc2e09-3122-4ceb-9fc4-7b8b8ba0bb05 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:21.053407 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1140/2303] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:20 2022] PUT /identity/v3/projects/b1bea19989614024a2fab7373b905887/users/485ec7065a5b4edabee3169c4c4b706d/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:21.055816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcc6a2-612a-42af-89e4-739bd1e93872 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:21.056163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcc6a2-612a-42af-89e4-739bd1e93872 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:21.056659 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcc6a2-612a-42af-89e4-739bd1e93872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:21.137232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-edbcc6a2-612a-42af-89e4-739bd1e93872 None None] MFA Rules not processed for user `485ec7065a5b4edabee3169c4c4b706d`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:21.138854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-edbcc6a2-612a-42af-89e4-739bd1e93872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:21.166833 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04414459-97e8-4e20-aa42-636846e73f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:21.168288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04414459-97e8-4e20-aa42-636846e73f37 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:21.168965 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04414459-97e8-4e20-aa42-636846e73f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:21.169660 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04414459-97e8-4e20-aa42-636846e73f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:21.249110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1141/2304] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:21.255630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcc6a2-612a-42af-89e4-739bd1e93872 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:21.330542 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04414459-97e8-4e20-aa42-636846e73f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:21.332900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04414459-97e8-4e20-aa42-636846e73f37 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:21.352482 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1164/2305] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:21.381436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:21.393874 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcc6a2-612a-42af-89e4-739bd1e93872 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:21.400346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8109250-d218-4fff-88a0-99204fe63442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:21.401454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8109250-d218-4fff-88a0-99204fe63442 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:21.401454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8109250-d218-4fff-88a0-99204fe63442 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:21.402100 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8109250-d218-4fff-88a0-99204fe63442 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:21.403036 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8109250-d218-4fff-88a0-99204fe63442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:21.405501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8109250-d218-4fff-88a0-99204fe63442 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:21.453044 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1142/2306] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:10:21 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:10:21.459052 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04414459-97e8-4e20-aa42-636846e73f37 service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:21.481270 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04414459-97e8-4e20-aa42-636846e73f37 service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:21.627685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8396f2-8d8c-4951-96ec-3ce60533fec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:21.628154 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8396f2-8d8c-4951-96ec-3ce60533fec0 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:21.628663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8396f2-8d8c-4951-96ec-3ce60533fec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:21.629267 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8396f2-8d8c-4951-96ec-3ce60533fec0 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:21.630377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8396f2-8d8c-4951-96ec-3ce60533fec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:21.634106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8396f2-8d8c-4951-96ec-3ce60533fec0 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:21.676049 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1165/2307] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:10:21 2022] POST /identity/v3/users => generated 295 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:21.681585 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8109250-d218-4fff-88a0-99204fe63442 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:21.703209 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8109250-d218-4fff-88a0-99204fe63442 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:21.713664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18f68b-adb1-4a7f-8768-7a002790b22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:21.716366 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18f68b-adb1-4a7f-8768-7a002790b22a admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:21.717861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18f68b-adb1-4a7f-8768-7a002790b22a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:21.718838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18f68b-adb1-4a7f-8768-7a002790b22a admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:21.720233 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18f68b-adb1-4a7f-8768-7a002790b22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:21.724171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18f68b-adb1-4a7f-8768-7a002790b22a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:21.743097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1143/2308] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:21.746198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8396f2-8d8c-4951-96ec-3ce60533fec0 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:21.771183 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8396f2-8d8c-4951-96ec-3ce60533fec0 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:21.780041 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884f337-c9e9-4779-b9a4-bcfcbe1abd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:21.785601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884f337-c9e9-4779-b9a4-bcfcbe1abd89 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:21.786540 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884f337-c9e9-4779-b9a4-bcfcbe1abd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:21.786802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884f337-c9e9-4779-b9a4-bcfcbe1abd89 admin admin] PATH_INFO: `/v3/projects/9b8b5c4d1cc14cbabf81e385c19a677d/users/4461922dc3a04f0f8afc4de521fa6185/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:21.793325 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18f68b-adb1-4a7f-8768-7a002790b22a admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:21.795685 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-cc18f68b-adb1-4a7f-8768-7a002790b22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:21.816590 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18f68b-adb1-4a7f-8768-7a002790b22a admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:21.825043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74cc41-f1c2-403a-819e-4088a5fd1b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:21.826020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74cc41-f1c2-403a-819e-4088a5fd1b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:21.826312 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74cc41-f1c2-403a-819e-4088a5fd1b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:21.826654 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74cc41-f1c2-403a-819e-4088a5fd1b95 admin admin] PATH_INFO: `/v3/projects/6d8df9df35d04aafaa6bf2e6e10e926e` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:21.828663 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74cc41-f1c2-403a-819e-4088a5fd1b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8df9df35d04aafaa6bf2e6e10e926e)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:21.829435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884f337-c9e9-4779-b9a4-bcfcbe1abd89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b8b5c4d1cc14cbabf81e385c19a677d, user_id=4461922dc3a04f0f8afc4de521fa6185, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:21.831994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74cc41-f1c2-403a-819e-4088a5fd1b95 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:21.835397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884f337-c9e9-4779-b9a4-bcfcbe1abd89 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:21.867723 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1166/2309] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:21 2022] PUT /identity/v3/projects/9b8b5c4d1cc14cbabf81e385c19a677d/users/4461922dc3a04f0f8afc4de521fa6185/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:21.874751 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884f337-c9e9-4779-b9a4-bcfcbe1abd89 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:21.901545 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:21.922465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-eb74cc41-f1c2-403a-819e-4088a5fd1b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8df9df35d04aafaa6bf2e6e10e926e', 'request_id': 'req-eb74cc41-f1c2-403a-819e-4088a5fd1b95'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:21.935577 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-eb74cc41-f1c2-403a-819e-4088a5fd1b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8df9df35d04aafaa6bf2e6e10e926e', 'request_id': 'req-eb74cc41-f1c2-403a-819e-4088a5fd1b95'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:21.945757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-eb74cc41-f1c2-403a-819e-4088a5fd1b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8df9df35d04aafaa6bf2e6e10e926e', 'request_id': 'req-eb74cc41-f1c2-403a-819e-4088a5fd1b95'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:21.962334 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-eb74cc41-f1c2-403a-819e-4088a5fd1b95 admin admin] The token cache is being invalidate because project 6d8df9df35d04aafaa6bf2e6e10e926e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:21.963023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-eb74cc41-f1c2-403a-819e-4088a5fd1b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:21.963844 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-eb74cc41-f1c2-403a-819e-4088a5fd1b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:21.969999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1144/2310] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:21 2022] DELETE /identity/v3/projects/6d8df9df35d04aafaa6bf2e6e10e926e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:10:21.973430 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43425f-68d6-47e3-9dff-1c3be0c4db74 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:21.973796 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43425f-68d6-47e3-9dff-1c3be0c4db74 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:21.974877 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43425f-68d6-47e3-9dff-1c3be0c4db74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:21.980047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884f337-c9e9-4779-b9a4-bcfcbe1abd89 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:22.008091 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-2f43425f-68d6-47e3-9dff-1c3be0c4db74 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:22.010350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2f43425f-68d6-47e3-9dff-1c3be0c4db74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:22.066604 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852004f-cb1a-45d9-9c7a-8f178759ea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:22.068028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852004f-cb1a-45d9-9c7a-8f178759ea7a admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:22.068028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852004f-cb1a-45d9-9c7a-8f178759ea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:22.068028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852004f-cb1a-45d9-9c7a-8f178759ea7a admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:22.069019 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852004f-cb1a-45d9-9c7a-8f178759ea7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:22.071349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852004f-cb1a-45d9-9c7a-8f178759ea7a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:22.093715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1167/2311] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:22.099700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852004f-cb1a-45d9-9c7a-8f178759ea7a admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:22.101880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-4852004f-cb1a-45d9-9c7a-8f178759ea7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:22.108728 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1145/2312] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:22.118514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ec8c9-f55d-47a7-a994-5b48b5567bd2 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:22.118975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ec8c9-f55d-47a7-a994-5b48b5567bd2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:22.120058 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ec8c9-f55d-47a7-a994-5b48b5567bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:22.128734 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852004f-cb1a-45d9-9c7a-8f178759ea7a admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:22.138664 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54ac99-56ab-4aa4-b6e3-e67a5b223611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:22.139794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54ac99-56ab-4aa4-b6e3-e67a5b223611 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:22.140571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54ac99-56ab-4aa4-b6e3-e67a5b223611 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:22.141065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54ac99-56ab-4aa4-b6e3-e67a5b223611 admin admin] PATH_INFO: `/v3/projects/9b8b5c4d1cc14cbabf81e385c19a677d/users/4461922dc3a04f0f8afc4de521fa6185/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:22.144866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54ac99-56ab-4aa4-b6e3-e67a5b223611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b8b5c4d1cc14cbabf81e385c19a677d, user_id=4461922dc3a04f0f8afc4de521fa6185, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:22.150751 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54ac99-56ab-4aa4-b6e3-e67a5b223611 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:22.159549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-be6ec8c9-f55d-47a7-a994-5b48b5567bd2 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:22.161844 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-be6ec8c9-f55d-47a7-a994-5b48b5567bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:22.175209 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1168/2313] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:22 2022] PUT /identity/v3/projects/9b8b5c4d1cc14cbabf81e385c19a677d/users/4461922dc3a04f0f8afc4de521fa6185/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:10:22.193438 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7978a25-af79-49c6-8df0-7f2bdde22aaf None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:22.193921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7978a25-af79-49c6-8df0-7f2bdde22aaf None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:22.194413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7978a25-af79-49c6-8df0-7f2bdde22aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:22.229854 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-c7978a25-af79-49c6-8df0-7f2bdde22aaf None None] MFA Rules not processed for user `4461922dc3a04f0f8afc4de521fa6185`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:22.231674 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c7978a25-af79-49c6-8df0-7f2bdde22aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:22.257985 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:22.288223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1146/2314] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:22.291705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ec8c9-f55d-47a7-a994-5b48b5567bd2 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:22.305212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ec8c9-f55d-47a7-a994-5b48b5567bd2 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:22.316091 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71cd37-41da-42ee-9243-6dac037c536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:22.319135 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71cd37-41da-42ee-9243-6dac037c536b admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:22.320573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71cd37-41da-42ee-9243-6dac037c536b admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:22.321021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71cd37-41da-42ee-9243-6dac037c536b admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:22.321876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71cd37-41da-42ee-9243-6dac037c536b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:10:22.322481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71cd37-41da-42ee-9243-6dac037c536b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:22.324505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71cd37-41da-42ee-9243-6dac037c536b admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:22.357805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1147/2315] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:10:22.360146 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71cd37-41da-42ee-9243-6dac037c536b admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:22.385600 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71cd37-41da-42ee-9243-6dac037c536b admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:22.394423 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcf0d3-c3ff-4e72-bf7a-559464ff489f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:22.395272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcf0d3-c3ff-4e72-bf7a-559464ff489f admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:22.395701 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcf0d3-c3ff-4e72-bf7a-559464ff489f admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:22.396473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcf0d3-c3ff-4e72-bf7a-559464ff489f admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:22.397448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcf0d3-c3ff-4e72-bf7a-559464ff489f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:22.405157 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcf0d3-c3ff-4e72-bf7a-559464ff489f admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:22.405636 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1169/2316] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:10:22.439567 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7978a25-af79-49c6-8df0-7f2bdde22aaf None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:22.441565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c7978a25-af79-49c6-8df0-7f2bdde22aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:22.456740 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1148/2317] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:10:22 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:22.462661 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcf0d3-c3ff-4e72-bf7a-559464ff489f admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:22.489468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:22.537331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7978a25-af79-49c6-8df0-7f2bdde22aaf None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:22.565251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcf0d3-c3ff-4e72-bf7a-559464ff489f admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:22.575734 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084c672-a7cb-4685-bbb2-e9e564ed6c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:22.576797 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084c672-a7cb-4685-bbb2-e9e564ed6c2d admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:22.578161 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084c672-a7cb-4685-bbb2-e9e564ed6c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:22.578584 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084c672-a7cb-4685-bbb2-e9e564ed6c2d admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:22.579718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084c672-a7cb-4685-bbb2-e9e564ed6c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:22.583223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084c672-a7cb-4685-bbb2-e9e564ed6c2d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:22.612107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c910f-d709-4df0-9d19-7c399aee2520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:22.612955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c910f-d709-4df0-9d19-7c399aee2520 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:22.613237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c910f-d709-4df0-9d19-7c399aee2520 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:22.613513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c910f-d709-4df0-9d19-7c399aee2520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:22.618172 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1149/2318] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:10:22 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:22.624331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084c672-a7cb-4685-bbb2-e9e564ed6c2d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:22.642309 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084c672-a7cb-4685-bbb2-e9e564ed6c2d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:22.649977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb07afa-8145-4b47-b917-88611e287f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:22.650982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb07afa-8145-4b47-b917-88611e287f88 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:22.651475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb07afa-8145-4b47-b917-88611e287f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:22.651936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb07afa-8145-4b47-b917-88611e287f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:22.653194 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb07afa-8145-4b47-b917-88611e287f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:22.656473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb07afa-8145-4b47-b917-88611e287f88 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:22.673864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1150/2319] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:10:22.678507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb07afa-8145-4b47-b917-88611e287f88 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:22.689085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb07afa-8145-4b47-b917-88611e287f88 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:22.694718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6cbdb-b787-4220-85e8-b1763333f7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:22.695476 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6cbdb-b787-4220-85e8-b1763333f7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:22.695759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6cbdb-b787-4220-85e8-b1763333f7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:22.695943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c910f-d709-4df0-9d19-7c399aee2520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:22.696178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6cbdb-b787-4220-85e8-b1763333f7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:22.696772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6cbdb-b787-4220-85e8-b1763333f7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:22.697889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c910f-d709-4df0-9d19-7c399aee2520 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:22.698531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6cbdb-b787-4220-85e8-b1763333f7e1 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:22.708978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1170/2320] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:10:22.713696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1151/2321] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:10:22.714818 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c910f-d709-4df0-9d19-7c399aee2520 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:22.728957 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c910f-d709-4df0-9d19-7c399aee2520 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:22.735475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f6d0b-2823-4e3f-8b8c-a6fb6e9315f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:22.736479 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f6d0b-2823-4e3f-8b8c-a6fb6e9315f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:22.737098 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f6d0b-2823-4e3f-8b8c-a6fb6e9315f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:22.737359 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f6d0b-2823-4e3f-8b8c-a6fb6e9315f2 admin admin] PATH_INFO: `/v3/projects/52fa294daf8f47a48cdf0b1f17b7b151/users/cc8ea23127db47faa6addb5b0e340e17/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:22.756075 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f6d0b-2823-4e3f-8b8c-a6fb6e9315f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52fa294daf8f47a48cdf0b1f17b7b151, user_id=cc8ea23127db47faa6addb5b0e340e17, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:22.759055 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f6d0b-2823-4e3f-8b8c-a6fb6e9315f2 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:22.776503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1171/2322] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:22 2022] PUT /identity/v3/projects/52fa294daf8f47a48cdf0b1f17b7b151/users/cc8ea23127db47faa6addb5b0e340e17/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:22.783020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fdb8a-129b-42ad-beab-be89d799e2c9 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:22.783510 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fdb8a-129b-42ad-beab-be89d799e2c9 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:22.783790 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fdb8a-129b-42ad-beab-be89d799e2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:22.810308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-d50fdb8a-129b-42ad-beab-be89d799e2c9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:22.811656 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d50fdb8a-129b-42ad-beab-be89d799e2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:22.902218 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1152/2323] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:10:22.913495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f6d0b-2823-4e3f-8b8c-a6fb6e9315f2 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:22.915700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-bb6f6d0b-2823-4e3f-8b8c-a6fb6e9315f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:23.001024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f6d0b-2823-4e3f-8b8c-a6fb6e9315f2 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:23.005391 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4dc9b-9b73-4a13-91c4-22ee80152a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:23.006012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4dc9b-9b73-4a13-91c4-22ee80152a9f service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:23.006432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4dc9b-9b73-4a13-91c4-22ee80152a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:23.006709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4dc9b-9b73-4a13-91c4-22ee80152a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:23.025481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4dc9b-9b73-4a13-91c4-22ee80152a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:23.027258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4dc9b-9b73-4a13-91c4-22ee80152a9f service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:23.045943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1172/2324] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:23.297566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fdb8a-129b-42ad-beab-be89d799e2c9 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:23.312035 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fdb8a-129b-42ad-beab-be89d799e2c9 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:23.320297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fc68e-58ec-41fa-9b8f-24141a01970a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:23.321396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fc68e-58ec-41fa-9b8f-24141a01970a admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:23.321844 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fc68e-58ec-41fa-9b8f-24141a01970a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:23.322330 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fc68e-58ec-41fa-9b8f-24141a01970a admin admin] PATH_INFO: `/v3/users/485ec7065a5b4edabee3169c4c4b706d` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:23.324583 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fc68e-58ec-41fa-9b8f-24141a01970a admin admin] RBAC: Authorizing `identity:delete_user(user_id=485ec7065a5b4edabee3169c4c4b706d)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:23.328267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fc68e-58ec-41fa-9b8f-24141a01970a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:23.363392 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:23.415162 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a36fc68e-58ec-41fa-9b8f-24141a01970a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '485ec7065a5b4edabee3169c4c4b706d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:23.416083 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a36fc68e-58ec-41fa-9b8f-24141a01970a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '485ec7065a5b4edabee3169c4c4b706d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:23.434120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a36fc68e-58ec-41fa-9b8f-24141a01970a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '485ec7065a5b4edabee3169c4c4b706d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:23.435739 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a36fc68e-58ec-41fa-9b8f-24141a01970a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '485ec7065a5b4edabee3169c4c4b706d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:23.458074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-a36fc68e-58ec-41fa-9b8f-24141a01970a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '485ec7065a5b4edabee3169c4c4b706d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:23.517775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1153/2325] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:23 2022] DELETE /identity/v3/users/485ec7065a5b4edabee3169c4c4b706d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:23.522775 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881bbe-b496-4612-affa-55ed28403f02 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:23.523512 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881bbe-b496-4612-affa-55ed28403f02 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:23.523512 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881bbe-b496-4612-affa-55ed28403f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:23.558710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-cc881bbe-b496-4612-affa-55ed28403f02 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:23.559889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-cc881bbe-b496-4612-affa-55ed28403f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:23.583044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:23.723535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1173/2326] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:23.738693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fc68e-58ec-41fa-9b8f-24141a01970a admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:23.740677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a36fc68e-58ec-41fa-9b8f-24141a01970a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:23.858689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fc68e-58ec-41fa-9b8f-24141a01970a admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:23.877262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838d973-0013-48c1-a7f0-0f7f4b5c961c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:23.878102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838d973-0013-48c1-a7f0-0f7f4b5c961c service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:23.878395 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838d973-0013-48c1-a7f0-0f7f4b5c961c service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:23.878677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838d973-0013-48c1-a7f0-0f7f4b5c961c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:23.892248 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838d973-0013-48c1-a7f0-0f7f4b5c961c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:23.897728 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838d973-0013-48c1-a7f0-0f7f4b5c961c service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:23.912290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1154/2327] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:24.443653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024655-5424-4bb8-bd26-cb2711258788 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:24.444290 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024655-5424-4bb8-bd26-cb2711258788 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:24.445235 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024655-5424-4bb8-bd26-cb2711258788 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:24.447978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1174/2328] 10.222.0.30 () {54 vars in 921 bytes} [Wed Sep 7 13:10:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:10:24.476604 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f313cb-91d6-4f0c-a0f5-0a44f77918bd None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:24.477205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f313cb-91d6-4f0c-a0f5-0a44f77918bd None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:24.477497 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f313cb-91d6-4f0c-a0f5-0a44f77918bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:24.501910 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-f5f313cb-91d6-4f0c-a0f5-0a44f77918bd None None] MFA Rules not processed for user `f2420def47ee4a5b8cf4373252583d75`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:24.503794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f5f313cb-91d6-4f0c-a0f5-0a44f77918bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:24.583528 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79024655-5424-4bb8-bd26-cb2711258788 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:24.586322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-79024655-5424-4bb8-bd26-cb2711258788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:24.605838 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79024655-5424-4bb8-bd26-cb2711258788 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:24.612802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46612dc9-4901-4cb2-9be8-3f4d85f48c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:24.613571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46612dc9-4901-4cb2-9be8-3f4d85f48c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:24.613921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46612dc9-4901-4cb2-9be8-3f4d85f48c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:24.614269 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46612dc9-4901-4cb2-9be8-3f4d85f48c83 admin admin] PATH_INFO: `/v3/projects/b1bea19989614024a2fab7373b905887` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:24.617122 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46612dc9-4901-4cb2-9be8-3f4d85f48c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1bea19989614024a2fab7373b905887)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:24.619503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46612dc9-4901-4cb2-9be8-3f4d85f48c83 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:24.620337 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1155/2329] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Sep 7 13:10:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:24.639314 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e7cb-3eec-413d-8b6c-a8c31c403cd2 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:24.639606 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e7cb-3eec-413d-8b6c-a8c31c403cd2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:24.639870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e7cb-3eec-413d-8b6c-a8c31c403cd2 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:24.641992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1156/2330] 10.222.0.30 () {54 vars in 961 bytes} [Wed Sep 7 13:10:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:10:24.648967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df2284-9bbf-47e8-8628-48155048f886 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:24.650150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df2284-9bbf-47e8-8628-48155048f886 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:24.650150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df2284-9bbf-47e8-8628-48155048f886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:24.693561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-c3df2284-9bbf-47e8-8628-48155048f886 None None] MFA Rules not processed for user `f2420def47ee4a5b8cf4373252583d75`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:24.695221 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c3df2284-9bbf-47e8-8628-48155048f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:24.724318 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-46612dc9-4901-4cb2-9be8-3f4d85f48c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1bea19989614024a2fab7373b905887', 'request_id': 'req-46612dc9-4901-4cb2-9be8-3f4d85f48c83'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:24.732598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-46612dc9-4901-4cb2-9be8-3f4d85f48c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1bea19989614024a2fab7373b905887', 'request_id': 'req-46612dc9-4901-4cb2-9be8-3f4d85f48c83'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:24.741933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-46612dc9-4901-4cb2-9be8-3f4d85f48c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1bea19989614024a2fab7373b905887', 'request_id': 'req-46612dc9-4901-4cb2-9be8-3f4d85f48c83'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:24.776502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:24.782072 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-46612dc9-4901-4cb2-9be8-3f4d85f48c83 admin admin] The token cache is being invalidate because project b1bea19989614024a2fab7373b905887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:24.782439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-46612dc9-4901-4cb2-9be8-3f4d85f48c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:24.784123 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-46612dc9-4901-4cb2-9be8-3f4d85f48c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:24.785709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1175/2331] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:24 2022] DELETE /identity/v3/projects/b1bea19989614024a2fab7373b905887 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:10:24.787476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0aaac-3ec6-437d-80f6-3cc4a0271738 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:24.787766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0aaac-3ec6-437d-80f6-3cc4a0271738 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:24.787929 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0aaac-3ec6-437d-80f6-3cc4a0271738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:24.859392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-b2b0aaac-3ec6-437d-80f6-3cc4a0271738 None None] MFA Rules not processed for user `cc8ea23127db47faa6addb5b0e340e17`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:24.864007 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b2b0aaac-3ec6-437d-80f6-3cc4a0271738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:24.881038 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1157/2332] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Sep 7 13:10:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:10:24.882550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df2284-9bbf-47e8-8628-48155048f886 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:24.884300 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c3df2284-9bbf-47e8-8628-48155048f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:24.978406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df2284-9bbf-47e8-8628-48155048f886 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:24.986902 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1233cc-a144-49f7-98d1-b415a3eda606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:24.988168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1233cc-a144-49f7-98d1-b415a3eda606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:24.988529 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1233cc-a144-49f7-98d1-b415a3eda606 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:24.988867 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1233cc-a144-49f7-98d1-b415a3eda606 admin admin] PATH_INFO: `/v3/users/4461922dc3a04f0f8afc4de521fa6185` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:24.990803 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1233cc-a144-49f7-98d1-b415a3eda606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4461922dc3a04f0f8afc4de521fa6185)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:24.993313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1233cc-a144-49f7-98d1-b415a3eda606 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:25.016593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1176/2333] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:25.017338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0aaac-3ec6-437d-80f6-3cc4a0271738 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:25.047946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0aaac-3ec6-437d-80f6-3cc4a0271738 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:25.054387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681f627-9d92-4eea-80d5-20c94a461645 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2420def47ee4a5b8cf4373252583d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:25.055167 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681f627-9d92-4eea-80d5-20c94a461645 service placement] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:25.056131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681f627-9d92-4eea-80d5-20c94a461645 service placement] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:25.056131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681f627-9d92-4eea-80d5-20c94a461645 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:25.058258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9681f627-9d92-4eea-80d5-20c94a461645 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:25.083473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4f1233cc-a144-49f7-98d1-b415a3eda606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4461922dc3a04f0f8afc4de521fa6185'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:25.089554 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681f627-9d92-4eea-80d5-20c94a461645 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:25.091247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4f1233cc-a144-49f7-98d1-b415a3eda606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4461922dc3a04f0f8afc4de521fa6185'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:25.091436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681f627-9d92-4eea-80d5-20c94a461645 service placement] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:25.117320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1177/2334] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:25.119065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681f627-9d92-4eea-80d5-20c94a461645 service placement] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:25.122589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9681f627-9d92-4eea-80d5-20c94a461645 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:25.123382 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4f1233cc-a144-49f7-98d1-b415a3eda606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4461922dc3a04f0f8afc4de521fa6185'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:25.124617 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4f1233cc-a144-49f7-98d1-b415a3eda606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4461922dc3a04f0f8afc4de521fa6185'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:25.135271 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4f1233cc-a144-49f7-98d1-b415a3eda606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4461922dc3a04f0f8afc4de521fa6185'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:25.146064 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:25.171956 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1158/2335] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:24 2022] DELETE /identity/v3/users/4461922dc3a04f0f8afc4de521fa6185 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:25.229495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681f627-9d92-4eea-80d5-20c94a461645 service placement] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:25.313999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05329fd0-c6dc-4743-a76e-a21d6bd98fde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:25.314840 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329fd0-c6dc-4743-a76e-a21d6bd98fde service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:25.315705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329fd0-c6dc-4743-a76e-a21d6bd98fde service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:25.316078 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329fd0-c6dc-4743-a76e-a21d6bd98fde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:25.319067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-05329fd0-c6dc-4743-a76e-a21d6bd98fde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:25.446780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05329fd0-c6dc-4743-a76e-a21d6bd98fde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:25.448354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05329fd0-c6dc-4743-a76e-a21d6bd98fde service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:25.460579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1178/2336] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:25.708316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1233cc-a144-49f7-98d1-b415a3eda606 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:25.710377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4f1233cc-a144-49f7-98d1-b415a3eda606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:25.741798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05329fd0-c6dc-4743-a76e-a21d6bd98fde service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:25.744008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-05329fd0-c6dc-4743-a76e-a21d6bd98fde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:25.853890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:25.864763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05329fd0-c6dc-4743-a76e-a21d6bd98fde service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:25.876668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea296fc3-fdb8-49cb-b8ed-0c554c23748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:25.877318 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea296fc3-fdb8-49cb-b8ed-0c554c23748c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:25.877593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea296fc3-fdb8-49cb-b8ed-0c554c23748c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:25.877870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea296fc3-fdb8-49cb-b8ed-0c554c23748c admin admin] PATH_INFO: `/v3/projects/9b8b5c4d1cc14cbabf81e385c19a677d` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:25.879129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea296fc3-fdb8-49cb-b8ed-0c554c23748c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b8b5c4d1cc14cbabf81e385c19a677d)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:25.880986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1233cc-a144-49f7-98d1-b415a3eda606 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:25.890062 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171590b1-c5df-4481-8b2b-dc069d6b4ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:25.891033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171590b1-c5df-4481-8b2b-dc069d6b4ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:25.891315 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171590b1-c5df-4481-8b2b-dc069d6b4ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:25.891587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171590b1-c5df-4481-8b2b-dc069d6b4ee9 admin admin] PATH_INFO: `/v3/users/27761d45a52942c59c68cf8951f36240` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:25.893463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171590b1-c5df-4481-8b2b-dc069d6b4ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27761d45a52942c59c68cf8951f36240)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:25.894967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171590b1-c5df-4481-8b2b-dc069d6b4ee9 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:25.897599 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea296fc3-fdb8-49cb-b8ed-0c554c23748c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:25.953795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:25.978384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ea296fc3-fdb8-49cb-b8ed-0c554c23748c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b8b5c4d1cc14cbabf81e385c19a677d', 'request_id': 'req-ea296fc3-fdb8-49cb-b8ed-0c554c23748c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:25.979181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-171590b1-c5df-4481-8b2b-dc069d6b4ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27761d45a52942c59c68cf8951f36240'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:25.980097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-171590b1-c5df-4481-8b2b-dc069d6b4ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27761d45a52942c59c68cf8951f36240'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:25.988303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ea296fc3-fdb8-49cb-b8ed-0c554c23748c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b8b5c4d1cc14cbabf81e385c19a677d', 'request_id': 'req-ea296fc3-fdb8-49cb-b8ed-0c554c23748c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:25.991565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-171590b1-c5df-4481-8b2b-dc069d6b4ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27761d45a52942c59c68cf8951f36240'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:25.992457 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-171590b1-c5df-4481-8b2b-dc069d6b4ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27761d45a52942c59c68cf8951f36240'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:25.998946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ea296fc3-fdb8-49cb-b8ed-0c554c23748c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b8b5c4d1cc14cbabf81e385c19a677d', 'request_id': 'req-ea296fc3-fdb8-49cb-b8ed-0c554c23748c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:26.005458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-171590b1-c5df-4481-8b2b-dc069d6b4ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27761d45a52942c59c68cf8951f36240'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:26.014441 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ea296fc3-fdb8-49cb-b8ed-0c554c23748c admin admin] The token cache is being invalidate because project 9b8b5c4d1cc14cbabf81e385c19a677d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:26.014735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ea296fc3-fdb8-49cb-b8ed-0c554c23748c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:26.015929 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ea296fc3-fdb8-49cb-b8ed-0c554c23748c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:26.017609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1179/2337] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:25 2022] DELETE /identity/v3/projects/9b8b5c4d1cc14cbabf81e385c19a677d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:10:26.022556 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c9e22-9415-4edc-83e0-b8c885d4ca9e None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:26.022848 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c9e22-9415-4edc-83e0-b8c885d4ca9e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:26.023127 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c9e22-9415-4edc-83e0-b8c885d4ca9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:26.026005 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1159/2338] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:25 2022] DELETE /identity/v3/users/27761d45a52942c59c68cf8951f36240 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:26.046491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-617c9e22-9415-4edc-83e0-b8c885d4ca9e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:26.047567 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-617c9e22-9415-4edc-83e0-b8c885d4ca9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:26.110642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1180/2339] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:26.118868 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2369c-59ed-4951-9717-4efe85bfb563 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:26.119154 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2369c-59ed-4951-9717-4efe85bfb563 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:26.119427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2369c-59ed-4951-9717-4efe85bfb563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:26.139879 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-b6f2369c-59ed-4951-9717-4efe85bfb563 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:26.141735 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b6f2369c-59ed-4951-9717-4efe85bfb563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:26.151120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1160/2340] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:26.155771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c9e22-9415-4edc-83e0-b8c885d4ca9e None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:26.166448 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c9e22-9415-4edc-83e0-b8c885d4ca9e None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:26.171608 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577771b-c50f-46d6-a126-3cdb85b5e256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:26.172224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577771b-c50f-46d6-a126-3cdb85b5e256 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:26.174153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577771b-c50f-46d6-a126-3cdb85b5e256 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:26.174153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577771b-c50f-46d6-a126-3cdb85b5e256 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:26.174153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577771b-c50f-46d6-a126-3cdb85b5e256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:10:26.174153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577771b-c50f-46d6-a126-3cdb85b5e256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:26.175571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577771b-c50f-46d6-a126-3cdb85b5e256 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:26.191990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1181/2341] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:10:26.196788 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2369c-59ed-4951-9717-4efe85bfb563 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:26.205513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577771b-c50f-46d6-a126-3cdb85b5e256 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:26.210537 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2369c-59ed-4951-9717-4efe85bfb563 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:26.215595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d577771b-c50f-46d6-a126-3cdb85b5e256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:26.223152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640f090-79c8-47d9-97ee-9b7c79147935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:26.223889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640f090-79c8-47d9-97ee-9b7c79147935 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:26.224358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640f090-79c8-47d9-97ee-9b7c79147935 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:26.224651 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640f090-79c8-47d9-97ee-9b7c79147935 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:26.225418 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640f090-79c8-47d9-97ee-9b7c79147935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:26.227270 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640f090-79c8-47d9-97ee-9b7c79147935 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:26.246290 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577771b-c50f-46d6-a126-3cdb85b5e256 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:26.259777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1400f-c1c6-450b-b169-a5ac10a2e472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:26.260575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1400f-c1c6-450b-b169-a5ac10a2e472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:26.260858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1400f-c1c6-450b-b169-a5ac10a2e472 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:26.261228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1400f-c1c6-450b-b169-a5ac10a2e472 admin admin] PATH_INFO: `/v3/projects/2c811078e3b545f199d498ba9851e2c9` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:26.264738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1400f-c1c6-450b-b169-a5ac10a2e472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c811078e3b545f199d498ba9851e2c9)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:26.267422 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1400f-c1c6-450b-b169-a5ac10a2e472 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:26.273417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1161/2342] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:10:26 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:26.277819 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640f090-79c8-47d9-97ee-9b7c79147935 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:26.353784 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ece1400f-c1c6-450b-b169-a5ac10a2e472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c811078e3b545f199d498ba9851e2c9', 'request_id': 'req-ece1400f-c1c6-450b-b169-a5ac10a2e472'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:26.373595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ece1400f-c1c6-450b-b169-a5ac10a2e472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c811078e3b545f199d498ba9851e2c9', 'request_id': 'req-ece1400f-c1c6-450b-b169-a5ac10a2e472'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:26.384099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ece1400f-c1c6-450b-b169-a5ac10a2e472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c811078e3b545f199d498ba9851e2c9', 'request_id': 'req-ece1400f-c1c6-450b-b169-a5ac10a2e472'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:26.391223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640f090-79c8-47d9-97ee-9b7c79147935 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:26.423596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ece1400f-c1c6-450b-b169-a5ac10a2e472 admin admin] The token cache is being invalidate because project 2c811078e3b545f199d498ba9851e2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:26.423880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ece1400f-c1c6-450b-b169-a5ac10a2e472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:26.425117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ece1400f-c1c6-450b-b169-a5ac10a2e472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:26.433512 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1182/2343] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:26 2022] DELETE /identity/v3/projects/2c811078e3b545f199d498ba9851e2c9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:26.435883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1400f-c1c6-450b-b169-a5ac10a2e472 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:26.438304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ece1400f-c1c6-450b-b169-a5ac10a2e472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:26.469952 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:26.488001 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:26.489293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9a5b5-e16b-4b38-a245-a7ecee131f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:26.490148 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9a5b5-e16b-4b38-a245-a7ecee131f62 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:26.491414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9a5b5-e16b-4b38-a245-a7ecee131f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:26.491817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9a5b5-e16b-4b38-a245-a7ecee131f62 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:26.492645 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9a5b5-e16b-4b38-a245-a7ecee131f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:26.495295 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9a5b5-e16b-4b38-a245-a7ecee131f62 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:26.529602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1162/2344] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:10:26 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:10:26.533523 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9a5b5-e16b-4b38-a245-a7ecee131f62 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:26.535642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-17d9a5b5-e16b-4b38-a245-a7ecee131f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:26.537938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1400f-c1c6-450b-b169-a5ac10a2e472 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:26.543500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c445ef-540d-4622-98b7-d2b613eedc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:26.544193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c445ef-540d-4622-98b7-d2b613eedc54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:26.544588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c445ef-540d-4622-98b7-d2b613eedc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:26.544945 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c445ef-540d-4622-98b7-d2b613eedc54 admin admin] PATH_INFO: `/v3/users/1c4e394dba0d4736938a71ec589ae897` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:26.546342 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c445ef-540d-4622-98b7-d2b613eedc54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4e394dba0d4736938a71ec589ae897)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:26.548230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9a5b5-e16b-4b38-a245-a7ecee131f62 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:26.548361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c445ef-540d-4622-98b7-d2b613eedc54 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:26.553468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c2d9a-07de-41c8-8401-07aa8ab05547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:26.554096 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c2d9a-07de-41c8-8401-07aa8ab05547 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:26.554385 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c2d9a-07de-41c8-8401-07aa8ab05547 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:26.554658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c2d9a-07de-41c8-8401-07aa8ab05547 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:26.555326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c2d9a-07de-41c8-8401-07aa8ab05547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:26.557000 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c2d9a-07de-41c8-8401-07aa8ab05547 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:26.570290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1163/2345] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:10:26.574542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c2d9a-07de-41c8-8401-07aa8ab05547 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:26.586029 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c2d9a-07de-41c8-8401-07aa8ab05547 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:26.592358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de771a5-eaac-4ace-9378-6e85135dddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:26.593012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de771a5-eaac-4ace-9378-6e85135dddcb admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:26.593287 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de771a5-eaac-4ace-9378-6e85135dddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:26.593572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de771a5-eaac-4ace-9378-6e85135dddcb admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:26.594199 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de771a5-eaac-4ace-9378-6e85135dddcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:26.596352 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de771a5-eaac-4ace-9378-6e85135dddcb admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:26.601626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-96c445ef-540d-4622-98b7-d2b613eedc54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4e394dba0d4736938a71ec589ae897'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:26.602306 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-96c445ef-540d-4622-98b7-d2b613eedc54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4e394dba0d4736938a71ec589ae897'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:26.607671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1164/2346] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:10:26.609921 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-96c445ef-540d-4622-98b7-d2b613eedc54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4e394dba0d4736938a71ec589ae897'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:26.611839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de771a5-eaac-4ace-9378-6e85135dddcb admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:26.613611 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0de771a5-eaac-4ace-9378-6e85135dddcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:26.623114 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-96c445ef-540d-4622-98b7-d2b613eedc54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4e394dba0d4736938a71ec589ae897'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:26.630704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de771a5-eaac-4ace-9378-6e85135dddcb admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:26.632316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-96c445ef-540d-4622-98b7-d2b613eedc54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4e394dba0d4736938a71ec589ae897'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:26.636430 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4e637-305c-4ba8-9cd8-2e0cb4c56355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:26.637118 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4e637-305c-4ba8-9cd8-2e0cb4c56355 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:26.637396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4e637-305c-4ba8-9cd8-2e0cb4c56355 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:26.637730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4e637-305c-4ba8-9cd8-2e0cb4c56355 admin admin] PATH_INFO: `/v3/projects/c774e59b4fa5467784eead103ba1c2f8/users/eb8fcc66af594ec3b1cb576707426941/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:26.641769 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1183/2347] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:26 2022] DELETE /identity/v3/users/1c4e394dba0d4736938a71ec589ae897 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:26.664421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4e637-305c-4ba8-9cd8-2e0cb4c56355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c774e59b4fa5467784eead103ba1c2f8, user_id=eb8fcc66af594ec3b1cb576707426941, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:26.668015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4e637-305c-4ba8-9cd8-2e0cb4c56355 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:26.692338 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1165/2348] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:26 2022] PUT /identity/v3/projects/c774e59b4fa5467784eead103ba1c2f8/users/eb8fcc66af594ec3b1cb576707426941/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:26.704118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c072a7d-100c-493b-9d25-2d75f9631da0 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:26.704775 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c072a7d-100c-493b-9d25-2d75f9631da0 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:26.705184 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c072a7d-100c-493b-9d25-2d75f9631da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:26.736240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-0c072a7d-100c-493b-9d25-2d75f9631da0 None None] MFA Rules not processed for user `eb8fcc66af594ec3b1cb576707426941`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:26.737503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0c072a7d-100c-493b-9d25-2d75f9631da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:26.844159 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1184/2349] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:26.845974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4e637-305c-4ba8-9cd8-2e0cb4c56355 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:26.887439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c072a7d-100c-493b-9d25-2d75f9631da0 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:26.889693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0c072a7d-100c-493b-9d25-2d75f9631da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:26.944083 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4e637-305c-4ba8-9cd8-2e0cb4c56355 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:26.947641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:26.951161 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93e67e-5e60-4f9f-b2b6-e57a1a0ffdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:26.951535 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93e67e-5e60-4f9f-b2b6-e57a1a0ffdd2 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:26.951780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93e67e-5e60-4f9f-b2b6-e57a1a0ffdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:26.952056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93e67e-5e60-4f9f-b2b6-e57a1a0ffdd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:26.952761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93e67e-5e60-4f9f-b2b6-e57a1a0ffdd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:26.955071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93e67e-5e60-4f9f-b2b6-e57a1a0ffdd2 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:26.993355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1166/2350] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:10:26 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:26.997297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93e67e-5e60-4f9f-b2b6-e57a1a0ffdd2 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:27.004601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c072a7d-100c-493b-9d25-2d75f9631da0 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:27.120760 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:27.121721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:27.122016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:27.122437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0 admin admin] PATH_INFO: `/v3/projects/8bc318b2294c4c8f91c151e26a29bffa` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:27.123616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bc318b2294c4c8f91c151e26a29bffa)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:27.125642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93e67e-5e60-4f9f-b2b6-e57a1a0ffdd2 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:27.125798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:27.132842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f2da0-296b-4fdb-a5ef-c597176941e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:27.133805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f2da0-296b-4fdb-a5ef-c597176941e8 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:27.134242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f2da0-296b-4fdb-a5ef-c597176941e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:27.134662 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f2da0-296b-4fdb-a5ef-c597176941e8 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:27.135520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f2da0-296b-4fdb-a5ef-c597176941e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:27.137818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f2da0-296b-4fdb-a5ef-c597176941e8 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:27.172597 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1167/2351] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:10:26 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:10:27.174381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d449a1-c349-4539-90aa-436c43cb8164 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:27.174893 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d449a1-c349-4539-90aa-436c43cb8164 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:27.175465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d449a1-c349-4539-90aa-436c43cb8164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:27.200009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc318b2294c4c8f91c151e26a29bffa', 'request_id': 'req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:27.201040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-82d449a1-c349-4539-90aa-436c43cb8164 None None] MFA Rules not processed for user `cc8ea23127db47faa6addb5b0e340e17`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:27.202600 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-82d449a1-c349-4539-90aa-436c43cb8164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:27.207479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:27.208420 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc318b2294c4c8f91c151e26a29bffa', 'request_id': 'req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:27.216959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc318b2294c4c8f91c151e26a29bffa', 'request_id': 'req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:27.240109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0 admin admin] The token cache is being invalidate because project 8bc318b2294c4c8f91c151e26a29bffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:27.240545 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:27.242014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:27.244463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1185/2352] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:26 2022] DELETE /identity/v3/projects/8bc318b2294c4c8f91c151e26a29bffa => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:27.245485 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:27.246960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:27.296101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1168/2353] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:27.297526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6018b2f-5247-4158-80c4-386e25a80e14 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:27.297812 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6018b2f-5247-4158-80c4-386e25a80e14 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:27.298086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6018b2f-5247-4158-80c4-386e25a80e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:27.325321 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-b6018b2f-5247-4158-80c4-386e25a80e14 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:27.326715 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b6018b2f-5247-4158-80c4-386e25a80e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:27.350459 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eab6e3-f404-4216-b1f4-4748fbf8e4d0 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:27.356021 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf96e0-e464-4118-b762-e1543d24fc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:27.357996 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf96e0-e464-4118-b762-e1543d24fc5d admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:27.358286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf96e0-e464-4118-b762-e1543d24fc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:27.358558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf96e0-e464-4118-b762-e1543d24fc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:27.359928 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf96e0-e464-4118-b762-e1543d24fc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:27.361733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf96e0-e464-4118-b762-e1543d24fc5d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:27.376434 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1186/2354] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:27.379331 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf96e0-e464-4118-b762-e1543d24fc5d admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:27.394220 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf96e0-e464-4118-b762-e1543d24fc5d admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:27.402185 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd26f7-0ae4-491d-8a0a-ba4b63ccb3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:27.403551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd26f7-0ae4-491d-8a0a-ba4b63ccb3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:27.404577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd26f7-0ae4-491d-8a0a-ba4b63ccb3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:27.404866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd26f7-0ae4-491d-8a0a-ba4b63ccb3fd admin admin] PATH_INFO: `/v3/projects/ddb367783c684aa3a22ca77115329ef5/users/da54e6b88c70484dae14648b22b69783/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:27.408067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:27.410444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1169/2355] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:27.418267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbb65d-05a8-4a40-8106-49819ad40c53 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:27.418879 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbb65d-05a8-4a40-8106-49819ad40c53 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:27.419527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbb65d-05a8-4a40-8106-49819ad40c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:27.428246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd26f7-0ae4-491d-8a0a-ba4b63ccb3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb367783c684aa3a22ca77115329ef5, user_id=da54e6b88c70484dae14648b22b69783, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:27.431253 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd26f7-0ae4-491d-8a0a-ba4b63ccb3fd admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:27.450533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-1bcbb65d-05a8-4a40-8106-49819ad40c53 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:27.455150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-1bcbb65d-05a8-4a40-8106-49819ad40c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:27.461341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1187/2356] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:27 2022] PUT /identity/v3/projects/ddb367783c684aa3a22ca77115329ef5/users/da54e6b88c70484dae14648b22b69783/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:10:27.467849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd26f7-0ae4-491d-8a0a-ba4b63ccb3fd admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:27.577835 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1170/2357] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:10:27.579252 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbb65d-05a8-4a40-8106-49819ad40c53 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:27.605257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbb65d-05a8-4a40-8106-49819ad40c53 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:27.609835 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd26f7-0ae4-491d-8a0a-ba4b63ccb3fd admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:27.612750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085dbfe-8a45-4e18-80cf-32be589dd4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:27.613896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085dbfe-8a45-4e18-80cf-32be589dd4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:27.613896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085dbfe-8a45-4e18-80cf-32be589dd4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:27.614277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085dbfe-8a45-4e18-80cf-32be589dd4d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:27.615038 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085dbfe-8a45-4e18-80cf-32be589dd4d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:10:27.615443 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085dbfe-8a45-4e18-80cf-32be589dd4d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:27.617449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085dbfe-8a45-4e18-80cf-32be589dd4d5 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:27.618765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1466-3f1a-4cf0-84dd-c99d226f5cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:27.619793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1466-3f1a-4cf0-84dd-c99d226f5cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:27.620282 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1466-3f1a-4cf0-84dd-c99d226f5cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:27.620939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1466-3f1a-4cf0-84dd-c99d226f5cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:27.622303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc1466-3f1a-4cf0-84dd-c99d226f5cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:27.626740 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc1466-3f1a-4cf0-84dd-c99d226f5cd8 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:27.635519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1171/2358] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:10:27.636762 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085dbfe-8a45-4e18-80cf-32be589dd4d5 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:27.649185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085dbfe-8a45-4e18-80cf-32be589dd4d5 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:27.653423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1188/2359] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:27.654529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1466-3f1a-4cf0-84dd-c99d226f5cd8 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:27.655089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ad8c4-be73-434c-81d9-4e3ec97d907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:27.655729 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ad8c4-be73-434c-81d9-4e3ec97d907e admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:27.657094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ad8c4-be73-434c-81d9-4e3ec97d907e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:27.657094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ad8c4-be73-434c-81d9-4e3ec97d907e admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:27.657094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ad8c4-be73-434c-81d9-4e3ec97d907e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:27.660427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ad8c4-be73-434c-81d9-4e3ec97d907e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:27.677130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1466-3f1a-4cf0-84dd-c99d226f5cd8 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:27.687271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cabbd-a6b2-404b-9a6e-cfe433a1e17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:27.688983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cabbd-a6b2-404b-9a6e-cfe433a1e17a admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:27.689388 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cabbd-a6b2-404b-9a6e-cfe433a1e17a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:27.689839 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cabbd-a6b2-404b-9a6e-cfe433a1e17a admin admin] PATH_INFO: `/v3/projects/ddb367783c684aa3a22ca77115329ef5/users/da54e6b88c70484dae14648b22b69783/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:27.694046 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cabbd-a6b2-404b-9a6e-cfe433a1e17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb367783c684aa3a22ca77115329ef5, user_id=da54e6b88c70484dae14648b22b69783, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:27.697107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cabbd-a6b2-404b-9a6e-cfe433a1e17a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:27.712248 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1172/2360] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:10:27 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:27.713427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ad8c4-be73-434c-81d9-4e3ec97d907e admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:27.725456 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1189/2361] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:27 2022] PUT /identity/v3/projects/ddb367783c684aa3a22ca77115329ef5/users/da54e6b88c70484dae14648b22b69783/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:27.738811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f660d2-417e-4e06-99a3-1b1dea923cdb None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:27.739364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f660d2-417e-4e06-99a3-1b1dea923cdb None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:27.739824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f660d2-417e-4e06-99a3-1b1dea923cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:27.754093 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:27.791133 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-41f660d2-417e-4e06-99a3-1b1dea923cdb None None] MFA Rules not processed for user `da54e6b88c70484dae14648b22b69783`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:27.793942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-41f660d2-417e-4e06-99a3-1b1dea923cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:27.822481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ad8c4-be73-434c-81d9-4e3ec97d907e admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:27.921673 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197aace-2c8d-411b-8355-a56c7daa6ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:27.923015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197aace-2c8d-411b-8355-a56c7daa6ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:27.923145 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197aace-2c8d-411b-8355-a56c7daa6ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:27.923354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197aace-2c8d-411b-8355-a56c7daa6ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:27.925465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197aace-2c8d-411b-8355-a56c7daa6ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:27.928238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197aace-2c8d-411b-8355-a56c7daa6ba2 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:27.951462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1190/2362] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:27.964724 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f660d2-417e-4e06-99a3-1b1dea923cdb None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:27.966246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-41f660d2-417e-4e06-99a3-1b1dea923cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:27.968562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1173/2363] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:10:27 2022] POST /identity/v3/users => generated 287 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:27.973895 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197aace-2c8d-411b-8355-a56c7daa6ba2 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:27.992201 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197aace-2c8d-411b-8355-a56c7daa6ba2 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:27.999786 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5b146-d5d4-472f-a4ff-1e1748220914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:28.000850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b146-d5d4-472f-a4ff-1e1748220914 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:28.001315 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b146-d5d4-472f-a4ff-1e1748220914 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:28.001761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b146-d5d4-472f-a4ff-1e1748220914 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:28.003079 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5b146-d5d4-472f-a4ff-1e1748220914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:28.006104 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5b146-d5d4-472f-a4ff-1e1748220914 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:28.023264 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1174/2364] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:28.028693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5b146-d5d4-472f-a4ff-1e1748220914 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:28.045377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f660d2-417e-4e06-99a3-1b1dea923cdb None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:28.046021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5b146-d5d4-472f-a4ff-1e1748220914 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:28.050744 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73861469-bc6a-4525-8923-c35ec6abb94c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:28.051408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73861469-bc6a-4525-8923-c35ec6abb94c service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:28.051694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73861469-bc6a-4525-8923-c35ec6abb94c service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:28.051969 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73861469-bc6a-4525-8923-c35ec6abb94c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:28.053842 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-73861469-bc6a-4525-8923-c35ec6abb94c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:28.054502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17744c8c-bdc5-4348-ab14-7eaa81b7075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:28.055414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17744c8c-bdc5-4348-ab14-7eaa81b7075d admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:28.056269 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17744c8c-bdc5-4348-ab14-7eaa81b7075d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:28.057103 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17744c8c-bdc5-4348-ab14-7eaa81b7075d admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:28.058228 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17744c8c-bdc5-4348-ab14-7eaa81b7075d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:28.059898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:28.060896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17744c8c-bdc5-4348-ab14-7eaa81b7075d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:28.077706 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1175/2365] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:28.081804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17744c8c-bdc5-4348-ab14-7eaa81b7075d admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:28.096019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17744c8c-bdc5-4348-ab14-7eaa81b7075d admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:28.103079 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c19b9-4c99-44eb-94ef-754723e43d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:28.103877 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c19b9-4c99-44eb-94ef-754723e43d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:28.104253 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c19b9-4c99-44eb-94ef-754723e43d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:28.104771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c19b9-4c99-44eb-94ef-754723e43d91 admin admin] PATH_INFO: `/v3/projects/28010e21737e49aaae89689788d17a66/users/7794ea1c372447b88885f7b62caeeaa6/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:28.131709 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c19b9-4c99-44eb-94ef-754723e43d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28010e21737e49aaae89689788d17a66, user_id=7794ea1c372447b88885f7b62caeeaa6, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:28.144581 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c19b9-4c99-44eb-94ef-754723e43d91 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:28.176622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73861469-bc6a-4525-8923-c35ec6abb94c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:28.178144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73861469-bc6a-4525-8923-c35ec6abb94c service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:28.183532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1176/2366] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:28 2022] PUT /identity/v3/projects/28010e21737e49aaae89689788d17a66/users/7794ea1c372447b88885f7b62caeeaa6/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:10:28.199295 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f31a7-c3a4-4255-8eb6-982b217592fd None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:28.199652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f31a7-c3a4-4255-8eb6-982b217592fd None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:28.199854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f31a7-c3a4-4255-8eb6-982b217592fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:28.200902 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1191/2367] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:10:28.239201 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-7e3f31a7-c3a4-4255-8eb6-982b217592fd None None] MFA Rules not processed for user `7794ea1c372447b88885f7b62caeeaa6`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:28.241305 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7e3f31a7-c3a4-4255-8eb6-982b217592fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:28.376924 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:28.384457 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1177/2368] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:28.400171 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73861469-bc6a-4525-8923-c35ec6abb94c service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:28.401699 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-73861469-bc6a-4525-8923-c35ec6abb94c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:28.417708 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73861469-bc6a-4525-8923-c35ec6abb94c service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:28.510522 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329edd9-b67b-4f5b-a64d-ffccae236537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:28.510853 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329edd9-b67b-4f5b-a64d-ffccae236537 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:28.511130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329edd9-b67b-4f5b-a64d-ffccae236537 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:28.511375 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329edd9-b67b-4f5b-a64d-ffccae236537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:28.533797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329edd9-b67b-4f5b-a64d-ffccae236537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:28.537376 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329edd9-b67b-4f5b-a64d-ffccae236537 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:28.551867 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd20f8-8986-4905-a2e1-c4a2a9cc27b2 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:28.552231 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd20f8-8986-4905-a2e1-c4a2a9cc27b2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:28.552590 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd20f8-8986-4905-a2e1-c4a2a9cc27b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:28.561240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1192/2369] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:28.584630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-79bd20f8-8986-4905-a2e1-c4a2a9cc27b2 None None] MFA Rules not processed for user `a48139e448064f27bb93baea83ae6697`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:28.585033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-79bd20f8-8986-4905-a2e1-c4a2a9cc27b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:28.588811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329edd9-b67b-4f5b-a64d-ffccae236537 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:28.693047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1178/2370] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:10:28.698432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329edd9-b67b-4f5b-a64d-ffccae236537 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:28.704613 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bae05-33d9-423b-8f8a-3e1c56de4412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:28.706271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bae05-33d9-423b-8f8a-3e1c56de4412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:28.707063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bae05-33d9-423b-8f8a-3e1c56de4412 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:28.707260 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bae05-33d9-423b-8f8a-3e1c56de4412 admin admin] PATH_INFO: `/v3/users/7794ea1c372447b88885f7b62caeeaa6` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:28.708950 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bae05-33d9-423b-8f8a-3e1c56de4412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7794ea1c372447b88885f7b62caeeaa6)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:28.711465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bae05-33d9-423b-8f8a-3e1c56de4412 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:28.813433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-152bae05-33d9-423b-8f8a-3e1c56de4412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7794ea1c372447b88885f7b62caeeaa6'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:28.814112 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-152bae05-33d9-423b-8f8a-3e1c56de4412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7794ea1c372447b88885f7b62caeeaa6'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:28.817009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:28.825965 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-152bae05-33d9-423b-8f8a-3e1c56de4412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7794ea1c372447b88885f7b62caeeaa6'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:28.843215 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-152bae05-33d9-423b-8f8a-3e1c56de4412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7794ea1c372447b88885f7b62caeeaa6'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:28.873376 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-152bae05-33d9-423b-8f8a-3e1c56de4412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7794ea1c372447b88885f7b62caeeaa6'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:28.895725 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1193/2371] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:28 2022] DELETE /identity/v3/users/7794ea1c372447b88885f7b62caeeaa6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:10:28.898205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f82209-6c13-486a-ba5b-2a367a8c89d9 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:28.898693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f82209-6c13-486a-ba5b-2a367a8c89d9 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:28.899169 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f82209-6c13-486a-ba5b-2a367a8c89d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:28.940522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-47f82209-6c13-486a-ba5b-2a367a8c89d9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:28.942436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-47f82209-6c13-486a-ba5b-2a367a8c89d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:29.064146 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1179/2372] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:10:29.082610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bae05-33d9-423b-8f8a-3e1c56de4412 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:29.085132 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-152bae05-33d9-423b-8f8a-3e1c56de4412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:29.168098 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bae05-33d9-423b-8f8a-3e1c56de4412 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:29.173719 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1bc2c-a021-4e90-8afe-0cb44751d5ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:29.174435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1bc2c-a021-4e90-8afe-0cb44751d5ea service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:29.174718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1bc2c-a021-4e90-8afe-0cb44751d5ea service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:29.175081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1bc2c-a021-4e90-8afe-0cb44751d5ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:29.195246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1bc2c-a021-4e90-8afe-0cb44751d5ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:29.198502 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1bc2c-a021-4e90-8afe-0cb44751d5ea service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:29.213882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1194/2373] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:29.652565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f82209-6c13-486a-ba5b-2a367a8c89d9 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:29.654252 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-47f82209-6c13-486a-ba5b-2a367a8c89d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:29.671132 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f82209-6c13-486a-ba5b-2a367a8c89d9 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:29.676626 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db436fc-0e25-416f-9ca7-ba40cffb9d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:29.677465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db436fc-0e25-416f-9ca7-ba40cffb9d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:29.677802 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db436fc-0e25-416f-9ca7-ba40cffb9d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:29.678139 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db436fc-0e25-416f-9ca7-ba40cffb9d3f admin admin] PATH_INFO: `/v3/projects/28010e21737e49aaae89689788d17a66` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:29.679404 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db436fc-0e25-416f-9ca7-ba40cffb9d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=28010e21737e49aaae89689788d17a66)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:29.681512 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db436fc-0e25-416f-9ca7-ba40cffb9d3f admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:29.805540 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3db436fc-0e25-416f-9ca7-ba40cffb9d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28010e21737e49aaae89689788d17a66', 'request_id': 'req-3db436fc-0e25-416f-9ca7-ba40cffb9d3f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:29.829385 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3db436fc-0e25-416f-9ca7-ba40cffb9d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28010e21737e49aaae89689788d17a66', 'request_id': 'req-3db436fc-0e25-416f-9ca7-ba40cffb9d3f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:29.845841 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3db436fc-0e25-416f-9ca7-ba40cffb9d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28010e21737e49aaae89689788d17a66', 'request_id': 'req-3db436fc-0e25-416f-9ca7-ba40cffb9d3f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:29.895066 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3db436fc-0e25-416f-9ca7-ba40cffb9d3f admin admin] The token cache is being invalidate because project 28010e21737e49aaae89689788d17a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:29.896540 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3db436fc-0e25-416f-9ca7-ba40cffb9d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:29.897792 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3db436fc-0e25-416f-9ca7-ba40cffb9d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:29.900642 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1180/2374] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:29 2022] DELETE /identity/v3/projects/28010e21737e49aaae89689788d17a66 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:29.909092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55808980-98b6-4380-a2c6-ff6da7df12bd None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:29.909567 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55808980-98b6-4380-a2c6-ff6da7df12bd None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:29.910061 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55808980-98b6-4380-a2c6-ff6da7df12bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:29.968656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-55808980-98b6-4380-a2c6-ff6da7df12bd None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:29.970640 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-55808980-98b6-4380-a2c6-ff6da7df12bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:30.047352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1195/2375] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:30.060008 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd88d10-09f7-4a4a-b3ad-c4060469a120 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:30.060637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd88d10-09f7-4a4a-b3ad-c4060469a120 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:30.060970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd88d10-09f7-4a4a-b3ad-c4060469a120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:30.086596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-2dd88d10-09f7-4a4a-b3ad-c4060469a120 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:30.095363 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2dd88d10-09f7-4a4a-b3ad-c4060469a120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:30.121682 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1181/2376] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:30.129573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55808980-98b6-4380-a2c6-ff6da7df12bd None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:30.158802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55808980-98b6-4380-a2c6-ff6da7df12bd None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:30.170936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd6659-b8d2-43ef-b70f-40792ae3a187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:30.180639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd6659-b8d2-43ef-b70f-40792ae3a187 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:30.181007 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd6659-b8d2-43ef-b70f-40792ae3a187 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:30.181240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd6659-b8d2-43ef-b70f-40792ae3a187 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:30.185343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd6659-b8d2-43ef-b70f-40792ae3a187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:10:30.185873 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd6659-b8d2-43ef-b70f-40792ae3a187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:30.203121 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd6659-b8d2-43ef-b70f-40792ae3a187 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:30.242360 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1196/2377] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:10:30.243622 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd88d10-09f7-4a4a-b3ad-c4060469a120 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:30.261977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd88d10-09f7-4a4a-b3ad-c4060469a120 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:30.283141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af9eee-62cb-48b9-8ebd-a1d97f827c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:30.300167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af9eee-62cb-48b9-8ebd-a1d97f827c49 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:30.300167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af9eee-62cb-48b9-8ebd-a1d97f827c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:30.300167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af9eee-62cb-48b9-8ebd-a1d97f827c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:30.300167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af9eee-62cb-48b9-8ebd-a1d97f827c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:30.300167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af9eee-62cb-48b9-8ebd-a1d97f827c49 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:30.362108 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:30.374786 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1182/2378] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:10:30 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:30.381004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd6659-b8d2-43ef-b70f-40792ae3a187 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:30.427430 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd6659-b8d2-43ef-b70f-40792ae3a187 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:30.585721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:30.609133 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c68d24-1787-49e5-a6b7-d14f10a14a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:30.609133 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c68d24-1787-49e5-a6b7-d14f10a14a48 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:30.609472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c68d24-1787-49e5-a6b7-d14f10a14a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:30.609759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c68d24-1787-49e5-a6b7-d14f10a14a48 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:30.610358 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c68d24-1787-49e5-a6b7-d14f10a14a48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:30.612690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c68d24-1787-49e5-a6b7-d14f10a14a48 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:30.653095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1197/2379] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:10:30 2022] POST /identity/v3/users => generated 286 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:30.658120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af9eee-62cb-48b9-8ebd-a1d97f827c49 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:30.677586 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af9eee-62cb-48b9-8ebd-a1d97f827c49 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:30.685348 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcaf22-06ea-468f-9245-57b4b9982781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:30.687155 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcaf22-06ea-468f-9245-57b4b9982781 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:30.687818 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcaf22-06ea-468f-9245-57b4b9982781 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:30.688309 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcaf22-06ea-468f-9245-57b4b9982781 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:30.689363 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcaf22-06ea-468f-9245-57b4b9982781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:30.691971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcaf22-06ea-468f-9245-57b4b9982781 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:30.709102 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1183/2380] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:30.710676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c68d24-1787-49e5-a6b7-d14f10a14a48 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:30.723562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c68d24-1787-49e5-a6b7-d14f10a14a48 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:30.738952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed970e-2813-4c30-ba08-6b2e7aeb46ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:30.740732 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed970e-2813-4c30-ba08-6b2e7aeb46ad admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:30.741242 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed970e-2813-4c30-ba08-6b2e7aeb46ad admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:30.741940 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed970e-2813-4c30-ba08-6b2e7aeb46ad admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:30.743162 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed970e-2813-4c30-ba08-6b2e7aeb46ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:30.745859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed970e-2813-4c30-ba08-6b2e7aeb46ad admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:30.766278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1198/2381] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:30.770698 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcaf22-06ea-468f-9245-57b4b9982781 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:30.785556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcaf22-06ea-468f-9245-57b4b9982781 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:30.795665 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7f9b7-4e3d-4008-9884-ec3adb4d1ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:30.797185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7f9b7-4e3d-4008-9884-ec3adb4d1ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:30.797548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7f9b7-4e3d-4008-9884-ec3adb4d1ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:30.797906 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7f9b7-4e3d-4008-9884-ec3adb4d1ba1 admin admin] PATH_INFO: `/v3/projects/9e3ee0e0d48d41a8834ae81587e5e8ee/users/37655384217b4589b1899b9f68ae43cf/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:30.825825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7f9b7-4e3d-4008-9884-ec3adb4d1ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3ee0e0d48d41a8834ae81587e5e8ee, user_id=37655384217b4589b1899b9f68ae43cf, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:30.831196 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7f9b7-4e3d-4008-9884-ec3adb4d1ba1 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:30.858405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1184/2382] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:30 2022] PUT /identity/v3/projects/9e3ee0e0d48d41a8834ae81587e5e8ee/users/37655384217b4589b1899b9f68ae43cf/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:10:30.873304 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af20549-082e-4c51-9fa9-826ddd8de73e None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:30.873590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af20549-082e-4c51-9fa9-826ddd8de73e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:30.873860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af20549-082e-4c51-9fa9-826ddd8de73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:30.917391 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-0af20549-082e-4c51-9fa9-826ddd8de73e None None] MFA Rules not processed for user `37655384217b4589b1899b9f68ae43cf`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:30.918941 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0af20549-082e-4c51-9fa9-826ddd8de73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:31.116432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1199/2383] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:31.131634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7f9b7-4e3d-4008-9884-ec3adb4d1ba1 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:31.133813 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-aff7f9b7-4e3d-4008-9884-ec3adb4d1ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:31.225008 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7f9b7-4e3d-4008-9884-ec3adb4d1ba1 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:31.232255 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb6dcd-3819-4894-a1e5-05fef90dd8ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f332ac2346f0444a8d336ed2b3121be2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:31.233839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb6dcd-3819-4894-a1e5-05fef90dd8ce service glance] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:31.234781 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb6dcd-3819-4894-a1e5-05fef90dd8ce service glance] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:31.235539 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb6dcd-3819-4894-a1e5-05fef90dd8ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:31.250695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb6dcd-3819-4894-a1e5-05fef90dd8ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:31.253148 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb6dcd-3819-4894-a1e5-05fef90dd8ce service glance] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:31.271841 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1185/2384] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:31.340629 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af20549-082e-4c51-9fa9-826ddd8de73e None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:31.344326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0af20549-082e-4c51-9fa9-826ddd8de73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:31.491932 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af20549-082e-4c51-9fa9-826ddd8de73e None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:31.499657 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e4957-191f-4989-9926-a42d0355051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:31.500454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e4957-191f-4989-9926-a42d0355051d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:31.500803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e4957-191f-4989-9926-a42d0355051d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:31.501147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e4957-191f-4989-9926-a42d0355051d admin admin] PATH_INFO: `/v3/users/eb8fcc66af594ec3b1cb576707426941` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:31.503006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e4957-191f-4989-9926-a42d0355051d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8fcc66af594ec3b1cb576707426941)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:31.504970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e4957-191f-4989-9926-a42d0355051d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:31.594797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ee7e4957-191f-4989-9926-a42d0355051d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8fcc66af594ec3b1cb576707426941'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:31.595655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ee7e4957-191f-4989-9926-a42d0355051d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8fcc66af594ec3b1cb576707426941'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:31.605459 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ee7e4957-191f-4989-9926-a42d0355051d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8fcc66af594ec3b1cb576707426941'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:31.618313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:31.626569 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ee7e4957-191f-4989-9926-a42d0355051d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8fcc66af594ec3b1cb576707426941'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:31.638596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ee7e4957-191f-4989-9926-a42d0355051d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8fcc66af594ec3b1cb576707426941'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:31.648038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1200/2385] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:31 2022] DELETE /identity/v3/users/eb8fcc66af594ec3b1cb576707426941 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:31.654919 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9483253-03fc-4f95-94c3-e04f97f152f3 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:31.655460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9483253-03fc-4f95-94c3-e04f97f152f3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:31.655895 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9483253-03fc-4f95-94c3-e04f97f152f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:31.701257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-b9483253-03fc-4f95-94c3-e04f97f152f3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:31.703716 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b9483253-03fc-4f95-94c3-e04f97f152f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:31.876431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1186/2386] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:31.914382 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e4957-191f-4989-9926-a42d0355051d admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:31.916665 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ee7e4957-191f-4989-9926-a42d0355051d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:32.026976 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e4957-191f-4989-9926-a42d0355051d admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:32.035784 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd461a-b033-4206-8fc8-5e30632e0e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:32.036771 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd461a-b033-4206-8fc8-5e30632e0e9c service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:32.037176 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd461a-b033-4206-8fc8-5e30632e0e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:32.037586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd461a-b033-4206-8fc8-5e30632e0e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:32.050638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd461a-b033-4206-8fc8-5e30632e0e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:32.052506 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd461a-b033-4206-8fc8-5e30632e0e9c service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:32.066401 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1201/2387] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:32.136125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9483253-03fc-4f95-94c3-e04f97f152f3 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:32.138636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b9483253-03fc-4f95-94c3-e04f97f152f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:32.168277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9483253-03fc-4f95-94c3-e04f97f152f3 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:32.179268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a289b7-1616-4093-90d8-226cc69cc94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:32.181010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a289b7-1616-4093-90d8-226cc69cc94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:32.181721 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a289b7-1616-4093-90d8-226cc69cc94f admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:32.182481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a289b7-1616-4093-90d8-226cc69cc94f admin admin] PATH_INFO: `/v3/users/25ece953419c47cc90fb0ca4273c3d15` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:32.185154 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a289b7-1616-4093-90d8-226cc69cc94f admin admin] RBAC: Authorizing `identity:delete_user(user_id=25ece953419c47cc90fb0ca4273c3d15)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:32.190760 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a289b7-1616-4093-90d8-226cc69cc94f admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:32.311539 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f4a289b7-1616-4093-90d8-226cc69cc94f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25ece953419c47cc90fb0ca4273c3d15'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:32.312593 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f4a289b7-1616-4093-90d8-226cc69cc94f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25ece953419c47cc90fb0ca4273c3d15'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:32.323522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f4a289b7-1616-4093-90d8-226cc69cc94f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25ece953419c47cc90fb0ca4273c3d15'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:32.324559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f4a289b7-1616-4093-90d8-226cc69cc94f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25ece953419c47cc90fb0ca4273c3d15'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:32.335583 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f4a289b7-1616-4093-90d8-226cc69cc94f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25ece953419c47cc90fb0ca4273c3d15'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:32.338359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:32.372717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b4283-03ac-40ed-aa49-831c2227c5b0 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:32.374100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b4283-03ac-40ed-aa49-831c2227c5b0 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:32.374100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b4283-03ac-40ed-aa49-831c2227c5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:32.376710 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1187/2388] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:32 2022] DELETE /identity/v3/users/25ece953419c47cc90fb0ca4273c3d15 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:32.395714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-a90b4283-03ac-40ed-aa49-831c2227c5b0 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:32.397035 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a90b4283-03ac-40ed-aa49-831c2227c5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:32.489091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1202/2389] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:32.550057 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a289b7-1616-4093-90d8-226cc69cc94f admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:32.551922 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f4a289b7-1616-4093-90d8-226cc69cc94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:32.629563 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a289b7-1616-4093-90d8-226cc69cc94f admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:32.633959 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efae0b-9061-4e1d-8cea-91e0f6ff98c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:32.634739 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efae0b-9061-4e1d-8cea-91e0f6ff98c2 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:32.635124 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efae0b-9061-4e1d-8cea-91e0f6ff98c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:32.635469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efae0b-9061-4e1d-8cea-91e0f6ff98c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:32.647107 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efae0b-9061-4e1d-8cea-91e0f6ff98c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:32.648781 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efae0b-9061-4e1d-8cea-91e0f6ff98c2 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:32.661757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1188/2390] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:33.624880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906319e-d6b7-4f67-922e-86acf8c349d8 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:33.625440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906319e-d6b7-4f67-922e-86acf8c349d8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:33.626465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906319e-d6b7-4f67-922e-86acf8c349d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:33.655521 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-7906319e-d6b7-4f67-922e-86acf8c349d8 None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:33.657567 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7906319e-d6b7-4f67-922e-86acf8c349d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:33.750884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efae0b-9061-4e1d-8cea-91e0f6ff98c2 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:33.753399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-59efae0b-9061-4e1d-8cea-91e0f6ff98c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:33.781354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efae0b-9061-4e1d-8cea-91e0f6ff98c2 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:33.796803 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:33.798356 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:33.798716 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:33.799053 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760 admin admin] PATH_INFO: `/v3/projects/c774e59b4fa5467784eead103ba1c2f8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:33.803857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c774e59b4fa5467784eead103ba1c2f8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:33.806184 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:33.836537 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1203/2391] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Sep 7 13:10:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:33.928738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c774e59b4fa5467784eead103ba1c2f8', 'request_id': 'req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:33.945096 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c774e59b4fa5467784eead103ba1c2f8', 'request_id': 'req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:33.951406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906319e-d6b7-4f67-922e-86acf8c349d8 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:33.954978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7906319e-d6b7-4f67-922e-86acf8c349d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:33.962201 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c774e59b4fa5467784eead103ba1c2f8', 'request_id': 'req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:33.979327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760 admin admin] The token cache is being invalidate because project c774e59b4fa5467784eead103ba1c2f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:33.979717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:33.981181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:33.983688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1189/2392] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:33 2022] DELETE /identity/v3/projects/c774e59b4fa5467784eead103ba1c2f8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:33.989565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:33.991298 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:34.030034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:34.120269 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906319e-d6b7-4f67-922e-86acf8c349d8 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:34.209332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b0f61-ce25-44c8-85b2-8f4c879b7760 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:34.219528 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122276c-c95b-4b56-a888-d27f8b376ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:34.221015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122276c-c95b-4b56-a888-d27f8b376ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:34.222555 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122276c-c95b-4b56-a888-d27f8b376ded admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:34.223251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122276c-c95b-4b56-a888-d27f8b376ded admin admin] PATH_INFO: `/v3/users/da54e6b88c70484dae14648b22b69783` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:34.225758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122276c-c95b-4b56-a888-d27f8b376ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=da54e6b88c70484dae14648b22b69783)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:34.232909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122276c-c95b-4b56-a888-d27f8b376ded admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:34.242003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:34.272096 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf0138-13d0-419b-a80a-fa68d42568d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:34.272772 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf0138-13d0-419b-a80a-fa68d42568d7 service swift] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:34.273288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf0138-13d0-419b-a80a-fa68d42568d7 service swift] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:34.273731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf0138-13d0-419b-a80a-fa68d42568d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:34.276060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9fdf0138-13d0-419b-a80a-fa68d42568d7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:34.336526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4122276c-c95b-4b56-a888-d27f8b376ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da54e6b88c70484dae14648b22b69783'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:34.338129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4122276c-c95b-4b56-a888-d27f8b376ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da54e6b88c70484dae14648b22b69783'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:34.354841 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4122276c-c95b-4b56-a888-d27f8b376ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da54e6b88c70484dae14648b22b69783'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:34.356065 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4122276c-c95b-4b56-a888-d27f8b376ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da54e6b88c70484dae14648b22b69783'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:34.370534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4122276c-c95b-4b56-a888-d27f8b376ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da54e6b88c70484dae14648b22b69783'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:34.412820 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1190/2393] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:33 2022] DELETE /identity/v3/users/da54e6b88c70484dae14648b22b69783 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:34.420514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122276c-c95b-4b56-a888-d27f8b376ded admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:34.420514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4122276c-c95b-4b56-a888-d27f8b376ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:34.478261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf0138-13d0-419b-a80a-fa68d42568d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:34.480868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf0138-13d0-419b-a80a-fa68d42568d7 service swift] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:34.508939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1204/2394] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:10:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 13:10:34.553906 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122276c-c95b-4b56-a888-d27f8b376ded admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:34.566294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aec800-ac99-4367-b600-b74e47e7b9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:34.567141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aec800-ac99-4367-b600-b74e47e7b9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:34.567394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aec800-ac99-4367-b600-b74e47e7b9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:34.574836 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aec800-ac99-4367-b600-b74e47e7b9ef admin admin] PATH_INFO: `/v3/projects/aeb8f73859c1457f8124f235a4c56eff` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:34.576756 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aec800-ac99-4367-b600-b74e47e7b9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeb8f73859c1457f8124f235a4c56eff)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:34.578875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aec800-ac99-4367-b600-b74e47e7b9ef admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:34.735216 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-18aec800-ac99-4367-b600-b74e47e7b9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeb8f73859c1457f8124f235a4c56eff', 'request_id': 'req-18aec800-ac99-4367-b600-b74e47e7b9ef'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:34.749218 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-18aec800-ac99-4367-b600-b74e47e7b9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeb8f73859c1457f8124f235a4c56eff', 'request_id': 'req-18aec800-ac99-4367-b600-b74e47e7b9ef'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:34.768630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-18aec800-ac99-4367-b600-b74e47e7b9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeb8f73859c1457f8124f235a4c56eff', 'request_id': 'req-18aec800-ac99-4367-b600-b74e47e7b9ef'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:34.795005 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-18aec800-ac99-4367-b600-b74e47e7b9ef admin admin] The token cache is being invalidate because project aeb8f73859c1457f8124f235a4c56eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:34.796545 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-18aec800-ac99-4367-b600-b74e47e7b9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:34.798137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-18aec800-ac99-4367-b600-b74e47e7b9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:34.800920 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1191/2395] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:34 2022] DELETE /identity/v3/projects/aeb8f73859c1457f8124f235a4c56eff => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:35.860222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf0138-13d0-419b-a80a-fa68d42568d7 service swift] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:35.888151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf0138-13d0-419b-a80a-fa68d42568d7 service swift] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:36.050861 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404380e6-fec5-4bd6-8b4f-ec12c279ce96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:36.051756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404380e6-fec5-4bd6-8b4f-ec12c279ce96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:36.052040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404380e6-fec5-4bd6-8b4f-ec12c279ce96 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:36.052623 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404380e6-fec5-4bd6-8b4f-ec12c279ce96 admin admin] PATH_INFO: `/v3/projects/ddb367783c684aa3a22ca77115329ef5` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:36.054738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404380e6-fec5-4bd6-8b4f-ec12c279ce96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb367783c684aa3a22ca77115329ef5)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:36.058491 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404380e6-fec5-4bd6-8b4f-ec12c279ce96 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:36.097093 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:36.138089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-404380e6-fec5-4bd6-8b4f-ec12c279ce96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb367783c684aa3a22ca77115329ef5', 'request_id': 'req-404380e6-fec5-4bd6-8b4f-ec12c279ce96'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:36.146891 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-404380e6-fec5-4bd6-8b4f-ec12c279ce96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb367783c684aa3a22ca77115329ef5', 'request_id': 'req-404380e6-fec5-4bd6-8b4f-ec12c279ce96'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:36.179393 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-404380e6-fec5-4bd6-8b4f-ec12c279ce96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb367783c684aa3a22ca77115329ef5', 'request_id': 'req-404380e6-fec5-4bd6-8b4f-ec12c279ce96'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:36.210642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-404380e6-fec5-4bd6-8b4f-ec12c279ce96 admin admin] The token cache is being invalidate because project ddb367783c684aa3a22ca77115329ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:36.211084 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-404380e6-fec5-4bd6-8b4f-ec12c279ce96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:36.211897 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-404380e6-fec5-4bd6-8b4f-ec12c279ce96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:36.218310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1205/2396] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:35 2022] DELETE /identity/v3/projects/ddb367783c684aa3a22ca77115329ef5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:36.220099 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f69c1-dced-4838-9585-1b1fb0c7fbec None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:36.220629 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f69c1-dced-4838-9585-1b1fb0c7fbec None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:36.220731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f69c1-dced-4838-9585-1b1fb0c7fbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:36.252883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-566f69c1-dced-4838-9585-1b1fb0c7fbec None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:36.254273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-566f69c1-dced-4838-9585-1b1fb0c7fbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:36.274685 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:36.393182 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1192/2397] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:36.394731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d162a6e-2d88-4816-b3d8-e42823223319 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:36.395034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d162a6e-2d88-4816-b3d8-e42823223319 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:36.395455 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d162a6e-2d88-4816-b3d8-e42823223319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:36.425230 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-7d162a6e-2d88-4816-b3d8-e42823223319 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:36.426606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7d162a6e-2d88-4816-b3d8-e42823223319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:36.435678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1206/2398] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:10:36.440412 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f69c1-dced-4838-9585-1b1fb0c7fbec None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:36.459400 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f69c1-dced-4838-9585-1b1fb0c7fbec None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:36.480098 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c883b-f1a5-4768-9a84-2de19806cc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:36.482870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c883b-f1a5-4768-9a84-2de19806cc27 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:36.484082 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c883b-f1a5-4768-9a84-2de19806cc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:36.485414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c883b-f1a5-4768-9a84-2de19806cc27 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:36.486151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c883b-f1a5-4768-9a84-2de19806cc27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:10:36.487151 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c883b-f1a5-4768-9a84-2de19806cc27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:36.489351 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c883b-f1a5-4768-9a84-2de19806cc27 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:36.510527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d162a6e-2d88-4816-b3d8-e42823223319 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:36.522447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1193/2399] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:10:36.523087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d162a6e-2d88-4816-b3d8-e42823223319 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:36.529240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09bbe5-277d-40dd-9e12-3146fe32ba6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:36.529980 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09bbe5-277d-40dd-9e12-3146fe32ba6a admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:36.530386 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09bbe5-277d-40dd-9e12-3146fe32ba6a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:36.530754 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09bbe5-277d-40dd-9e12-3146fe32ba6a admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:36.531495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09bbe5-277d-40dd-9e12-3146fe32ba6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:36.536040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09bbe5-277d-40dd-9e12-3146fe32ba6a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:36.598607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c883b-f1a5-4768-9a84-2de19806cc27 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:36.616521 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1207/2400] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:10:36 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:36.616891 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c883b-f1a5-4768-9a84-2de19806cc27 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:37.040521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a88806-fa9d-4872-9514-16d32b12be09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:37.041755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a88806-fa9d-4872-9514-16d32b12be09 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:37.041755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a88806-fa9d-4872-9514-16d32b12be09 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:37.042058 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a88806-fa9d-4872-9514-16d32b12be09 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:37.042904 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a88806-fa9d-4872-9514-16d32b12be09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:37.045316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a88806-fa9d-4872-9514-16d32b12be09 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:37.085779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09bbe5-277d-40dd-9e12-3146fe32ba6a admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:37.091863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1194/2401] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:10:36 2022] POST /identity/v3/users => generated 287 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:37.098691 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09bbe5-277d-40dd-9e12-3146fe32ba6a admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:37.106164 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387c019-fd03-46eb-9d60-623db1664dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:37.107152 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387c019-fd03-46eb-9d60-623db1664dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:37.107548 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387c019-fd03-46eb-9d60-623db1664dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:37.107917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387c019-fd03-46eb-9d60-623db1664dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:37.108757 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387c019-fd03-46eb-9d60-623db1664dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:37.110665 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387c019-fd03-46eb-9d60-623db1664dd9 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:37.127718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a88806-fa9d-4872-9514-16d32b12be09 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:37.134770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1208/2402] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:37.143688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a88806-fa9d-4872-9514-16d32b12be09 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:37.149168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f45dd5-2d84-4c79-86f1-9e18a898891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:37.149911 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f45dd5-2d84-4c79-86f1-9e18a898891e admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:37.150294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f45dd5-2d84-4c79-86f1-9e18a898891e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:37.150653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f45dd5-2d84-4c79-86f1-9e18a898891e admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:37.151545 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f45dd5-2d84-4c79-86f1-9e18a898891e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:37.153420 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f45dd5-2d84-4c79-86f1-9e18a898891e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:37.192175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387c019-fd03-46eb-9d60-623db1664dd9 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:37.204134 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1195/2403] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:37.206786 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387c019-fd03-46eb-9d60-623db1664dd9 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:37.216349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53436cd-9650-43c0-a48d-01ac027be48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:37.217039 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53436cd-9650-43c0-a48d-01ac027be48b admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:37.217321 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53436cd-9650-43c0-a48d-01ac027be48b admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:37.217597 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53436cd-9650-43c0-a48d-01ac027be48b admin admin] PATH_INFO: `/v3/projects/387704aac8c844d8a0fb1a9c2b781ffd/users/2cfad9e93c384a65990a18aafd5d586d/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:37.262315 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53436cd-9650-43c0-a48d-01ac027be48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=387704aac8c844d8a0fb1a9c2b781ffd, user_id=2cfad9e93c384a65990a18aafd5d586d, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:37.266558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53436cd-9650-43c0-a48d-01ac027be48b admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:37.299107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1209/2404] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:37 2022] PUT /identity/v3/projects/387704aac8c844d8a0fb1a9c2b781ffd/users/2cfad9e93c384a65990a18aafd5d586d/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:37.318002 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e041873-0cc0-4bc1-82d3-9709f662b592 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:37.319021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e041873-0cc0-4bc1-82d3-9709f662b592 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:37.319401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e041873-0cc0-4bc1-82d3-9709f662b592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:37.382952 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-8e041873-0cc0-4bc1-82d3-9709f662b592 None None] MFA Rules not processed for user `2cfad9e93c384a65990a18aafd5d586d`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:37.384483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-8e041873-0cc0-4bc1-82d3-9709f662b592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:37.500419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1196/2405] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:37.508946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53436cd-9650-43c0-a48d-01ac027be48b admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:37.511606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c53436cd-9650-43c0-a48d-01ac027be48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:37.602575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53436cd-9650-43c0-a48d-01ac027be48b admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:37.608850 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa6188-ff2b-476d-8fce-8e54a622f4f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:37.610112 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa6188-ff2b-476d-8fce-8e54a622f4f7 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:37.615288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa6188-ff2b-476d-8fce-8e54a622f4f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:37.615889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa6188-ff2b-476d-8fce-8e54a622f4f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:37.628410 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa6188-ff2b-476d-8fce-8e54a622f4f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:37.630229 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa6188-ff2b-476d-8fce-8e54a622f4f7 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:37.641862 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1210/2406] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:42.042962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e041873-0cc0-4bc1-82d3-9709f662b592 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:42.066873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:42.180834 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e041873-0cc0-4bc1-82d3-9709f662b592 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:42.187946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb29057-0161-4ac9-b57d-a720cb4908c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:42.189220 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb29057-0161-4ac9-b57d-a720cb4908c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:42.189957 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb29057-0161-4ac9-b57d-a720cb4908c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:42.194003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb29057-0161-4ac9-b57d-a720cb4908c2 admin admin] PATH_INFO: `/v3/users/2cfad9e93c384a65990a18aafd5d586d` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:42.194316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb29057-0161-4ac9-b57d-a720cb4908c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cfad9e93c384a65990a18aafd5d586d)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:42.199062 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb29057-0161-4ac9-b57d-a720cb4908c2 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:42.339341 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-dcb29057-0161-4ac9-b57d-a720cb4908c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cfad9e93c384a65990a18aafd5d586d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:42.340637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-dcb29057-0161-4ac9-b57d-a720cb4908c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cfad9e93c384a65990a18aafd5d586d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:42.362476 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-dcb29057-0161-4ac9-b57d-a720cb4908c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cfad9e93c384a65990a18aafd5d586d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:42.366069 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-dcb29057-0161-4ac9-b57d-a720cb4908c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cfad9e93c384a65990a18aafd5d586d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:42.405053 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-dcb29057-0161-4ac9-b57d-a720cb4908c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cfad9e93c384a65990a18aafd5d586d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:42.504804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1197/2407] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:42 2022] DELETE /identity/v3/users/2cfad9e93c384a65990a18aafd5d586d => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:42.509944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9af5c-e223-4985-88f5-1f06f18ec60f None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:42.510962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9af5c-e223-4985-88f5-1f06f18ec60f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:42.510962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9af5c-e223-4985-88f5-1f06f18ec60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:42.567317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-47e9af5c-e223-4985-88f5-1f06f18ec60f None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:42.568836 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-47e9af5c-e223-4985-88f5-1f06f18ec60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:42.700360 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:42.759753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1211/2408] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:42.766570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb29057-0161-4ac9-b57d-a720cb4908c2 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:42.768223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-dcb29057-0161-4ac9-b57d-a720cb4908c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:42.974383 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb29057-0161-4ac9-b57d-a720cb4908c2 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:42.985189 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1835662-9633-4d57-b8a2-b973b9ba6c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:42.986041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1835662-9633-4d57-b8a2-b973b9ba6c9f service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:42.986304 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1835662-9633-4d57-b8a2-b973b9ba6c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:42.986576 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1835662-9633-4d57-b8a2-b973b9ba6c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:43.001640 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1835662-9633-4d57-b8a2-b973b9ba6c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:43.008516 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1835662-9633-4d57-b8a2-b973b9ba6c9f service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:43.033183 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1198/2409] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:10:43.628752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9af5c-e223-4985-88f5-1f06f18ec60f None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:43.630577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-47e9af5c-e223-4985-88f5-1f06f18ec60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:43.673702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9af5c-e223-4985-88f5-1f06f18ec60f None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:43.681829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35f62c-9395-43e6-b36e-642d8dde21e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:43.682669 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35f62c-9395-43e6-b36e-642d8dde21e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:43.683014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35f62c-9395-43e6-b36e-642d8dde21e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:43.683345 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35f62c-9395-43e6-b36e-642d8dde21e5 admin admin] PATH_INFO: `/v3/projects/387704aac8c844d8a0fb1a9c2b781ffd` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:43.685091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35f62c-9395-43e6-b36e-642d8dde21e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=387704aac8c844d8a0fb1a9c2b781ffd)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:43.687619 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35f62c-9395-43e6-b36e-642d8dde21e5 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:43.832493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ed35f62c-9395-43e6-b36e-642d8dde21e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '387704aac8c844d8a0fb1a9c2b781ffd', 'request_id': 'req-ed35f62c-9395-43e6-b36e-642d8dde21e5'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:43.843226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ed35f62c-9395-43e6-b36e-642d8dde21e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '387704aac8c844d8a0fb1a9c2b781ffd', 'request_id': 'req-ed35f62c-9395-43e6-b36e-642d8dde21e5'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:43.858862 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ed35f62c-9395-43e6-b36e-642d8dde21e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '387704aac8c844d8a0fb1a9c2b781ffd', 'request_id': 'req-ed35f62c-9395-43e6-b36e-642d8dde21e5'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:43.903226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ed35f62c-9395-43e6-b36e-642d8dde21e5 admin admin] The token cache is being invalidate because project 387704aac8c844d8a0fb1a9c2b781ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:43.904925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ed35f62c-9395-43e6-b36e-642d8dde21e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:43.905887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ed35f62c-9395-43e6-b36e-642d8dde21e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:43.908758 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1212/2410] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:43 2022] DELETE /identity/v3/projects/387704aac8c844d8a0fb1a9c2b781ffd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:43.913500 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964776e-3715-4363-ad19-ea85641265bc None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:43.914110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964776e-3715-4363-ad19-ea85641265bc None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:43.914110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964776e-3715-4363-ad19-ea85641265bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:43.960239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-0964776e-3715-4363-ad19-ea85641265bc None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:43.962267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0964776e-3715-4363-ad19-ea85641265bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:44.012173 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:44.086683 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1199/2411] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:44.088690 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3a96a-10d3-4baa-8a7a-78b13ca8845d None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:44.089110 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3a96a-10d3-4baa-8a7a-78b13ca8845d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:44.089237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3a96a-10d3-4baa-8a7a-78b13ca8845d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:44.121468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-23b3a96a-10d3-4baa-8a7a-78b13ca8845d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:44.126704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-23b3a96a-10d3-4baa-8a7a-78b13ca8845d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:44.137616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1213/2412] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:44.143256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964776e-3715-4363-ad19-ea85641265bc None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:44.164962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964776e-3715-4363-ad19-ea85641265bc None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:44.194992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6663bf7-6402-4fff-b0c7-6394e79a4344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:44.196999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6663bf7-6402-4fff-b0c7-6394e79a4344 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:44.199421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6663bf7-6402-4fff-b0c7-6394e79a4344 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:44.199873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6663bf7-6402-4fff-b0c7-6394e79a4344 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:44.201092 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6663bf7-6402-4fff-b0c7-6394e79a4344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:10:44.202696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6663bf7-6402-4fff-b0c7-6394e79a4344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:44.208301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6663bf7-6402-4fff-b0c7-6394e79a4344 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:44.238353 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1200/2413] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:10:44.240032 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3a96a-10d3-4baa-8a7a-78b13ca8845d None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:44.265122 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3a96a-10d3-4baa-8a7a-78b13ca8845d None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:44.277300 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04728a-94df-4b22-9ab0-6a927bb4a2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:44.278208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04728a-94df-4b22-9ab0-6a927bb4a2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:44.278667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04728a-94df-4b22-9ab0-6a927bb4a2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:44.279098 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04728a-94df-4b22-9ab0-6a927bb4a2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:44.280314 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04728a-94df-4b22-9ab0-6a927bb4a2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:44.282647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04728a-94df-4b22-9ab0-6a927bb4a2e3 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:44.331012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1214/2414] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:10:44 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:44.334911 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6663bf7-6402-4fff-b0c7-6394e79a4344 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:44.346005 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6663bf7-6402-4fff-b0c7-6394e79a4344 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:44.457230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae5837-1541-450d-b964-393d93da08f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:44.457882 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae5837-1541-450d-b964-393d93da08f4 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:44.458159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae5837-1541-450d-b964-393d93da08f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:44.458430 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae5837-1541-450d-b964-393d93da08f4 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:44.459097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae5837-1541-450d-b964-393d93da08f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:44.461094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae5837-1541-450d-b964-393d93da08f4 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:44.494363 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1201/2415] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:10:44 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:10:44.498923 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04728a-94df-4b22-9ab0-6a927bb4a2e3 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:44.513301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04728a-94df-4b22-9ab0-6a927bb4a2e3 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:44.519540 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530525a-07e2-4422-9c1a-b9e56f029d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:44.520283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530525a-07e2-4422-9c1a-b9e56f029d81 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:44.520795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530525a-07e2-4422-9c1a-b9e56f029d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:44.521146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530525a-07e2-4422-9c1a-b9e56f029d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:44.521879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530525a-07e2-4422-9c1a-b9e56f029d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:44.523754 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530525a-07e2-4422-9c1a-b9e56f029d81 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:44.548502 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1215/2416] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:44.550213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae5837-1541-450d-b964-393d93da08f4 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:44.565283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae5837-1541-450d-b964-393d93da08f4 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:44.573714 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55acdee-64f6-4b8c-8911-4f69738ffd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:44.574905 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55acdee-64f6-4b8c-8911-4f69738ffd05 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:44.575269 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55acdee-64f6-4b8c-8911-4f69738ffd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:44.575700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55acdee-64f6-4b8c-8911-4f69738ffd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:44.577011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55acdee-64f6-4b8c-8911-4f69738ffd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:44.580211 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55acdee-64f6-4b8c-8911-4f69738ffd05 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:44.607238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1202/2417] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:10:44.608449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530525a-07e2-4422-9c1a-b9e56f029d81 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:44.621793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530525a-07e2-4422-9c1a-b9e56f029d81 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:44.627888 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18cff4-f2e6-47ae-a00f-6cbb562ac1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:44.628626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18cff4-f2e6-47ae-a00f-6cbb562ac1e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:44.628913 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18cff4-f2e6-47ae-a00f-6cbb562ac1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:44.629574 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18cff4-f2e6-47ae-a00f-6cbb562ac1e7 admin admin] PATH_INFO: `/v3/projects/66b2231d171546359b515b48ad8f0d6c/users/9ce1947d5eb44f80b0118e5fca87d26f/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:44.653211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18cff4-f2e6-47ae-a00f-6cbb562ac1e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b2231d171546359b515b48ad8f0d6c, user_id=9ce1947d5eb44f80b0118e5fca87d26f, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:44.656264 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18cff4-f2e6-47ae-a00f-6cbb562ac1e7 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:44.675785 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1216/2418] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:10:44 2022] PUT /identity/v3/projects/66b2231d171546359b515b48ad8f0d6c/users/9ce1947d5eb44f80b0118e5fca87d26f/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:44.759122 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c78daa-5e00-49b0-ad9c-1b065c1f9894 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:44.759906 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c78daa-5e00-49b0-ad9c-1b065c1f9894 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:44.760468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c78daa-5e00-49b0-ad9c-1b065c1f9894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:44.799940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-75c78daa-5e00-49b0-ad9c-1b065c1f9894 None None] MFA Rules not processed for user `9ce1947d5eb44f80b0118e5fca87d26f`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:44.801405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-75c78daa-5e00-49b0-ad9c-1b065c1f9894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:44.946844 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1203/2419] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:44.965525 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18cff4-f2e6-47ae-a00f-6cbb562ac1e7 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:44.968069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ee18cff4-f2e6-47ae-a00f-6cbb562ac1e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:45.042029 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18cff4-f2e6-47ae-a00f-6cbb562ac1e7 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:45.046976 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789b8e5-22c3-434d-aad8-64b52a3fc1db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:45.047795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789b8e5-22c3-434d-aad8-64b52a3fc1db service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:45.048237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789b8e5-22c3-434d-aad8-64b52a3fc1db service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:45.048787 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789b8e5-22c3-434d-aad8-64b52a3fc1db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:45.062005 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789b8e5-22c3-434d-aad8-64b52a3fc1db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:45.063523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789b8e5-22c3-434d-aad8-64b52a3fc1db service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:45.078519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1217/2420] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:10:46.828080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fa47a-f76b-4d20-a445-72b9d6016bad None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:46.828708 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fa47a-f76b-4d20-a445-72b9d6016bad None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:46.828708 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fa47a-f76b-4d20-a445-72b9d6016bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:46.860686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-468fa47a-f76b-4d20-a445-72b9d6016bad None None] MFA Rules not processed for user `9ce1947d5eb44f80b0118e5fca87d26f`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:46.862503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-468fa47a-f76b-4d20-a445-72b9d6016bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:46.884668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1204/2421] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:55.070201 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:55.726642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721733f8-36f6-4a28-941c-ee4d4d5a8ce1 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:55.727251 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721733f8-36f6-4a28-941c-ee4d4d5a8ce1 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:55.728261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721733f8-36f6-4a28-941c-ee4d4d5a8ce1 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:55.730678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1218/2422] 10.222.0.30 () {54 vars in 921 bytes} [Wed Sep 7 13:10:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:10:55.740188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629c562-200a-4518-928b-8f35bcca442a None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:55.741376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629c562-200a-4518-928b-8f35bcca442a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:55.741859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629c562-200a-4518-928b-8f35bcca442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:55.777202 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-7629c562-200a-4518-928b-8f35bcca442a None None] MFA Rules not processed for user `fbe8fa8ab8094aa69933398280810692`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:55.778988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7629c562-200a-4518-928b-8f35bcca442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:55.809373 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:55.912828 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1205/2423] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Sep 7 13:10:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:55.939408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721733f8-36f6-4a28-941c-ee4d4d5a8ce1 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:55.945405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-721733f8-36f6-4a28-941c-ee4d4d5a8ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:56.085286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721733f8-36f6-4a28-941c-ee4d4d5a8ce1 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:56.092840 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b222445-28aa-41cc-932c-270849f1e186 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f332ac2346f0444a8d336ed2b3121be2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:56.094205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b222445-28aa-41cc-932c-270849f1e186 service glance] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:56.094798 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b222445-28aa-41cc-932c-270849f1e186 service glance] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:56.095219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b222445-28aa-41cc-932c-270849f1e186 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:56.115501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b222445-28aa-41cc-932c-270849f1e186 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:56.117908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b222445-28aa-41cc-932c-270849f1e186 service glance] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:56.147268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1219/2424] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:56.257090 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6b100-1b27-48c5-8476-4c91456ab228 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:56.257387 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6b100-1b27-48c5-8476-4c91456ab228 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:56.257655 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6b100-1b27-48c5-8476-4c91456ab228 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:56.259327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1206/2425] 10.222.0.30 () {54 vars in 921 bytes} [Wed Sep 7 13:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:10:56.268073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdc7f0-0f98-4888-a76b-7bad51879447 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:56.268575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdc7f0-0f98-4888-a76b-7bad51879447 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:56.268919 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdc7f0-0f98-4888-a76b-7bad51879447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:56.297785 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-f4cdc7f0-0f98-4888-a76b-7bad51879447 None None] MFA Rules not processed for user `eefd1293a22848e3b595e54be0455d10`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:56.299077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f4cdc7f0-0f98-4888-a76b-7bad51879447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:56.402797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1220/2426] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Sep 7 13:10:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:56.420559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6b100-1b27-48c5-8476-4c91456ab228 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:56.421986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-9fe6b100-1b27-48c5-8476-4c91456ab228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:56.436693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6b100-1b27-48c5-8476-4c91456ab228 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:56.441852 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86133262-eb68-4322-a4b0-e1989c80851e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:56.443766 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86133262-eb68-4322-a4b0-e1989c80851e service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:56.444326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86133262-eb68-4322-a4b0-e1989c80851e service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:56.444940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86133262-eb68-4322-a4b0-e1989c80851e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:56.460767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86133262-eb68-4322-a4b0-e1989c80851e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:56.463712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86133262-eb68-4322-a4b0-e1989c80851e service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:56.480893 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1207/2427] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:56.624954 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37101bd-ef0a-455f-a616-0d3bf5c6b4f6 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:56.625444 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37101bd-ef0a-455f-a616-0d3bf5c6b4f6 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:56.625917 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37101bd-ef0a-455f-a616-0d3bf5c6b4f6 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:56.628510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1221/2428] 10.222.0.30 () {54 vars in 921 bytes} [Wed Sep 7 13:10:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:10:56.638660 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cfac3-e0ec-447e-840e-b1e0083b856a None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:56.638960 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cfac3-e0ec-447e-840e-b1e0083b856a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:56.639490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cfac3-e0ec-447e-840e-b1e0083b856a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:56.661996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-2d1cfac3-e0ec-447e-840e-b1e0083b856a None None] MFA Rules not processed for user `fbe8fa8ab8094aa69933398280810692`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:56.663799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2d1cfac3-e0ec-447e-840e-b1e0083b856a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:56.675076 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1208/2429] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Sep 7 13:10:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:10:56.691618 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37101bd-ef0a-455f-a616-0d3bf5c6b4f6 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:56.706872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37101bd-ef0a-455f-a616-0d3bf5c6b4f6 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:56.711250 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd47ed8-e2f9-4157-93fb-4599a649fdbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:56.711880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd47ed8-e2f9-4157-93fb-4599a649fdbf service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:56.712169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd47ed8-e2f9-4157-93fb-4599a649fdbf service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:56.712480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd47ed8-e2f9-4157-93fb-4599a649fdbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:56.727316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd47ed8-e2f9-4157-93fb-4599a649fdbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:56.729490 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd47ed8-e2f9-4157-93fb-4599a649fdbf service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:56.744830 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1222/2430] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:59.398398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cfac3-e0ec-447e-840e-b1e0083b856a None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:59.400049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2d1cfac3-e0ec-447e-840e-b1e0083b856a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:59.502725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cfac3-e0ec-447e-840e-b1e0083b856a None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:59.510453 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9552b5-931d-448f-85e6-091d22f480ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:59.511184 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9552b5-931d-448f-85e6-091d22f480ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:59.511481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9552b5-931d-448f-85e6-091d22f480ff admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:59.511763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9552b5-931d-448f-85e6-091d22f480ff admin admin] PATH_INFO: `/v3/users/37655384217b4589b1899b9f68ae43cf` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:59.513147 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9552b5-931d-448f-85e6-091d22f480ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=37655384217b4589b1899b9f68ae43cf)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:59.515432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9552b5-931d-448f-85e6-091d22f480ff admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:59.597842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3b9552b5-931d-448f-85e6-091d22f480ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37655384217b4589b1899b9f68ae43cf'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:59.598606 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3b9552b5-931d-448f-85e6-091d22f480ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37655384217b4589b1899b9f68ae43cf'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:59.610896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3b9552b5-931d-448f-85e6-091d22f480ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37655384217b4589b1899b9f68ae43cf'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:59.611466 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3b9552b5-931d-448f-85e6-091d22f480ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37655384217b4589b1899b9f68ae43cf'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:59.620823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-3b9552b5-931d-448f-85e6-091d22f480ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37655384217b4589b1899b9f68ae43cf'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:59.647125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1209/2431] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:59 2022] DELETE /identity/v3/users/37655384217b4589b1899b9f68ae43cf => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:59.652313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a26613-a332-4114-8215-d545a73f04c3 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:59.653144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a26613-a332-4114-8215-d545a73f04c3 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:59.653144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a26613-a332-4114-8215-d545a73f04c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:59.684445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-85a26613-a332-4114-8215-d545a73f04c3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:59.686446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-85a26613-a332-4114-8215-d545a73f04c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:59.780313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1223/2432] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:10:59.792318 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9552b5-931d-448f-85e6-091d22f480ff admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:59.794019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3b9552b5-931d-448f-85e6-091d22f480ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:59.818211 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:59.907194 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9552b5-931d-448f-85e6-091d22f480ff admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:59.912478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcfa1b-4a53-4993-8ff9-32b119159aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:59.913723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcfa1b-4a53-4993-8ff9-32b119159aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:59.914242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcfa1b-4a53-4993-8ff9-32b119159aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:59.914719 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcfa1b-4a53-4993-8ff9-32b119159aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:59.949718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcfa1b-4a53-4993-8ff9-32b119159aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:59.953672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcfa1b-4a53-4993-8ff9-32b119159aa9 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:00.003210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1210/2433] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:11:01.088240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a26613-a332-4114-8215-d545a73f04c3 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:01.091985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-85a26613-a332-4114-8215-d545a73f04c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:01.114881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a26613-a332-4114-8215-d545a73f04c3 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:01.123633 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:01.124742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:01.125359 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:01.126059 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34 admin admin] PATH_INFO: `/v3/projects/9e3ee0e0d48d41a8834ae81587e5e8ee` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:01.130216 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3ee0e0d48d41a8834ae81587e5e8ee)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:01.133221 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:01.211217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:01.225489 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3ee0e0d48d41a8834ae81587e5e8ee', 'request_id': 'req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:01.238784 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3ee0e0d48d41a8834ae81587e5e8ee', 'request_id': 'req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:01.246639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3ee0e0d48d41a8834ae81587e5e8ee', 'request_id': 'req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:01.267505 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34 admin admin] The token cache is being invalidate because project 9e3ee0e0d48d41a8834ae81587e5e8ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:11:01.267885 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:01.268749 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:01.270343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1224/2434] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:11:01 2022] DELETE /identity/v3/projects/9e3ee0e0d48d41a8834ae81587e5e8ee => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:01.594620 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace6615-e2ae-4706-964d-a7016b0586ae None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:01.595381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace6615-e2ae-4706-964d-a7016b0586ae None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:01.595381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace6615-e2ae-4706-964d-a7016b0586ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:01.627697 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-7ace6615-e2ae-4706-964d-a7016b0586ae None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:01.629858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7ace6615-e2ae-4706-964d-a7016b0586ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:01.742582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1211/2435] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Sep 7 13:11:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:01.758500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:01.760267 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:01.861618 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2c16-0ee0-4ceb-863d-4f6dd8ff0d34 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:01.867825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a06ab-624e-4355-a2fc-43f5cdb4ac39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:01.868544 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a06ab-624e-4355-a2fc-43f5cdb4ac39 service swift] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:01.868825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a06ab-624e-4355-a2fc-43f5cdb4ac39 service swift] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:01.869098 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a06ab-624e-4355-a2fc-43f5cdb4ac39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:01.879427 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a06ab-624e-4355-a2fc-43f5cdb4ac39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:01.881597 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a06ab-624e-4355-a2fc-43f5cdb4ac39 service swift] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:01.892468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1225/2436] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:11:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 13:11:11.729281 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=45 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:11.887765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:DELETE=5,keystone:SELECT=43,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:19.703946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ae57c-f2c1-4393-8fe7-67446a17ed30 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:19.704724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ae57c-f2c1-4393-8fe7-67446a17ed30 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:19.704724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ae57c-f2c1-4393-8fe7-67446a17ed30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:19.726983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-f72ae57c-f2c1-4393-8fe7-67446a17ed30 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:19.729403 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f72ae57c-f2c1-4393-8fe7-67446a17ed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:19.802330 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1212/2437] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Sep 7 13:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:19.836937 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a06ab-624e-4355-a2fc-43f5cdb4ac39 service swift] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:19.838726 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a21a06ab-624e-4355-a2fc-43f5cdb4ac39 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:19.925904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a06ab-624e-4355-a2fc-43f5cdb4ac39 service swift] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:19.932146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590b2a3-56ca-4d76-934c-3c1b77c87f15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:19.932807 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590b2a3-56ca-4d76-934c-3c1b77c87f15 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:19.933088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590b2a3-56ca-4d76-934c-3c1b77c87f15 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:19.933358 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590b2a3-56ca-4d76-934c-3c1b77c87f15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:19.943058 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590b2a3-56ca-4d76-934c-3c1b77c87f15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:19.944702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590b2a3-56ca-4d76-934c-3c1b77c87f15 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:19.955892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1226/2438] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:20.981300 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ae57c-f2c1-4393-8fe7-67446a17ed30 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:20.983910 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f72ae57c-f2c1-4393-8fe7-67446a17ed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:21.069350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ae57c-f2c1-4393-8fe7-67446a17ed30 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:21.074676 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18580a70-6433-4d3a-8fc7-9472f226bff4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2420def47ee4a5b8cf4373252583d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:21.075333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18580a70-6433-4d3a-8fc7-9472f226bff4 service placement] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:21.075608 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18580a70-6433-4d3a-8fc7-9472f226bff4 service placement] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:21.075949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18580a70-6433-4d3a-8fc7-9472f226bff4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:21.078039 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-18580a70-6433-4d3a-8fc7-9472f226bff4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:21.091068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18580a70-6433-4d3a-8fc7-9472f226bff4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:21.092890 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18580a70-6433-4d3a-8fc7-9472f226bff4 service placement] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:21.107972 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1213/2439] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:24.871501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd2e36-e2ec-4b82-be77-440559e71387 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:24.872158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd2e36-e2ec-4b82-be77-440559e71387 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:24.872158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd2e36-e2ec-4b82-be77-440559e71387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:24.895397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-4efd2e36-e2ec-4b82-be77-440559e71387 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:24.896716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-4efd2e36-e2ec-4b82-be77-440559e71387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:24.906334 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1227/2440] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Sep 7 13:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:24.922032 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18580a70-6433-4d3a-8fc7-9472f226bff4 service placement] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:24.936268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18580a70-6433-4d3a-8fc7-9472f226bff4 service placement] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:24.942561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ed8e3-8966-4110-a806-be11580999f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:24.943197 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ed8e3-8966-4110-a806-be11580999f1 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:24.943477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ed8e3-8966-4110-a806-be11580999f1 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:24.943754 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ed8e3-8966-4110-a806-be11580999f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:24.953611 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ed8e3-8966-4110-a806-be11580999f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:24.955261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ed8e3-8966-4110-a806-be11580999f1 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:24.967015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1214/2441] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:25.311587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e1c7c-d6b7-4a61-9d88-1c11b24dd379 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:25.311587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e1c7c-d6b7-4a61-9d88-1c11b24dd379 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:25.312075 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e1c7c-d6b7-4a61-9d88-1c11b24dd379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:25.338046 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-8b0e1c7c-d6b7-4a61-9d88-1c11b24dd379 None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:25.339471 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8b0e1c7c-d6b7-4a61-9d88-1c11b24dd379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:25.349795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1228/2442] 10.222.0.30 () {58 vars in 967 bytes} [Wed Sep 7 13:11:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:25.368297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ed8e3-8966-4110-a806-be11580999f1 service nova] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:25.384112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ed8e3-8966-4110-a806-be11580999f1 service nova] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:25.390839 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b448d-e41c-4903-b1f4-11f9f01a842f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:25.391618 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b448d-e41c-4903-b1f4-11f9f01a842f service swift] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:25.392032 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b448d-e41c-4903-b1f4-11f9f01a842f service swift] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:25.392545 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b448d-e41c-4903-b1f4-11f9f01a842f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:25.406824 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b448d-e41c-4903-b1f4-11f9f01a842f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:25.409153 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b448d-e41c-4903-b1f4-11f9f01a842f service swift] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:25.424840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1215/2443] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:11:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:11:29.338451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492adb5-3a7e-49dd-8557-69fae6b4e52c None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.338952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492adb5-3a7e-49dd-8557-69fae6b4e52c None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.339069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492adb5-3a7e-49dd-8557-69fae6b4e52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.349614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef50a1-3c61-421d-a115-45739a42acac None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.350149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef50a1-3c61-421d-a115-45739a42acac None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.350149 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef50a1-3c61-421d-a115-45739a42acac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.363860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-b492adb5-3a7e-49dd-8557-69fae6b4e52c None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:29.365177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b492adb5-3a7e-49dd-8557-69fae6b4e52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:29.373578 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-a0ef50a1-3c61-421d-a115-45739a42acac None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:29.374806 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1229/2444] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Sep 7 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:11:29.375214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a0ef50a1-3c61-421d-a115-45739a42acac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:29.391807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1216/2445] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Sep 7 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:11:29.399867 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492adb5-3a7e-49dd-8557-69fae6b4e52c None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:29.401756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b492adb5-3a7e-49dd-8557-69fae6b4e52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:29.409404 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef50a1-3c61-421d-a115-45739a42acac None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:29.422231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492adb5-3a7e-49dd-8557-69fae6b4e52c None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:29.427769 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef50a1-3c61-421d-a115-45739a42acac None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:29.428203 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83f2a9-5db6-4e0a-be2e-253fa9a61e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:29.428870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83f2a9-5db6-4e0a-be2e-253fa9a61e70 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.429156 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83f2a9-5db6-4e0a-be2e-253fa9a61e70 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.429426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83f2a9-5db6-4e0a-be2e-253fa9a61e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.435715 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86855d-ad4a-4d87-89c8-0a2a498fa3e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:29.436603 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86855d-ad4a-4d87-89c8-0a2a498fa3e8 service swift] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.436878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86855d-ad4a-4d87-89c8-0a2a498fa3e8 service swift] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.437394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86855d-ad4a-4d87-89c8-0a2a498fa3e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.441437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83f2a9-5db6-4e0a-be2e-253fa9a61e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:29.443333 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83f2a9-5db6-4e0a-be2e-253fa9a61e70 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:29.447580 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86855d-ad4a-4d87-89c8-0a2a498fa3e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:29.449541 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86855d-ad4a-4d87-89c8-0a2a498fa3e8 service swift] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:29.459188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1217/2446] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:11:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 13:11:29.469752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1230/2447] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:30.157173 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ccf84-6e79-4b22-8d3f-34d378e11703 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:30.157469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ccf84-6e79-4b22-8d3f-34d378e11703 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:30.157799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ccf84-6e79-4b22-8d3f-34d378e11703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:30.182282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-617ccf84-6e79-4b22-8d3f-34d378e11703 None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:30.183530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-617ccf84-6e79-4b22-8d3f-34d378e11703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:30.192989 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1218/2448] 10.222.0.30 () {58 vars in 967 bytes} [Wed Sep 7 13:11:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:30.207922 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83f2a9-5db6-4e0a-be2e-253fa9a61e70 service nova] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:30.226877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83f2a9-5db6-4e0a-be2e-253fa9a61e70 service nova] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:30.234834 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713d1f1-448b-4f9d-ae33-e0321bcb484d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:30.235948 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713d1f1-448b-4f9d-ae33-e0321bcb484d service swift] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:30.236640 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713d1f1-448b-4f9d-ae33-e0321bcb484d service swift] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:30.236872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713d1f1-448b-4f9d-ae33-e0321bcb484d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:30.251773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713d1f1-448b-4f9d-ae33-e0321bcb484d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:30.254954 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713d1f1-448b-4f9d-ae33-e0321bcb484d service swift] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:30.265027 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1231/2449] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:11:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:11:30.529261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecb904-423e-43da-a52f-5935c5da15bf None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:30.530491 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecb904-423e-43da-a52f-5935c5da15bf None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:30.530859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecb904-423e-43da-a52f-5935c5da15bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:30.555247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-30ecb904-423e-43da-a52f-5935c5da15bf None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:30.557131 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-30ecb904-423e-43da-a52f-5935c5da15bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:30.568029 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1219/2450] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Sep 7 13:11:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:30.582721 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713d1f1-448b-4f9d-ae33-e0321bcb484d service swift] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:30.595166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713d1f1-448b-4f9d-ae33-e0321bcb484d service swift] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:30.600931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d860b-cffa-47ab-a803-bc92769f493d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:30.601582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d860b-cffa-47ab-a803-bc92769f493d service swift] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:30.601895 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d860b-cffa-47ab-a803-bc92769f493d service swift] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:30.602122 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d860b-cffa-47ab-a803-bc92769f493d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:30.612987 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d860b-cffa-47ab-a803-bc92769f493d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:30.615265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d860b-cffa-47ab-a803-bc92769f493d service swift] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:30.627523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1232/2451] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:11:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 13:11:31.059036 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a94dd-80ee-431f-8bf3-9d48dedf107f None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:31.059319 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a94dd-80ee-431f-8bf3-9d48dedf107f None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:31.059559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a94dd-80ee-431f-8bf3-9d48dedf107f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:31.082268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-191a94dd-80ee-431f-8bf3-9d48dedf107f None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:31.083515 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-191a94dd-80ee-431f-8bf3-9d48dedf107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:31.091193 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1220/2452] 10.222.0.30 () {58 vars in 967 bytes} [Wed Sep 7 13:11:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:31.104812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d860b-cffa-47ab-a803-bc92769f493d service swift] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:31.116261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d860b-cffa-47ab-a803-bc92769f493d service swift] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:31.122671 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bda37-4729-4f48-a1ae-0df8c10ccdcb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:31.123633 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bda37-4729-4f48-a1ae-0df8c10ccdcb service swift] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:31.123914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bda37-4729-4f48-a1ae-0df8c10ccdcb service swift] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:31.124172 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bda37-4729-4f48-a1ae-0df8c10ccdcb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:31.135714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bda37-4729-4f48-a1ae-0df8c10ccdcb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:31.137406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bda37-4729-4f48-a1ae-0df8c10ccdcb service swift] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:31.148039 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1233/2453] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:11:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:11:32.469826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e757f-3eca-4308-8224-dc55dde41642 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:32.470542 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e757f-3eca-4308-8224-dc55dde41642 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:32.470737 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e757f-3eca-4308-8224-dc55dde41642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:32.511185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-045e757f-3eca-4308-8224-dc55dde41642 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:32.513381 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-045e757f-3eca-4308-8224-dc55dde41642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:32.532746 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1221/2454] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Sep 7 13:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:32.559411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bda37-4729-4f48-a1ae-0df8c10ccdcb service swift] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:32.583662 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bda37-4729-4f48-a1ae-0df8c10ccdcb service swift] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:32.590124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aafd1-5022-4425-8f03-aac10cf631e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:32.590819 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aafd1-5022-4425-8f03-aac10cf631e5 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:32.591161 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aafd1-5022-4425-8f03-aac10cf631e5 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:32.591450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aafd1-5022-4425-8f03-aac10cf631e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:32.619082 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5aafd1-5022-4425-8f03-aac10cf631e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:32.621377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5aafd1-5022-4425-8f03-aac10cf631e5 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:32.638321 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1234/2455] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:11:33.784599 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e757f-3eca-4308-8224-dc55dde41642 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:33.786276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-045e757f-3eca-4308-8224-dc55dde41642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:33.802563 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e757f-3eca-4308-8224-dc55dde41642 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:33.811468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee0a64-edc2-4cc6-bc1d-f9af779b76e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:33.812424 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee0a64-edc2-4cc6-bc1d-f9af779b76e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:33.812792 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee0a64-edc2-4cc6-bc1d-f9af779b76e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:33.813110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee0a64-edc2-4cc6-bc1d-f9af779b76e0 admin admin] PATH_INFO: `/v3/users/9ce1947d5eb44f80b0118e5fca87d26f` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:33.814558 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee0a64-edc2-4cc6-bc1d-f9af779b76e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce1947d5eb44f80b0118e5fca87d26f)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:33.817809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee0a64-edc2-4cc6-bc1d-f9af779b76e0 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:33.836941 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:33.890870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-98ee0a64-edc2-4cc6-bc1d-f9af779b76e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce1947d5eb44f80b0118e5fca87d26f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:33.891903 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-98ee0a64-edc2-4cc6-bc1d-f9af779b76e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce1947d5eb44f80b0118e5fca87d26f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:33.904541 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-98ee0a64-edc2-4cc6-bc1d-f9af779b76e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce1947d5eb44f80b0118e5fca87d26f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:33.905503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-98ee0a64-edc2-4cc6-bc1d-f9af779b76e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce1947d5eb44f80b0118e5fca87d26f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:33.913183 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-98ee0a64-edc2-4cc6-bc1d-f9af779b76e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce1947d5eb44f80b0118e5fca87d26f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:33.939137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1222/2456] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:11:33 2022] DELETE /identity/v3/users/9ce1947d5eb44f80b0118e5fca87d26f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:11:33.944237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3d082-1b7e-4912-bc2b-3ea7d2674384 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:33.944802 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3d082-1b7e-4912-bc2b-3ea7d2674384 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:33.944938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3d082-1b7e-4912-bc2b-3ea7d2674384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:33.969168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-26e3d082-1b7e-4912-bc2b-3ea7d2674384 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:33.970749 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-26e3d082-1b7e-4912-bc2b-3ea7d2674384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:34.034337 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:34.043606 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1235/2457] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:34.054394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee0a64-edc2-4cc6-bc1d-f9af779b76e0 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:34.055954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-98ee0a64-edc2-4cc6-bc1d-f9af779b76e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:34.120822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee0a64-edc2-4cc6-bc1d-f9af779b76e0 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:34.124748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bdcb8-3bb6-4b57-8740-e9e6873bc493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:34.125354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bdcb8-3bb6-4b57-8740-e9e6873bc493 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:34.125624 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bdcb8-3bb6-4b57-8740-e9e6873bc493 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:34.125893 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bdcb8-3bb6-4b57-8740-e9e6873bc493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:34.137682 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bdcb8-3bb6-4b57-8740-e9e6873bc493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:34.139258 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bdcb8-3bb6-4b57-8740-e9e6873bc493 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:34.150613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1223/2458] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:34.360815 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3d082-1b7e-4912-bc2b-3ea7d2674384 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:34.362589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-26e3d082-1b7e-4912-bc2b-3ea7d2674384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:34.382543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3d082-1b7e-4912-bc2b-3ea7d2674384 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:34.395667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202684-0668-41cd-aba0-f472ff43aa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:34.396343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202684-0668-41cd-aba0-f472ff43aa40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:34.398392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202684-0668-41cd-aba0-f472ff43aa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:34.398392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202684-0668-41cd-aba0-f472ff43aa40 admin admin] PATH_INFO: `/v3/projects/66b2231d171546359b515b48ad8f0d6c` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:34.399030 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86202684-0668-41cd-aba0-f472ff43aa40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b2231d171546359b515b48ad8f0d6c)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:34.401116 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86202684-0668-41cd-aba0-f472ff43aa40 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:34.469060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-86202684-0668-41cd-aba0-f472ff43aa40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b2231d171546359b515b48ad8f0d6c', 'request_id': 'req-86202684-0668-41cd-aba0-f472ff43aa40'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:34.478467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-86202684-0668-41cd-aba0-f472ff43aa40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b2231d171546359b515b48ad8f0d6c', 'request_id': 'req-86202684-0668-41cd-aba0-f472ff43aa40'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:34.491813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-86202684-0668-41cd-aba0-f472ff43aa40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b2231d171546359b515b48ad8f0d6c', 'request_id': 'req-86202684-0668-41cd-aba0-f472ff43aa40'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:34.521797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-86202684-0668-41cd-aba0-f472ff43aa40 admin admin] The token cache is being invalidate because project 66b2231d171546359b515b48ad8f0d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:11:34.522714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-86202684-0668-41cd-aba0-f472ff43aa40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:34.523995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-86202684-0668-41cd-aba0-f472ff43aa40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:34.527918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1236/2459] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:11:34 2022] DELETE /identity/v3/projects/66b2231d171546359b515b48ad8f0d6c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:11:34.535799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d940d9-4c36-446f-8c66-56fbfa309d50 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:34.536258 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d940d9-4c36-446f-8c66-56fbfa309d50 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:34.536701 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d940d9-4c36-446f-8c66-56fbfa309d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:34.608733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-07d940d9-4c36-446f-8c66-56fbfa309d50 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:34.610334 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-07d940d9-4c36-446f-8c66-56fbfa309d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:34.711679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1224/2460] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:34.720790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2550766-37b3-4c67-8c9e-268a94ec6f4e None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:34.721133 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2550766-37b3-4c67-8c9e-268a94ec6f4e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:34.721337 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2550766-37b3-4c67-8c9e-268a94ec6f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:34.745024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-a2550766-37b3-4c67-8c9e-268a94ec6f4e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:34.746351 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a2550766-37b3-4c67-8c9e-268a94ec6f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:34.756843 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1237/2461] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:34.762098 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d940d9-4c36-446f-8c66-56fbfa309d50 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:34.779252 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d940d9-4c36-446f-8c66-56fbfa309d50 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:34.787706 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76f574-b22f-42d7-a98c-ccacadfd3d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:34.789131 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76f574-b22f-42d7-a98c-ccacadfd3d62 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:34.789547 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76f574-b22f-42d7-a98c-ccacadfd3d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:34.789979 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76f574-b22f-42d7-a98c-ccacadfd3d62 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:34.790848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76f574-b22f-42d7-a98c-ccacadfd3d62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:11:34.791281 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76f574-b22f-42d7-a98c-ccacadfd3d62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:34.793446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76f574-b22f-42d7-a98c-ccacadfd3d62 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:34.816506 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1225/2462] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:11:34.821791 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2550766-37b3-4c67-8c9e-268a94ec6f4e None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:34.835343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2550766-37b3-4c67-8c9e-268a94ec6f4e None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:34.840893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd031f54-490d-4d46-a090-1c9f3929a190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:34.841768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd031f54-490d-4d46-a090-1c9f3929a190 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:34.842552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd031f54-490d-4d46-a090-1c9f3929a190 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:34.843093 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd031f54-490d-4d46-a090-1c9f3929a190 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:34.843969 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd031f54-490d-4d46-a090-1c9f3929a190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:34.846904 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd031f54-490d-4d46-a090-1c9f3929a190 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:34.900756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1238/2463] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:11:34 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:11:34.907965 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76f574-b22f-42d7-a98c-ccacadfd3d62 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:34.924337 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76f574-b22f-42d7-a98c-ccacadfd3d62 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:34.955804 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:35.040673 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e92d32-bd09-4913-a5b4-068c8a74faf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:35.041479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e92d32-bd09-4913-a5b4-068c8a74faf7 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:35.041846 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e92d32-bd09-4913-a5b4-068c8a74faf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:35.042219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e92d32-bd09-4913-a5b4-068c8a74faf7 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:35.043070 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e92d32-bd09-4913-a5b4-068c8a74faf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:35.045522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e92d32-bd09-4913-a5b4-068c8a74faf7 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:35.081824 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1226/2464] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:11:34 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:11:35.083350 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd031f54-490d-4d46-a090-1c9f3929a190 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:35.097386 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd031f54-490d-4d46-a090-1c9f3929a190 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:35.103445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4741b69-5a9f-46dc-80e2-88862f3cc555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:35.104077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4741b69-5a9f-46dc-80e2-88862f3cc555 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:35.104356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4741b69-5a9f-46dc-80e2-88862f3cc555 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:35.104662 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4741b69-5a9f-46dc-80e2-88862f3cc555 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:35.105338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4741b69-5a9f-46dc-80e2-88862f3cc555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:35.107245 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4741b69-5a9f-46dc-80e2-88862f3cc555 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:35.121488 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1239/2465] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:35.131291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e92d32-bd09-4913-a5b4-068c8a74faf7 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:35.142304 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e92d32-bd09-4913-a5b4-068c8a74faf7 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:35.147389 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0415b3-897f-4458-8d58-ec978078802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:35.148041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0415b3-897f-4458-8d58-ec978078802d admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:35.148287 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0415b3-897f-4458-8d58-ec978078802d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:35.148602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0415b3-897f-4458-8d58-ec978078802d admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:35.149262 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0415b3-897f-4458-8d58-ec978078802d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:35.150897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0415b3-897f-4458-8d58-ec978078802d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:35.164203 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1227/2466] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:11:35.168755 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4741b69-5a9f-46dc-80e2-88862f3cc555 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:35.183299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4741b69-5a9f-46dc-80e2-88862f3cc555 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:35.189645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77528f5-bd6b-426e-9551-6862b8914b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:35.190332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77528f5-bd6b-426e-9551-6862b8914b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:35.190611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77528f5-bd6b-426e-9551-6862b8914b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:35.190886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77528f5-bd6b-426e-9551-6862b8914b56 admin admin] PATH_INFO: `/v3/projects/fba6dd0f46b44440b518fe3d7d8a2a53/users/44a02c537c0e40ab998a84f1f5c7fa62/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:35.208774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77528f5-bd6b-426e-9551-6862b8914b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba6dd0f46b44440b518fe3d7d8a2a53, user_id=44a02c537c0e40ab998a84f1f5c7fa62, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:35.211529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77528f5-bd6b-426e-9551-6862b8914b56 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:35.229237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1240/2467] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:35 2022] PUT /identity/v3/projects/fba6dd0f46b44440b518fe3d7d8a2a53/users/44a02c537c0e40ab998a84f1f5c7fa62/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:35.235633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824836cb-23c8-480e-8041-2213e64d81d9 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:35.236049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824836cb-23c8-480e-8041-2213e64d81d9 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:35.236184 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824836cb-23c8-480e-8041-2213e64d81d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:35.258563 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-824836cb-23c8-480e-8041-2213e64d81d9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:35.259805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-824836cb-23c8-480e-8041-2213e64d81d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:35.350731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1228/2468] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:35.365533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77528f5-bd6b-426e-9551-6862b8914b56 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:35.367642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c77528f5-bd6b-426e-9551-6862b8914b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:35.437529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77528f5-bd6b-426e-9551-6862b8914b56 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:35.443302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1f61f-6951-4ccf-85ed-169e882ac077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:35.443953 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1f61f-6951-4ccf-85ed-169e882ac077 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:35.444231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1f61f-6951-4ccf-85ed-169e882ac077 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:35.444544 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1f61f-6951-4ccf-85ed-169e882ac077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:35.457124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1f61f-6951-4ccf-85ed-169e882ac077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:35.458709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1f61f-6951-4ccf-85ed-169e882ac077 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:35.472691 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1241/2469] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:35.774271 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31231c21-b11a-438e-b3d4-f3b5512cc484 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:35.774726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31231c21-b11a-438e-b3d4-f3b5512cc484 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:35.775156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31231c21-b11a-438e-b3d4-f3b5512cc484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:35.821161 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-31231c21-b11a-438e-b3d4-f3b5512cc484 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:35.822464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-31231c21-b11a-438e-b3d4-f3b5512cc484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:35.838920 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1229/2470] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Sep 7 13:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:35.868222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1f61f-6951-4ccf-85ed-169e882ac077 service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:35.871067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-00e1f61f-6951-4ccf-85ed-169e882ac077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:35.939126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:36.037653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1f61f-6951-4ccf-85ed-169e882ac077 service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:36.046661 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb75c13-e3d7-4c19-9ca3-459e27aae299 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:36.047343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb75c13-e3d7-4c19-9ca3-459e27aae299 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:36.047624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb75c13-e3d7-4c19-9ca3-459e27aae299 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:36.047897 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb75c13-e3d7-4c19-9ca3-459e27aae299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:36.061019 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb75c13-e3d7-4c19-9ca3-459e27aae299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:36.065077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb75c13-e3d7-4c19-9ca3-459e27aae299 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:36.079469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1242/2471] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:11:39.039517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eb879-77b8-40c3-99b0-85312a6b07b9 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:39.040410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eb879-77b8-40c3-99b0-85312a6b07b9 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:39.040410 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eb879-77b8-40c3-99b0-85312a6b07b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:39.069990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-344eb879-77b8-40c3-99b0-85312a6b07b9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:39.071816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-344eb879-77b8-40c3-99b0-85312a6b07b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:39.083727 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1230/2472] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Sep 7 13:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:39.100521 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb75c13-e3d7-4c19-9ca3-459e27aae299 service nova] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:39.102204 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ecb75c13-e3d7-4c19-9ca3-459e27aae299 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:39.119490 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb75c13-e3d7-4c19-9ca3-459e27aae299 service nova] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:39.126038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1eefb-11e0-404d-8c25-cb7d7e602f97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:39.126978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1eefb-11e0-404d-8c25-cb7d7e602f97 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:39.127289 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1eefb-11e0-404d-8c25-cb7d7e602f97 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:39.127908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1eefb-11e0-404d-8c25-cb7d7e602f97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:39.141613 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1eefb-11e0-404d-8c25-cb7d7e602f97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:39.143978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1eefb-11e0-404d-8c25-cb7d7e602f97 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:39.156447 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1243/2473] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:11:41.225584 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92aae5-f478-46c2-a3da-96da7a351f46 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:41.226312 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92aae5-f478-46c2-a3da-96da7a351f46 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:41.226470 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92aae5-f478-46c2-a3da-96da7a351f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:41.289708 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ed92aae5-f478-46c2-a3da-96da7a351f46 None None] MFA Rules not processed for user `44a02c537c0e40ab998a84f1f5c7fa62`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:41.291778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ed92aae5-f478-46c2-a3da-96da7a351f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:41.480268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1231/2474] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:11:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:41.482903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1eefb-11e0-404d-8c25-cb7d7e602f97 service nova] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:41.504929 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1eefb-11e0-404d-8c25-cb7d7e602f97 service nova] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:41.516047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4d73b-0c92-438e-aac0-f34b843a0cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:41.517040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4d73b-0c92-438e-aac0-f34b843a0cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:41.517351 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4d73b-0c92-438e-aac0-f34b843a0cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:41.517903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4d73b-0c92-438e-aac0-f34b843a0cc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:41.519088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4d73b-0c92-438e-aac0-f34b843a0cc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:41.521187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4d73b-0c92-438e-aac0-f34b843a0cc4 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:41.578935 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1244/2475] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:11:41 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:11:41.585326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92aae5-f478-46c2-a3da-96da7a351f46 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:41.603243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92aae5-f478-46c2-a3da-96da7a351f46 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:41.633812 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:41.723163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4047b-8856-41c5-badd-91f51987e529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:41.723163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4047b-8856-41c5-badd-91f51987e529 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:41.723573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4047b-8856-41c5-badd-91f51987e529 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:41.724042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4047b-8856-41c5-badd-91f51987e529 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:41.725687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4047b-8856-41c5-badd-91f51987e529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:41.728679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4047b-8856-41c5-badd-91f51987e529 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:41.773678 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1232/2476] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:11:41 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:11:41.774715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4d73b-0c92-438e-aac0-f34b843a0cc4 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:41.797440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4d73b-0c92-438e-aac0-f34b843a0cc4 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:41.805704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5d2e6-6080-4e46-a3f5-08beadc20af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:41.808336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5d2e6-6080-4e46-a3f5-08beadc20af4 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:41.809000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5d2e6-6080-4e46-a3f5-08beadc20af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:41.809593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5d2e6-6080-4e46-a3f5-08beadc20af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:41.811214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5d2e6-6080-4e46-a3f5-08beadc20af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:41.815579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5d2e6-6080-4e46-a3f5-08beadc20af4 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:41.849999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1245/2477] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:41.860702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4047b-8856-41c5-badd-91f51987e529 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:41.892715 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4047b-8856-41c5-badd-91f51987e529 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:41.904154 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fa4f8-280d-450f-8995-46b51d3f59f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:41.905652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fa4f8-280d-450f-8995-46b51d3f59f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:41.906136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fa4f8-280d-450f-8995-46b51d3f59f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:41.906632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fa4f8-280d-450f-8995-46b51d3f59f6 admin admin] PATH_INFO: `/v3/projects/54fc53687cc14918af6b4a2419a184c3/users/04dca291638941f1a01a84e3f0633c9d/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:41.945393 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fa4f8-280d-450f-8995-46b51d3f59f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fc53687cc14918af6b4a2419a184c3, user_id=04dca291638941f1a01a84e3f0633c9d, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:41.950909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fa4f8-280d-450f-8995-46b51d3f59f6 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:41.978470 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1233/2478] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:41 2022] PUT /identity/v3/projects/54fc53687cc14918af6b4a2419a184c3/users/04dca291638941f1a01a84e3f0633c9d/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:41.985828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5d2e6-6080-4e46-a3f5-08beadc20af4 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:42.004582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5d2e6-6080-4e46-a3f5-08beadc20af4 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:42.121922 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd18186-ab1a-439a-ac6e-6ffedb6bf112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:42.122912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd18186-ab1a-439a-ac6e-6ffedb6bf112 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:42.123949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd18186-ab1a-439a-ac6e-6ffedb6bf112 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:42.124619 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd18186-ab1a-439a-ac6e-6ffedb6bf112 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:42.125774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd18186-ab1a-439a-ac6e-6ffedb6bf112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:42.128777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd18186-ab1a-439a-ac6e-6ffedb6bf112 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:42.144038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1246/2479] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:42.149243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fa4f8-280d-450f-8995-46b51d3f59f6 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:42.163706 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fa4f8-280d-450f-8995-46b51d3f59f6 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:42.174486 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c9e1f-ba8b-44ea-9a4e-34f5a8aa2cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:42.175505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9e1f-ba8b-44ea-9a4e-34f5a8aa2cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:42.175947 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9e1f-ba8b-44ea-9a4e-34f5a8aa2cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:42.176480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9e1f-ba8b-44ea-9a4e-34f5a8aa2cc0 admin admin] PATH_INFO: `/v3/projects/54fc53687cc14918af6b4a2419a184c3/users/04dca291638941f1a01a84e3f0633c9d/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:42.178967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c9e1f-ba8b-44ea-9a4e-34f5a8aa2cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fc53687cc14918af6b4a2419a184c3, user_id=04dca291638941f1a01a84e3f0633c9d, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:42.182272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c9e1f-ba8b-44ea-9a4e-34f5a8aa2cc0 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:42.207830 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1234/2480] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:42 2022] PUT /identity/v3/projects/54fc53687cc14918af6b4a2419a184c3/users/04dca291638941f1a01a84e3f0633c9d/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:52.137315 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=73,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:52.199986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=37,keystone:INSERT=5 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:52.610083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85dc86-4e5f-4432-9336-b2894361d219 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:52.615831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85dc86-4e5f-4432-9336-b2894361d219 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:52.615831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85dc86-4e5f-4432-9336-b2894361d219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:52.665102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-8c85dc86-4e5f-4432-9336-b2894361d219 None None] MFA Rules not processed for user `04dca291638941f1a01a84e3f0633c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:52.667142 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8c85dc86-4e5f-4432-9336-b2894361d219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:52.886263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1247/2481] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:11:53.119892 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c9e1f-ba8b-44ea-9a4e-34f5a8aa2cc0 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:53.320267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c9e1f-ba8b-44ea-9a4e-34f5a8aa2cc0 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:53.331924 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55181f81-6d06-4906-a586-cfc2b8469728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:53.332786 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55181f81-6d06-4906-a586-cfc2b8469728 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:53.339739 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55181f81-6d06-4906-a586-cfc2b8469728 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:53.340405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55181f81-6d06-4906-a586-cfc2b8469728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:53.480574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55181f81-6d06-4906-a586-cfc2b8469728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:53.483561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55181f81-6d06-4906-a586-cfc2b8469728 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:53.502608 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1235/2482] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:56.084479 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dc33e-af3c-44f4-9dd3-0d99138cb7f1 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:56.085899 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dc33e-af3c-44f4-9dd3-0d99138cb7f1 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:56.086369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dc33e-af3c-44f4-9dd3-0d99138cb7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:56.147297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-e17dc33e-af3c-44f4-9dd3-0d99138cb7f1 None None] MFA Rules not processed for user `44a02c537c0e40ab998a84f1f5c7fa62`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:56.150568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e17dc33e-af3c-44f4-9dd3-0d99138cb7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:56.171048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1248/2483] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:58.943732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10d730-db8e-4b41-85fd-5a958bf0a5fe None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:58.944312 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10d730-db8e-4b41-85fd-5a958bf0a5fe None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:58.944312 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10d730-db8e-4b41-85fd-5a958bf0a5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:58.968387 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-3f10d730-db8e-4b41-85fd-5a958bf0a5fe None None] MFA Rules not processed for user `cc8ea23127db47faa6addb5b0e340e17`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:58.969778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3f10d730-db8e-4b41-85fd-5a958bf0a5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:59.038534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1236/2484] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:06.136432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=37 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:09.027907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=81 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:18.154835 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1f391-e351-4fc4-adff-71b611754da1 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:18.155576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1f391-e351-4fc4-adff-71b611754da1 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:18.156272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1f391-e351-4fc4-adff-71b611754da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:18.185712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-aff1f391-e351-4fc4-adff-71b611754da1 None None] MFA Rules not processed for user `a48139e448064f27bb93baea83ae6697`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:18.197544 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-aff1f391-e351-4fc4-adff-71b611754da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:18.407303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1249/2485] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:12:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:20.575314 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75dea9-381a-4604-867d-ee07d7a17904 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:20.575898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75dea9-381a-4604-867d-ee07d7a17904 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:20.576307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75dea9-381a-4604-867d-ee07d7a17904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:20.634798 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-0b75dea9-381a-4604-867d-ee07d7a17904 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:20.636649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0b75dea9-381a-4604-867d-ee07d7a17904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:20.731530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1237/2486] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Sep 7 13:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:20.753454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1f391-e351-4fc4-adff-71b611754da1 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:20.785177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1f391-e351-4fc4-adff-71b611754da1 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:20.797915 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6e23f-ed5a-419c-a292-ecd04e4b7b6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:20.799013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6e23f-ed5a-419c-a292-ecd04e4b7b6e service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:20.799376 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6e23f-ed5a-419c-a292-ecd04e4b7b6e service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:20.800022 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6e23f-ed5a-419c-a292-ecd04e4b7b6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:20.812217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6e23f-ed5a-419c-a292-ecd04e4b7b6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:20.815784 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6e23f-ed5a-419c-a292-ecd04e4b7b6e service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:20.840483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1250/2487] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:23.957125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e77ee-7572-4ffd-acca-50aca29e58b2 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:23.958420 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e77ee-7572-4ffd-acca-50aca29e58b2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:23.958821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e77ee-7572-4ffd-acca-50aca29e58b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:23.982628 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-265e77ee-7572-4ffd-acca-50aca29e58b2 None None] MFA Rules not processed for user `e4a0c3740593402c955abe8ce23640c4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:23.984652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-265e77ee-7572-4ffd-acca-50aca29e58b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:24.036934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aac249-028e-4010-a9b4-83cc68cd263c None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:24.037694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aac249-028e-4010-a9b4-83cc68cd263c None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:24.037872 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aac249-028e-4010-a9b4-83cc68cd263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:24.055824 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1238/2488] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:12:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:24.066825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-e7aac249-028e-4010-a9b4-83cc68cd263c None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:24.068039 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e7aac249-028e-4010-a9b4-83cc68cd263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:24.080268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1251/2489] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Sep 7 13:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:12:24.100274 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e77ee-7572-4ffd-acca-50aca29e58b2 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:24.129019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e77ee-7572-4ffd-acca-50aca29e58b2 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:24.138470 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5600e30-dba8-4576-bb55-7a0966635017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:24.139529 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5600e30-dba8-4576-bb55-7a0966635017 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:24.140068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5600e30-dba8-4576-bb55-7a0966635017 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:24.140590 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5600e30-dba8-4576-bb55-7a0966635017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:24.158967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5600e30-dba8-4576-bb55-7a0966635017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:24.162083 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5600e30-dba8-4576-bb55-7a0966635017 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:24.179276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1239/2490] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:12:28.316142 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466ecf8-2f2f-4221-b3fe-fccb2a3da234 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:28.316781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466ecf8-2f2f-4221-b3fe-fccb2a3da234 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:28.316781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466ecf8-2f2f-4221-b3fe-fccb2a3da234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:28.341832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-6466ecf8-2f2f-4221-b3fe-fccb2a3da234 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:28.343532 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6466ecf8-2f2f-4221-b3fe-fccb2a3da234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:28.355614 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1252/2491] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Sep 7 13:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:28.378519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5600e30-dba8-4576-bb55-7a0966635017 service nova] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:28.397384 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5600e30-dba8-4576-bb55-7a0966635017 service nova] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:28.404933 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad368b-ed9f-4977-9ff2-a044b704bc44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:28.406212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad368b-ed9f-4977-9ff2-a044b704bc44 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:28.406764 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad368b-ed9f-4977-9ff2-a044b704bc44 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:28.407105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad368b-ed9f-4977-9ff2-a044b704bc44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:28.417655 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad368b-ed9f-4977-9ff2-a044b704bc44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:28.419817 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad368b-ed9f-4977-9ff2-a044b704bc44 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:28.435393 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1240/2492] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:31.643593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ffb8c-a338-4076-a7cf-976ab976f8ea None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:31.644450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ffb8c-a338-4076-a7cf-976ab976f8ea None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:31.644450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ffb8c-a338-4076-a7cf-976ab976f8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:31.684320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-641ffb8c-a338-4076-a7cf-976ab976f8ea None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:31.686735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-641ffb8c-a338-4076-a7cf-976ab976f8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:31.701880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1253/2493] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Sep 7 13:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:31.725566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad368b-ed9f-4977-9ff2-a044b704bc44 service nova] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:31.751015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad368b-ed9f-4977-9ff2-a044b704bc44 service nova] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:31.762032 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a3071-8adb-45dd-b229-0fece9770f3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:31.766876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a3071-8adb-45dd-b229-0fece9770f3a service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:31.767670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a3071-8adb-45dd-b229-0fece9770f3a service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:31.768242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a3071-8adb-45dd-b229-0fece9770f3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:31.790161 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a3071-8adb-45dd-b229-0fece9770f3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:31.793321 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a3071-8adb-45dd-b229-0fece9770f3a service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:31.815428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1241/2494] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:34.927733 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d14a61-d0a5-433d-b25c-a95525697aa9 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:34.928516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d14a61-d0a5-433d-b25c-a95525697aa9 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:34.928516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d14a61-d0a5-433d-b25c-a95525697aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:34.951295 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-05d14a61-d0a5-433d-b25c-a95525697aa9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:34.952699 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-05d14a61-d0a5-433d-b25c-a95525697aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:34.962303 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1254/2495] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Sep 7 13:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:34.980789 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a3071-8adb-45dd-b229-0fece9770f3a service nova] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:34.993353 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a3071-8adb-45dd-b229-0fece9770f3a service nova] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:34.999184 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a4576-9ebb-4fd0-af02-59f4660a791c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:35.000461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a4576-9ebb-4fd0-af02-59f4660a791c service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:35.000746 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a4576-9ebb-4fd0-af02-59f4660a791c service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:35.001019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a4576-9ebb-4fd0-af02-59f4660a791c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:35.017030 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a4576-9ebb-4fd0-af02-59f4660a791c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:35.022433 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a4576-9ebb-4fd0-af02-59f4660a791c service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:35.038282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1242/2496] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:38.413660 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d14a61-d0a5-433d-b25c-a95525697aa9 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:38.512509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d14a61-d0a5-433d-b25c-a95525697aa9 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:38.517447 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12fe83-eb3d-45fe-a285-676d98a0d84d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:38.518149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12fe83-eb3d-45fe-a285-676d98a0d84d service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:38.518473 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12fe83-eb3d-45fe-a285-676d98a0d84d service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:38.518835 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12fe83-eb3d-45fe-a285-676d98a0d84d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:38.530909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12fe83-eb3d-45fe-a285-676d98a0d84d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:38.532949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12fe83-eb3d-45fe-a285-676d98a0d84d service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:38.546063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1255/2497] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:45.028693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=76 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:48.539743 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=69 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:11.854908 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a4576-9ebb-4fd0-af02-59f4660a791c service nova] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:11.854908 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-515a4576-9ebb-4fd0-af02-59f4660a791c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:11.874687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a4576-9ebb-4fd0-af02-59f4660a791c service nova] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:11.880396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28481999-8c43-411b-bcb5-c21e3d1ace21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:11.881156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28481999-8c43-411b-bcb5-c21e3d1ace21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:11.881583 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28481999-8c43-411b-bcb5-c21e3d1ace21 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:11.881976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28481999-8c43-411b-bcb5-c21e3d1ace21 admin admin] PATH_INFO: `/v3/users/cc8ea23127db47faa6addb5b0e340e17` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:11.883354 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28481999-8c43-411b-bcb5-c21e3d1ace21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc8ea23127db47faa6addb5b0e340e17)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:11.885598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28481999-8c43-411b-bcb5-c21e3d1ace21 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:11.957681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-28481999-8c43-411b-bcb5-c21e3d1ace21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc8ea23127db47faa6addb5b0e340e17'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:11.958704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-28481999-8c43-411b-bcb5-c21e3d1ace21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc8ea23127db47faa6addb5b0e340e17'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:11.969079 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-28481999-8c43-411b-bcb5-c21e3d1ace21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc8ea23127db47faa6addb5b0e340e17'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:11.970108 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-28481999-8c43-411b-bcb5-c21e3d1ace21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc8ea23127db47faa6addb5b0e340e17'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:11.984523 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-28481999-8c43-411b-bcb5-c21e3d1ace21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc8ea23127db47faa6addb5b0e340e17'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:12.012639 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1243/2498] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:11 2022] DELETE /identity/v3/users/cc8ea23127db47faa6addb5b0e340e17 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:12.307146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12fe83-eb3d-45fe-a285-676d98a0d84d service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:12.322033 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12fe83-eb3d-45fe-a285-676d98a0d84d service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:12.424943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639521b0-5851-4247-b102-e79b59254140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:12.425988 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639521b0-5851-4247-b102-e79b59254140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:12.426444 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639521b0-5851-4247-b102-e79b59254140 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:12.426908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639521b0-5851-4247-b102-e79b59254140 admin admin] PATH_INFO: `/v3/projects/52fa294daf8f47a48cdf0b1f17b7b151` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:12.428943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639521b0-5851-4247-b102-e79b59254140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52fa294daf8f47a48cdf0b1f17b7b151)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:12.432343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639521b0-5851-4247-b102-e79b59254140 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:12.506568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-639521b0-5851-4247-b102-e79b59254140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52fa294daf8f47a48cdf0b1f17b7b151', 'request_id': 'req-639521b0-5851-4247-b102-e79b59254140'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:12.518374 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-639521b0-5851-4247-b102-e79b59254140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52fa294daf8f47a48cdf0b1f17b7b151', 'request_id': 'req-639521b0-5851-4247-b102-e79b59254140'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:12.525616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-639521b0-5851-4247-b102-e79b59254140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52fa294daf8f47a48cdf0b1f17b7b151', 'request_id': 'req-639521b0-5851-4247-b102-e79b59254140'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:12.549220 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-639521b0-5851-4247-b102-e79b59254140 admin admin] The token cache is being invalidate because project 52fa294daf8f47a48cdf0b1f17b7b151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:12.549605 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-639521b0-5851-4247-b102-e79b59254140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:12.550565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-639521b0-5851-4247-b102-e79b59254140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:12.552639 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1256/2499] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:12 2022] DELETE /identity/v3/projects/52fa294daf8f47a48cdf0b1f17b7b151 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:18.431973 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28481999-8c43-411b-bcb5-c21e3d1ace21 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:18.433907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-28481999-8c43-411b-bcb5-c21e3d1ace21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:18.524632 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28481999-8c43-411b-bcb5-c21e3d1ace21 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:18.579372 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d918-05f1-4f30-abb6-4465a11b108a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:18.579993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d918-05f1-4f30-abb6-4465a11b108a service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:18.580271 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d918-05f1-4f30-abb6-4465a11b108a service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:18.580571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d918-05f1-4f30-abb6-4465a11b108a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:18.582499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2d10d918-05f1-4f30-abb6-4465a11b108a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:18.633968 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:18.679888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10d918-05f1-4f30-abb6-4465a11b108a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:18.682436 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10d918-05f1-4f30-abb6-4465a11b108a service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:18.700701 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1244/2500] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:19.927089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639521b0-5851-4247-b102-e79b59254140 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:19.928693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-639521b0-5851-4247-b102-e79b59254140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:19.942787 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639521b0-5851-4247-b102-e79b59254140 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:19.947307 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b82a0-2244-4f6f-8fd2-724f19170431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:19.947945 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b82a0-2244-4f6f-8fd2-724f19170431 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:19.948226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b82a0-2244-4f6f-8fd2-724f19170431 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:19.948533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b82a0-2244-4f6f-8fd2-724f19170431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:19.950400 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8a3b82a0-2244-4f6f-8fd2-724f19170431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:19.974667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b82a0-2244-4f6f-8fd2-724f19170431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:19.976225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b82a0-2244-4f6f-8fd2-724f19170431 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:19.990126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1257/2501] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:28.693463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=14 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:29.984601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:38.423782 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d918-05f1-4f30-abb6-4465a11b108a service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:38.433652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d918-05f1-4f30-abb6-4465a11b108a service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:38.445458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63419dd-c896-4695-9c18-1d0fbce24b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:38.446101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63419dd-c896-4695-9c18-1d0fbce24b5e service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:38.446380 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63419dd-c896-4695-9c18-1d0fbce24b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:38.446652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63419dd-c896-4695-9c18-1d0fbce24b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:38.448686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a63419dd-c896-4695-9c18-1d0fbce24b5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:38.557829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63419dd-c896-4695-9c18-1d0fbce24b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:38.561080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63419dd-c896-4695-9c18-1d0fbce24b5e service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:38.579999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1245/2502] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:38.658578 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b82a0-2244-4f6f-8fd2-724f19170431 service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:38.661112 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8a3b82a0-2244-4f6f-8fd2-724f19170431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:38.687167 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b82a0-2244-4f6f-8fd2-724f19170431 service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:38.697847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e91b1-e0cb-478c-9979-5f46d9e5a7ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:38.698887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e91b1-e0cb-478c-9979-5f46d9e5a7ed service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:38.699364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e91b1-e0cb-478c-9979-5f46d9e5a7ed service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:38.699820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e91b1-e0cb-478c-9979-5f46d9e5a7ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:38.703624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f84e91b1-e0cb-478c-9979-5f46d9e5a7ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:38.788847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e91b1-e0cb-478c-9979-5f46d9e5a7ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:38.792263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e91b1-e0cb-478c-9979-5f46d9e5a7ed service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:38.811349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1258/2503] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:43.873858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63419dd-c896-4695-9c18-1d0fbce24b5e service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:43.881372 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a63419dd-c896-4695-9c18-1d0fbce24b5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:43.905794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63419dd-c896-4695-9c18-1d0fbce24b5e service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:43.917461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bccc93-2704-4dc5-b42d-83b9e9065ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:43.918454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bccc93-2704-4dc5-b42d-83b9e9065ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:43.918932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bccc93-2704-4dc5-b42d-83b9e9065ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:43.919408 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bccc93-2704-4dc5-b42d-83b9e9065ac7 admin admin] PATH_INFO: `/v3/users/a48139e448064f27bb93baea83ae6697` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:43.921750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bccc93-2704-4dc5-b42d-83b9e9065ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a48139e448064f27bb93baea83ae6697)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:43.925647 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bccc93-2704-4dc5-b42d-83b9e9065ac7 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:44.014610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e1bccc93-2704-4dc5-b42d-83b9e9065ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a48139e448064f27bb93baea83ae6697'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:44.015708 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e1bccc93-2704-4dc5-b42d-83b9e9065ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a48139e448064f27bb93baea83ae6697'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:44.040461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e1bccc93-2704-4dc5-b42d-83b9e9065ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a48139e448064f27bb93baea83ae6697'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:44.043962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e1bccc93-2704-4dc5-b42d-83b9e9065ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a48139e448064f27bb93baea83ae6697'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:44.065487 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e1bccc93-2704-4dc5-b42d-83b9e9065ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a48139e448064f27bb93baea83ae6697'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:44.109289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1246/2504] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:43 2022] DELETE /identity/v3/users/a48139e448064f27bb93baea83ae6697 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:44.416565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e91b1-e0cb-478c-9979-5f46d9e5a7ed service nova] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:44.443709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e91b1-e0cb-478c-9979-5f46d9e5a7ed service nova] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:44.543876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92897a7-997b-4adc-b40e-e78c373436db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:44.544586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92897a7-997b-4adc-b40e-e78c373436db admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:44.544870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92897a7-997b-4adc-b40e-e78c373436db admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:44.545149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92897a7-997b-4adc-b40e-e78c373436db admin admin] PATH_INFO: `/v3/projects/3b6c1bec29b942eb938592a894917a38` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:44.546355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92897a7-997b-4adc-b40e-e78c373436db admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b6c1bec29b942eb938592a894917a38)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:44.548762 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92897a7-997b-4adc-b40e-e78c373436db admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:44.619452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c92897a7-997b-4adc-b40e-e78c373436db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b6c1bec29b942eb938592a894917a38', 'request_id': 'req-c92897a7-997b-4adc-b40e-e78c373436db'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:44.627490 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c92897a7-997b-4adc-b40e-e78c373436db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b6c1bec29b942eb938592a894917a38', 'request_id': 'req-c92897a7-997b-4adc-b40e-e78c373436db'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:44.634077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c92897a7-997b-4adc-b40e-e78c373436db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b6c1bec29b942eb938592a894917a38', 'request_id': 'req-c92897a7-997b-4adc-b40e-e78c373436db'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:44.651913 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c92897a7-997b-4adc-b40e-e78c373436db admin admin] The token cache is being invalidate because project 3b6c1bec29b942eb938592a894917a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:44.652429 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c92897a7-997b-4adc-b40e-e78c373436db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:44.653458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c92897a7-997b-4adc-b40e-e78c373436db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:44.656052 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1259/2505] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:44 2022] DELETE /identity/v3/projects/3b6c1bec29b942eb938592a894917a38 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:44.663105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56ded8-954c-428b-b7f0-fa36218682f3 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:44.663388 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56ded8-954c-428b-b7f0-fa36218682f3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:44.663665 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56ded8-954c-428b-b7f0-fa36218682f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:44.691527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-4f56ded8-954c-428b-b7f0-fa36218682f3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:44.693254 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4f56ded8-954c-428b-b7f0-fa36218682f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:44.805973 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1247/2506] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:44.815752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97351350-518e-4e2b-9b3b-316c2670a470 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:44.816635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97351350-518e-4e2b-9b3b-316c2670a470 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:44.817097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97351350-518e-4e2b-9b3b-316c2670a470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:44.851078 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-97351350-518e-4e2b-9b3b-316c2670a470 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:44.853064 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-97351350-518e-4e2b-9b3b-316c2670a470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:44.866326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1260/2507] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:44.872404 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56ded8-954c-428b-b7f0-fa36218682f3 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:44.890602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56ded8-954c-428b-b7f0-fa36218682f3 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:44.897505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533825b7-6c60-4277-87dd-f432328f9965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:44.898482 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533825b7-6c60-4277-87dd-f432328f9965 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:44.899125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533825b7-6c60-4277-87dd-f432328f9965 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:44.899564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533825b7-6c60-4277-87dd-f432328f9965 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:44.900864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533825b7-6c60-4277-87dd-f432328f9965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:44.901382 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533825b7-6c60-4277-87dd-f432328f9965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:44.904658 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533825b7-6c60-4277-87dd-f432328f9965 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:44.907900 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:44.932476 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1248/2508] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:13:44.940357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97351350-518e-4e2b-9b3b-316c2670a470 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:44.957769 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97351350-518e-4e2b-9b3b-316c2670a470 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:44.967571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adc86c-baf5-447e-980d-7f1e7de355b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:44.968353 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adc86c-baf5-447e-980d-7f1e7de355b2 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:44.968674 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adc86c-baf5-447e-980d-7f1e7de355b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:44.968937 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adc86c-baf5-447e-980d-7f1e7de355b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:44.969890 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adc86c-baf5-447e-980d-7f1e7de355b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:44.973505 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adc86c-baf5-447e-980d-7f1e7de355b2 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:45.026963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:45.038737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1261/2509] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:44 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:45.060993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533825b7-6c60-4277-87dd-f432328f9965 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:45.077156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533825b7-6c60-4277-87dd-f432328f9965 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:45.215204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16339f1-785e-421a-af23-9e768e830d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:45.216127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16339f1-785e-421a-af23-9e768e830d22 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:45.216840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16339f1-785e-421a-af23-9e768e830d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:45.217369 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16339f1-785e-421a-af23-9e768e830d22 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:45.218621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16339f1-785e-421a-af23-9e768e830d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:45.229454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16339f1-785e-421a-af23-9e768e830d22 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:45.288738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1249/2510] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:45 2022] POST /identity/v3/users => generated 287 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:45.294271 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adc86c-baf5-447e-980d-7f1e7de355b2 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:45.325008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adc86c-baf5-447e-980d-7f1e7de355b2 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:45.339062 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7285dc-7404-4f73-9475-99e5d2eb92ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:45.340238 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7285dc-7404-4f73-9475-99e5d2eb92ae admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:45.340783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7285dc-7404-4f73-9475-99e5d2eb92ae admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:45.341276 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7285dc-7404-4f73-9475-99e5d2eb92ae admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:45.342500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7285dc-7404-4f73-9475-99e5d2eb92ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:45.346423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7285dc-7404-4f73-9475-99e5d2eb92ae admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:45.365249 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1262/2511] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:45.378210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16339f1-785e-421a-af23-9e768e830d22 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:45.398430 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16339f1-785e-421a-af23-9e768e830d22 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:45.408366 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ad21a-c4c5-4710-a28f-6cbaaa63ce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:45.409165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ad21a-c4c5-4710-a28f-6cbaaa63ce2c admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:45.409649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ad21a-c4c5-4710-a28f-6cbaaa63ce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:45.410113 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ad21a-c4c5-4710-a28f-6cbaaa63ce2c admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:45.411653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ad21a-c4c5-4710-a28f-6cbaaa63ce2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:45.413736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ad21a-c4c5-4710-a28f-6cbaaa63ce2c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:45.436692 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1250/2512] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:45.443835 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7285dc-7404-4f73-9475-99e5d2eb92ae admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:45.464936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7285dc-7404-4f73-9475-99e5d2eb92ae admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:45.473928 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886c8ee-d3db-4686-a2a8-f9c69708339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:45.475221 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886c8ee-d3db-4686-a2a8-f9c69708339e admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:45.475932 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886c8ee-d3db-4686-a2a8-f9c69708339e admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:45.476857 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886c8ee-d3db-4686-a2a8-f9c69708339e admin admin] PATH_INFO: `/v3/projects/d1f71b54ee5d4916bf63f91e20552d72/users/5c8a42953f90452980711108e43c53f8/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:45.506075 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886c8ee-d3db-4686-a2a8-f9c69708339e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f71b54ee5d4916bf63f91e20552d72, user_id=5c8a42953f90452980711108e43c53f8, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:45.509811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886c8ee-d3db-4686-a2a8-f9c69708339e admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:45.544094 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1263/2513] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:45 2022] PUT /identity/v3/projects/d1f71b54ee5d4916bf63f91e20552d72/users/5c8a42953f90452980711108e43c53f8/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:45.559462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20a161-3fd2-4814-bdc3-0b3fb6cfd294 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:45.560010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20a161-3fd2-4814-bdc3-0b3fb6cfd294 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:45.560551 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20a161-3fd2-4814-bdc3-0b3fb6cfd294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:45.633486 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-2f20a161-3fd2-4814-bdc3-0b3fb6cfd294 None None] MFA Rules not processed for user `5c8a42953f90452980711108e43c53f8`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:45.635078 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2f20a161-3fd2-4814-bdc3-0b3fb6cfd294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:45.768861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1251/2514] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:13:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:45.781408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886c8ee-d3db-4686-a2a8-f9c69708339e admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:45.783475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6886c8ee-d3db-4686-a2a8-f9c69708339e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:45.914748 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886c8ee-d3db-4686-a2a8-f9c69708339e admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:45.922715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d4250-9180-44de-b7e2-5664c60a20e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:45.923912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d4250-9180-44de-b7e2-5664c60a20e1 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:45.924274 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d4250-9180-44de-b7e2-5664c60a20e1 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:45.925215 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d4250-9180-44de-b7e2-5664c60a20e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:45.946973 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d4250-9180-44de-b7e2-5664c60a20e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:45.950034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d4250-9180-44de-b7e2-5664c60a20e1 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:45.979607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1264/2515] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:49.117119 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67435997-f336-4807-8e32-9073f1016747 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:49.117990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67435997-f336-4807-8e32-9073f1016747 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:49.118349 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67435997-f336-4807-8e32-9073f1016747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:49.153645 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-67435997-f336-4807-8e32-9073f1016747 None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:49.155886 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-67435997-f336-4807-8e32-9073f1016747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:49.286083 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1252/2516] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Sep 7 13:13:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:49.396451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d4250-9180-44de-b7e2-5664c60a20e1 service nova] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:49.402835 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-952d4250-9180-44de-b7e2-5664c60a20e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:49.417712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67435997-f336-4807-8e32-9073f1016747 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:49.429639 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:49.573906 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d4250-9180-44de-b7e2-5664c60a20e1 service nova] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:49.588658 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c2886-2af4-4a63-82de-2ce5854dc76a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:49.589780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c2886-2af4-4a63-82de-2ce5854dc76a service swift] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:49.590247 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c2886-2af4-4a63-82de-2ce5854dc76a service swift] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:49.590734 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c2886-2af4-4a63-82de-2ce5854dc76a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:49.590925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67435997-f336-4807-8e32-9073f1016747 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:49.599475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f2fea-c0dc-43b1-8c25-862a1698d670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:49.600739 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f2fea-c0dc-43b1-8c25-862a1698d670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:49.601242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f2fea-c0dc-43b1-8c25-862a1698d670 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:49.602091 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f2fea-c0dc-43b1-8c25-862a1698d670 admin admin] PATH_INFO: `/v3/users/5c8a42953f90452980711108e43c53f8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:49.604789 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f2fea-c0dc-43b1-8c25-862a1698d670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c8a42953f90452980711108e43c53f8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:49.609751 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f2fea-c0dc-43b1-8c25-862a1698d670 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:49.643813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c2886-2af4-4a63-82de-2ce5854dc76a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:49.647048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c2886-2af4-4a63-82de-2ce5854dc76a service swift] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:49.704650 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1265/2517] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:13:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:13:49.756365 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e11f2fea-c0dc-43b1-8c25-862a1698d670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c8a42953f90452980711108e43c53f8'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:49.758334 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e11f2fea-c0dc-43b1-8c25-862a1698d670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c8a42953f90452980711108e43c53f8'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:49.800581 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e11f2fea-c0dc-43b1-8c25-862a1698d670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c8a42953f90452980711108e43c53f8'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:49.802365 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e11f2fea-c0dc-43b1-8c25-862a1698d670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c8a42953f90452980711108e43c53f8'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:49.820605 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e11f2fea-c0dc-43b1-8c25-862a1698d670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c8a42953f90452980711108e43c53f8'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:49.912447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1253/2518] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:49 2022] DELETE /identity/v3/users/5c8a42953f90452980711108e43c53f8 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:49.916032 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a8dd8-25a3-4c2d-a18c-7068632f4ae5 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:49.916806 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a8dd8-25a3-4c2d-a18c-7068632f4ae5 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:49.917468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a8dd8-25a3-4c2d-a18c-7068632f4ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:50.000762 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-ed6a8dd8-25a3-4c2d-a18c-7068632f4ae5 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:50.002553 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ed6a8dd8-25a3-4c2d-a18c-7068632f4ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:50.127088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:50.197598 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1266/2519] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:50.209145 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f2fea-c0dc-43b1-8c25-862a1698d670 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:50.213494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-e11f2fea-c0dc-43b1-8c25-862a1698d670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:50.406943 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f2fea-c0dc-43b1-8c25-862a1698d670 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:50.413927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fef06-b2d7-43a7-a641-7508a4c3c50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:50.416279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fef06-b2d7-43a7-a641-7508a4c3c50c service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:50.416279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fef06-b2d7-43a7-a641-7508a4c3c50c service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:50.416794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fef06-b2d7-43a7-a641-7508a4c3c50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:50.435670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fef06-b2d7-43a7-a641-7508a4c3c50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:50.438342 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fef06-b2d7-43a7-a641-7508a4c3c50c service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:50.472825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1254/2520] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:51.108408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a8dd8-25a3-4c2d-a18c-7068632f4ae5 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:51.116184 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ed6a8dd8-25a3-4c2d-a18c-7068632f4ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:51.193437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a8dd8-25a3-4c2d-a18c-7068632f4ae5 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:51.203879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c159c8b-c18a-4f13-be1d-66f212dc350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:51.207170 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159c8b-c18a-4f13-be1d-66f212dc350c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.207648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159c8b-c18a-4f13-be1d-66f212dc350c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.208053 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159c8b-c18a-4f13-be1d-66f212dc350c admin admin] PATH_INFO: `/v3/projects/d1f71b54ee5d4916bf63f91e20552d72` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.210576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c159c8b-c18a-4f13-be1d-66f212dc350c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f71b54ee5d4916bf63f91e20552d72)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:51.215088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c159c8b-c18a-4f13-be1d-66f212dc350c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:51.351997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-0c159c8b-c18a-4f13-be1d-66f212dc350c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f71b54ee5d4916bf63f91e20552d72', 'request_id': 'req-0c159c8b-c18a-4f13-be1d-66f212dc350c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:51.372317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-0c159c8b-c18a-4f13-be1d-66f212dc350c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f71b54ee5d4916bf63f91e20552d72', 'request_id': 'req-0c159c8b-c18a-4f13-be1d-66f212dc350c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:51.388962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-0c159c8b-c18a-4f13-be1d-66f212dc350c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f71b54ee5d4916bf63f91e20552d72', 'request_id': 'req-0c159c8b-c18a-4f13-be1d-66f212dc350c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:51.424169 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-0c159c8b-c18a-4f13-be1d-66f212dc350c admin admin] The token cache is being invalidate because project d1f71b54ee5d4916bf63f91e20552d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:51.424701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-0c159c8b-c18a-4f13-be1d-66f212dc350c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:51.425898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-0c159c8b-c18a-4f13-be1d-66f212dc350c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:51.429873 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1267/2521] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:51 2022] DELETE /identity/v3/projects/d1f71b54ee5d4916bf63f91e20552d72 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:51.436871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa260c7-627e-498f-9f06-cd4a1716d470 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.437911 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa260c7-627e-498f-9f06-cd4a1716d470 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.439024 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa260c7-627e-498f-9f06-cd4a1716d470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.491089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-efa260c7-627e-498f-9f06-cd4a1716d470 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:51.493816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-efa260c7-627e-498f-9f06-cd4a1716d470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:51.587530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:51.710606 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1255/2522] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:51.746765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad99c2-8ea1-4c5e-9738-7d9b946304ef None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.747970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad99c2-8ea1-4c5e-9738-7d9b946304ef None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.748708 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad99c2-8ea1-4c5e-9738-7d9b946304ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.801749 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-d8ad99c2-8ea1-4c5e-9738-7d9b946304ef None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:51.805042 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d8ad99c2-8ea1-4c5e-9738-7d9b946304ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:51.821415 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1268/2523] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:51.828921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa260c7-627e-498f-9f06-cd4a1716d470 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:51.855638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa260c7-627e-498f-9f06-cd4a1716d470 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:51.874504 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27490048-fbd5-41e1-8f42-cf8c9a65df96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:51.875639 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27490048-fbd5-41e1-8f42-cf8c9a65df96 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.876156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27490048-fbd5-41e1-8f42-cf8c9a65df96 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.876732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27490048-fbd5-41e1-8f42-cf8c9a65df96 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.877940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27490048-fbd5-41e1-8f42-cf8c9a65df96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:51.878471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27490048-fbd5-41e1-8f42-cf8c9a65df96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:51.881655 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27490048-fbd5-41e1-8f42-cf8c9a65df96 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:51.912897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1256/2524] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:13:51.920005 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad99c2-8ea1-4c5e-9738-7d9b946304ef None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:51.966506 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad99c2-8ea1-4c5e-9738-7d9b946304ef None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:51.987643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5833a9d-b05e-4e72-bace-338d8bed7e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:51.991164 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5833a9d-b05e-4e72-bace-338d8bed7e4d admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.993519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5833a9d-b05e-4e72-bace-338d8bed7e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.994075 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5833a9d-b05e-4e72-bace-338d8bed7e4d admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.995174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5833a9d-b05e-4e72-bace-338d8bed7e4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:51.998603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5833a9d-b05e-4e72-bace-338d8bed7e4d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:52.068487 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1269/2525] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:51 2022] POST /identity/v3/projects => generated 357 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:52.074713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27490048-fbd5-41e1-8f42-cf8c9a65df96 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:52.109883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27490048-fbd5-41e1-8f42-cf8c9a65df96 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:52.320842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c93259-6a19-465b-941e-4ef310360d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:52.321920 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c93259-6a19-465b-941e-4ef310360d4b admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:52.322423 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c93259-6a19-465b-941e-4ef310360d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:52.322924 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c93259-6a19-465b-941e-4ef310360d4b admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:52.324111 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c93259-6a19-465b-941e-4ef310360d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:52.327880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c93259-6a19-465b-941e-4ef310360d4b admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:52.402446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1257/2526] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:52 2022] POST /identity/v3/users => generated 279 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:52.407035 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5833a9d-b05e-4e72-bace-338d8bed7e4d admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:52.427335 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5833a9d-b05e-4e72-bace-338d8bed7e4d admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:52.436043 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6a843-4eb4-4c16-b8d4-e6d81415509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:52.437632 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a843-4eb4-4c16-b8d4-e6d81415509a admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:52.438970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a843-4eb4-4c16-b8d4-e6d81415509a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:52.438970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a843-4eb4-4c16-b8d4-e6d81415509a admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:52.441756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6a843-4eb4-4c16-b8d4-e6d81415509a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:52.443968 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6a843-4eb4-4c16-b8d4-e6d81415509a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:52.481573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1270/2527] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:52.487512 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c93259-6a19-465b-941e-4ef310360d4b admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:52.512942 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c93259-6a19-465b-941e-4ef310360d4b admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:52.542656 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acff84-767e-4212-a32e-abf6d2904d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:52.543995 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acff84-767e-4212-a32e-abf6d2904d95 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:52.546130 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acff84-767e-4212-a32e-abf6d2904d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:52.552082 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acff84-767e-4212-a32e-abf6d2904d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:52.553989 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acff84-767e-4212-a32e-abf6d2904d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:52.559301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acff84-767e-4212-a32e-abf6d2904d95 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:52.603514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1258/2528] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:52.612283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6a843-4eb4-4c16-b8d4-e6d81415509a admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:52.634294 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6a843-4eb4-4c16-b8d4-e6d81415509a admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:52.642967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96864f46-c71c-4a9d-af51-08961ba48dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:52.644724 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96864f46-c71c-4a9d-af51-08961ba48dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:52.645023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96864f46-c71c-4a9d-af51-08961ba48dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:52.645603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96864f46-c71c-4a9d-af51-08961ba48dc6 admin admin] PATH_INFO: `/v3/projects/5de2eadb1d394f628918552cb8636731/users/03cb69a1f864476bbac90e153194061b/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:52.682395 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96864f46-c71c-4a9d-af51-08961ba48dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de2eadb1d394f628918552cb8636731, user_id=03cb69a1f864476bbac90e153194061b, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:52.692059 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96864f46-c71c-4a9d-af51-08961ba48dc6 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:52.714035 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487a828-e1ef-4ef3-b467-0e693d1c3cee None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:52.715018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487a828-e1ef-4ef3-b467-0e693d1c3cee None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:52.715674 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487a828-e1ef-4ef3-b467-0e693d1c3cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:52.737264 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1271/2529] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:52 2022] PUT /identity/v3/projects/5de2eadb1d394f628918552cb8636731/users/03cb69a1f864476bbac90e153194061b/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:52.755162 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03b31-27c6-4f93-b8b2-bbe01d50bd0f None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:52.755595 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-7487a828-e1ef-4ef3-b467-0e693d1c3cee None None] MFA Rules not processed for user `2b1ed674b846444e9239d42e7ea03b53`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:52.756050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03b31-27c6-4f93-b8b2-bbe01d50bd0f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:52.759259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03b31-27c6-4f93-b8b2-bbe01d50bd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:52.760227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7487a828-e1ef-4ef3-b467-0e693d1c3cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:52.863591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-1cf03b31-27c6-4f93-b8b2-bbe01d50bd0f None None] MFA Rules not processed for user `03cb69a1f864476bbac90e153194061b`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:52.866133 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1cf03b31-27c6-4f93-b8b2-bbe01d50bd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:52.939896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1259/2530] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:13:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:53.022297 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:53.087654 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1272/2531] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:13:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:53.095339 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487a828-e1ef-4ef3-b467-0e693d1c3cee None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:53.273871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:53.335794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487a828-e1ef-4ef3-b467-0e693d1c3cee None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:53.356769 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c10eb-2bfa-4ba7-82b4-dc551b1364be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:53.357812 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c10eb-2bfa-4ba7-82b4-dc551b1364be admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:53.358304 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c10eb-2bfa-4ba7-82b4-dc551b1364be admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:53.358878 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c10eb-2bfa-4ba7-82b4-dc551b1364be admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:53.360732 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c10eb-2bfa-4ba7-82b4-dc551b1364be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:53.365304 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c10eb-2bfa-4ba7-82b4-dc551b1364be admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:53.445206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1260/2532] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:53 2022] POST /identity/v3/projects => generated 357 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:53.448799 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03b31-27c6-4f93-b8b2-bbe01d50bd0f None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:53.502948 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03b31-27c6-4f93-b8b2-bbe01d50bd0f None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:53.729666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c10eb-2bfa-4ba7-82b4-dc551b1364be admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:53.736190 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a97c10eb-2bfa-4ba7-82b4-dc551b1364be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:53.767067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd0817-1722-4e92-bfb8-191a7cb0993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:53.767067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd0817-1722-4e92-bfb8-191a7cb0993c admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:53.767067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd0817-1722-4e92-bfb8-191a7cb0993c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:53.767067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd0817-1722-4e92-bfb8-191a7cb0993c admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:53.772941 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd0817-1722-4e92-bfb8-191a7cb0993c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:53.774469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd0817-1722-4e92-bfb8-191a7cb0993c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:53.880014 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1273/2533] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:53 2022] POST /identity/v3/users => generated 285 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:53.881865 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd0817-1722-4e92-bfb8-191a7cb0993c admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:53.949041 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd0817-1722-4e92-bfb8-191a7cb0993c admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:53.966559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b2319-4e74-4934-9373-922579da2631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:53.967643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b2319-4e74-4934-9373-922579da2631 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:53.968125 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b2319-4e74-4934-9373-922579da2631 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:53.968670 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b2319-4e74-4934-9373-922579da2631 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:53.969659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b2319-4e74-4934-9373-922579da2631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:53.971942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b2319-4e74-4934-9373-922579da2631 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:54.003685 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c10eb-2bfa-4ba7-82b4-dc551b1364be admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:54.010748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba154409-41a6-4f75-b1b9-f54a6b533022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:54.012248 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba154409-41a6-4f75-b1b9-f54a6b533022 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:54.014167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba154409-41a6-4f75-b1b9-f54a6b533022 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:54.014777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba154409-41a6-4f75-b1b9-f54a6b533022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:54.018358 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ba154409-41a6-4f75-b1b9-f54a6b533022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:54.029146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1274/2534] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:54.031050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b2319-4e74-4934-9373-922579da2631 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:54.055559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba154409-41a6-4f75-b1b9-f54a6b533022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:54.068960 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba154409-41a6-4f75-b1b9-f54a6b533022 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:54.106102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b2319-4e74-4934-9373-922579da2631 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:54.128158 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1261/2535] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:54.154884 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cf2b2-3e63-45da-842d-15e5db1a1ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:54.160596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cf2b2-3e63-45da-842d-15e5db1a1ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:54.161498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cf2b2-3e63-45da-842d-15e5db1a1ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:54.164246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cf2b2-3e63-45da-842d-15e5db1a1ebb admin admin] PATH_INFO: `/v3/projects/9405225c7a3342409cfefd450e935322/users/f3a96431313545f7a1cac55563af9d08/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:54.236866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cf2b2-3e63-45da-842d-15e5db1a1ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9405225c7a3342409cfefd450e935322, user_id=f3a96431313545f7a1cac55563af9d08, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:54.247434 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cf2b2-3e63-45da-842d-15e5db1a1ebb admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:54.301176 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1275/2536] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:54 2022] PUT /identity/v3/projects/9405225c7a3342409cfefd450e935322/users/f3a96431313545f7a1cac55563af9d08/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:54.320710 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba154409-41a6-4f75-b1b9-f54a6b533022 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:54.361810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba154409-41a6-4f75-b1b9-f54a6b533022 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:54.544472 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003910a-5a20-4176-a344-49cce9b1b704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:54.544472 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003910a-5a20-4176-a344-49cce9b1b704 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:54.544472 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003910a-5a20-4176-a344-49cce9b1b704 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:54.544472 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003910a-5a20-4176-a344-49cce9b1b704 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:54.545302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003910a-5a20-4176-a344-49cce9b1b704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:54.546482 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003910a-5a20-4176-a344-49cce9b1b704 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:54.601858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cf2b2-3e63-45da-842d-15e5db1a1ebb admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:54.602806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1262/2537] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:54.661970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cf2b2-3e63-45da-842d-15e5db1a1ebb admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:54.676256 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031d54f-a1fa-4445-b7e5-75fcfe1a99f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:54.678285 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031d54f-a1fa-4445-b7e5-75fcfe1a99f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:54.678861 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031d54f-a1fa-4445-b7e5-75fcfe1a99f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:54.679347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031d54f-a1fa-4445-b7e5-75fcfe1a99f4 admin admin] PATH_INFO: `/v3/projects/9405225c7a3342409cfefd450e935322/users/f3a96431313545f7a1cac55563af9d08/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:54.683648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031d54f-a1fa-4445-b7e5-75fcfe1a99f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9405225c7a3342409cfefd450e935322, user_id=f3a96431313545f7a1cac55563af9d08, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:54.690694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031d54f-a1fa-4445-b7e5-75fcfe1a99f4 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:54.726475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1276/2538] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:54 2022] PUT /identity/v3/projects/9405225c7a3342409cfefd450e935322/users/f3a96431313545f7a1cac55563af9d08/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:54.748483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbabb0c-e86c-4ae7-8fad-773f8dcfb9ed None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:54.750021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbabb0c-e86c-4ae7-8fad-773f8dcfb9ed None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:54.750810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbabb0c-e86c-4ae7-8fad-773f8dcfb9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:54.839970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-0fbabb0c-e86c-4ae7-8fad-773f8dcfb9ed None None] MFA Rules not processed for user `f3a96431313545f7a1cac55563af9d08`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:54.842214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0fbabb0c-e86c-4ae7-8fad-773f8dcfb9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:55.024657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:55.143136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1263/2539] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:13:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:55.184408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031d54f-a1fa-4445-b7e5-75fcfe1a99f4 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:55.186393 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbabb0c-e86c-4ae7-8fad-773f8dcfb9ed None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:55.188123 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-3031d54f-a1fa-4445-b7e5-75fcfe1a99f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:55.189157 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0fbabb0c-e86c-4ae7-8fad-773f8dcfb9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:55.473911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031d54f-a1fa-4445-b7e5-75fcfe1a99f4 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:55.476127 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2525080-fb94-421c-bc7f-dc703afbc17a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:55.477210 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2525080-fb94-421c-bc7f-dc703afbc17a service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:55.477638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2525080-fb94-421c-bc7f-dc703afbc17a service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:55.478051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2525080-fb94-421c-bc7f-dc703afbc17a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:55.482084 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbabb0c-e86c-4ae7-8fad-773f8dcfb9ed None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:55.529814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2525080-fb94-421c-bc7f-dc703afbc17a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:55.529814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2525080-fb94-421c-bc7f-dc703afbc17a service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:55.530531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8964d-cbe0-4e09-a5b4-9bd8ef734536 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2420def47ee4a5b8cf4373252583d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:55.530531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8964d-cbe0-4e09-a5b4-9bd8ef734536 service placement] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:55.530992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8964d-cbe0-4e09-a5b4-9bd8ef734536 service placement] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:55.531587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8964d-cbe0-4e09-a5b4-9bd8ef734536 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:55.535349 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5ab8964d-cbe0-4e09-a5b4-9bd8ef734536 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:55.558339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1277/2540] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:55.568359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8964d-cbe0-4e09-a5b4-9bd8ef734536 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:55.571707 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8964d-cbe0-4e09-a5b4-9bd8ef734536 service placement] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:55.599699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1264/2541] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:55.801277 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2525080-fb94-421c-bc7f-dc703afbc17a service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:55.838885 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2525080-fb94-421c-bc7f-dc703afbc17a service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:55.856310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7cd95-ae3f-4df9-82f0-70c1d03dc268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:55.857487 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7cd95-ae3f-4df9-82f0-70c1d03dc268 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:55.858055 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7cd95-ae3f-4df9-82f0-70c1d03dc268 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:55.858483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7cd95-ae3f-4df9-82f0-70c1d03dc268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:55.966793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:56.038285 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7cd95-ae3f-4df9-82f0-70c1d03dc268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:56.055753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7cd95-ae3f-4df9-82f0-70c1d03dc268 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:56.094280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1278/2542] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:00.370953 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8964d-cbe0-4e09-a5b4-9bd8ef734536 service placement] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:00.373490 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5ab8964d-cbe0-4e09-a5b4-9bd8ef734536 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:00.707080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8964d-cbe0-4e09-a5b4-9bd8ef734536 service placement] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:00.718054 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393b2f4-ec97-4225-98e1-d50504a6a467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:00.720439 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393b2f4-ec97-4225-98e1-d50504a6a467 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:00.721888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393b2f4-ec97-4225-98e1-d50504a6a467 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:00.721888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393b2f4-ec97-4225-98e1-d50504a6a467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:00.726475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a393b2f4-ec97-4225-98e1-d50504a6a467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:00.755904 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393b2f4-ec97-4225-98e1-d50504a6a467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:00.760043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393b2f4-ec97-4225-98e1-d50504a6a467 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:00.779067 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1265/2543] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:06.076204 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=13 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:07.977031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7cd95-ae3f-4df9-82f0-70c1d03dc268 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:07.984530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-64f7cd95-ae3f-4df9-82f0-70c1d03dc268 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:08.299376 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7cd95-ae3f-4df9-82f0-70c1d03dc268 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:08.351020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a92bb-953e-4303-aae6-763f6d68dcf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:08.351020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a92bb-953e-4303-aae6-763f6d68dcf6 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:08.351020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a92bb-953e-4303-aae6-763f6d68dcf6 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:08.351020 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a92bb-953e-4303-aae6-763f6d68dcf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:08.351700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6c5a92bb-953e-4303-aae6-763f6d68dcf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:08.382835 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a92bb-953e-4303-aae6-763f6d68dcf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:08.386435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a92bb-953e-4303-aae6-763f6d68dcf6 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:08.408576 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1279/2544] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:10.769132 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=63 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:14.080881 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393b2f4-ec97-4225-98e1-d50504a6a467 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:14.082629 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a393b2f4-ec97-4225-98e1-d50504a6a467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:14.105249 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393b2f4-ec97-4225-98e1-d50504a6a467 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:14.116266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e141a2a-053d-4ee8-ae35-4e0890d27740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:14.117323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e141a2a-053d-4ee8-ae35-4e0890d27740 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:14.117770 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e141a2a-053d-4ee8-ae35-4e0890d27740 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:14.118339 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e141a2a-053d-4ee8-ae35-4e0890d27740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:14.121500 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3e141a2a-053d-4ee8-ae35-4e0890d27740 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:14.142074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e141a2a-053d-4ee8-ae35-4e0890d27740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:14.145021 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e141a2a-053d-4ee8-ae35-4e0890d27740 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:14.157801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1266/2545] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:16.791327 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a92bb-953e-4303-aae6-763f6d68dcf6 service nova] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:16.809846 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a92bb-953e-4303-aae6-763f6d68dcf6 service nova] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:16.816538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995394f-7dd3-45a4-b32c-152d9c486223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:16.817916 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995394f-7dd3-45a4-b32c-152d9c486223 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:16.818481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995394f-7dd3-45a4-b32c-152d9c486223 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:16.818861 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995394f-7dd3-45a4-b32c-152d9c486223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:16.822600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1995394f-7dd3-45a4-b32c-152d9c486223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:16.841120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995394f-7dd3-45a4-b32c-152d9c486223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:16.843592 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995394f-7dd3-45a4-b32c-152d9c486223 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:16.860253 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1280/2546] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:17.110226 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb27e1-b8a8-4f46-836d-43614ac55eb2 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:17.110226 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb27e1-b8a8-4f46-836d-43614ac55eb2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:17.110226 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb27e1-b8a8-4f46-836d-43614ac55eb2 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:17.110226 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1267/2547] 10.222.0.30 () {54 vars in 921 bytes} [Wed Sep 7 13:14:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:14:17.119877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94706487-285b-4e06-aad6-541469320012 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:17.120367 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94706487-285b-4e06-aad6-541469320012 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:17.120883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94706487-285b-4e06-aad6-541469320012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:17.139769 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb27e1-b8a8-4f46-836d-43614ac55eb2 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:17.175109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-94706487-285b-4e06-aad6-541469320012 None None] MFA Rules not processed for user `fbe8fa8ab8094aa69933398280810692`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:17.177482 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-94706487-285b-4e06-aad6-541469320012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:17.200480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1281/2548] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Sep 7 13:14:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:17.221311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94706487-285b-4e06-aad6-541469320012 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:17.223659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-94706487-285b-4e06-aad6-541469320012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:17.297218 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb27e1-b8a8-4f46-836d-43614ac55eb2 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:17.303835 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e1c34-784f-496c-a229-d65ce984915c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:17.304900 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e1c34-784f-496c-a229-d65ce984915c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:17.305278 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e1c34-784f-496c-a229-d65ce984915c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:17.305674 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e1c34-784f-496c-a229-d65ce984915c admin admin] PATH_INFO: `/v3/users/03cb69a1f864476bbac90e153194061b` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:17.307392 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e1c34-784f-496c-a229-d65ce984915c admin admin] RBAC: Authorizing `identity:delete_user(user_id=03cb69a1f864476bbac90e153194061b)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:17.309958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e1c34-784f-496c-a229-d65ce984915c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:17.336437 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94706487-285b-4e06-aad6-541469320012 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:17.342676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee7d2a-06c0-45bd-a5e9-5d87880edfcc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f332ac2346f0444a8d336ed2b3121be2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:17.343901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee7d2a-06c0-45bd-a5e9-5d87880edfcc service glance] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:17.344573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee7d2a-06c0-45bd-a5e9-5d87880edfcc service glance] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:17.345067 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee7d2a-06c0-45bd-a5e9-5d87880edfcc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:17.367420 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee7d2a-06c0-45bd-a5e9-5d87880edfcc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:17.370477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee7d2a-06c0-45bd-a5e9-5d87880edfcc service glance] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:17.395751 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1282/2549] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:14:17.432871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-be5e1c34-784f-496c-a229-d65ce984915c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03cb69a1f864476bbac90e153194061b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:17.434004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-be5e1c34-784f-496c-a229-d65ce984915c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03cb69a1f864476bbac90e153194061b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:17.450010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-be5e1c34-784f-496c-a229-d65ce984915c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03cb69a1f864476bbac90e153194061b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:17.452917 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-be5e1c34-784f-496c-a229-d65ce984915c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03cb69a1f864476bbac90e153194061b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:17.468207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-be5e1c34-784f-496c-a229-d65ce984915c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03cb69a1f864476bbac90e153194061b'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:17.509781 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1268/2550] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:14:17 2022] DELETE /identity/v3/users/03cb69a1f864476bbac90e153194061b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:17.515198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556758-3dfe-4d1b-8f42-f2e13b53d669 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:17.515633 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556758-3dfe-4d1b-8f42-f2e13b53d669 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:17.516198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556758-3dfe-4d1b-8f42-f2e13b53d669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:17.525567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58086b09-6677-4ec7-964d-3adf46ca8b09 None None] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:17.526256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58086b09-6677-4ec7-964d-3adf46ca8b09 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:17.526877 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58086b09-6677-4ec7-964d-3adf46ca8b09 None None] PATH_INFO: `/` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:17.529279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1269/2551] 10.222.0.30 () {54 vars in 921 bytes} [Wed Sep 7 13:14:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:14:17.539709 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0c795-bbf2-4161-adbc-9f2c1aac0729 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:17.540704 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0c795-bbf2-4161-adbc-9f2c1aac0729 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:17.541315 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0c795-bbf2-4161-adbc-9f2c1aac0729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:17.552660 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-ab556758-3dfe-4d1b-8f42-f2e13b53d669 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:17.554108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ab556758-3dfe-4d1b-8f42-f2e13b53d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:17.584747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-3da0c795-bbf2-4161-adbc-9f2c1aac0729 None None] MFA Rules not processed for user `eefd1293a22848e3b595e54be0455d10`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:17.587846 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3da0c795-bbf2-4161-adbc-9f2c1aac0729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:17.702307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1270/2552] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Sep 7 13:14:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:17.708514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1283/2553] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:17.724649 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0c795-bbf2-4161-adbc-9f2c1aac0729 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:17.725078 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556758-3dfe-4d1b-8f42-f2e13b53d669 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:17.728481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-ab556758-3dfe-4d1b-8f42-f2e13b53d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:17.728669 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3da0c795-bbf2-4161-adbc-9f2c1aac0729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:17.745859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556758-3dfe-4d1b-8f42-f2e13b53d669 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:17.748672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0c795-bbf2-4161-adbc-9f2c1aac0729 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:17.750513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880376c0-313c-49d3-a2f9-eac7f86220fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:17.751400 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880376c0-313c-49d3-a2f9-eac7f86220fe service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:17.751797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880376c0-313c-49d3-a2f9-eac7f86220fe service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:17.752211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880376c0-313c-49d3-a2f9-eac7f86220fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:17.757470 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c4807-c100-4d20-a2da-f10b4a221222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:17.758431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c4807-c100-4d20-a2da-f10b4a221222 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:17.759025 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c4807-c100-4d20-a2da-f10b4a221222 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:17.759474 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c4807-c100-4d20-a2da-f10b4a221222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:17.763931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:17.769494 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880376c0-313c-49d3-a2f9-eac7f86220fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:17.772624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880376c0-313c-49d3-a2f9-eac7f86220fe service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:17.772876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c4807-c100-4d20-a2da-f10b4a221222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:17.775556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c4807-c100-4d20-a2da-f10b4a221222 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:17.791999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1284/2554] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:17.796296 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1271/2555] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:17.963150 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dce9aa-d8b6-433c-9dd4-809f1ad8a717 None None] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:17.963150 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dce9aa-d8b6-433c-9dd4-809f1ad8a717 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:17.964142 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dce9aa-d8b6-433c-9dd4-809f1ad8a717 None None] PATH_INFO: `/` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:17.967172 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1285/2556] 10.222.0.30 () {54 vars in 921 bytes} [Wed Sep 7 13:14:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:14:17.975347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fe59f-85c0-41a1-8144-6e64ab8e4d6d None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:17.975723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fe59f-85c0-41a1-8144-6e64ab8e4d6d None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:17.976238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fe59f-85c0-41a1-8144-6e64ab8e4d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:17.987005 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:18.014188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-f52fe59f-85c0-41a1-8144-6e64ab8e4d6d None None] MFA Rules not processed for user `fbe8fa8ab8094aa69933398280810692`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:18.016553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f52fe59f-85c0-41a1-8144-6e64ab8e4d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:18.188713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1272/2557] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Sep 7 13:14:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:14:18.205170 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dce9aa-d8b6-433c-9dd4-809f1ad8a717 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:18.227228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dce9aa-d8b6-433c-9dd4-809f1ad8a717 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:18.232147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d135a3c-9768-4fe9-a572-bf6ab3cf52de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:18.233226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d135a3c-9768-4fe9-a572-bf6ab3cf52de service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:18.233722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d135a3c-9768-4fe9-a572-bf6ab3cf52de service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:18.234234 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d135a3c-9768-4fe9-a572-bf6ab3cf52de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:18.250552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d135a3c-9768-4fe9-a572-bf6ab3cf52de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:18.253150 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d135a3c-9768-4fe9-a572-bf6ab3cf52de service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:18.271023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1286/2558] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:18.373965 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fe59f-85c0-41a1-8144-6e64ab8e4d6d None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:18.376281 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f52fe59f-85c0-41a1-8144-6e64ab8e4d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:18.410910 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fe59f-85c0-41a1-8144-6e64ab8e4d6d None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:18.435880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:18.437020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:18.437833 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:18.438017 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac admin admin] PATH_INFO: `/v3/projects/5de2eadb1d394f628918552cb8636731` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:18.440832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de2eadb1d394f628918552cb8636731)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:18.444639 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:18.567609 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de2eadb1d394f628918552cb8636731', 'request_id': 'req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:18.583964 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de2eadb1d394f628918552cb8636731', 'request_id': 'req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:18.598112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de2eadb1d394f628918552cb8636731', 'request_id': 'req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:18.640666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac admin admin] The token cache is being invalidate because project 5de2eadb1d394f628918552cb8636731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:14:18.641967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:18.643889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:18.647185 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1273/2559] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:14:18 2022] DELETE /identity/v3/projects/5de2eadb1d394f628918552cb8636731 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:18.653882 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d135a3c-9768-4fe9-a572-bf6ab3cf52de service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:18.672424 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d135a3c-9768-4fe9-a572-bf6ab3cf52de service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:18.821215 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38eaa9-c73a-4c94-b5ab-2e4d08fee6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:18.822308 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38eaa9-c73a-4c94-b5ab-2e4d08fee6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:18.822504 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38eaa9-c73a-4c94-b5ab-2e4d08fee6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:18.823588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38eaa9-c73a-4c94-b5ab-2e4d08fee6d1 admin admin] PATH_INFO: `/v3/users/f3a96431313545f7a1cac55563af9d08` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:18.825441 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38eaa9-c73a-4c94-b5ab-2e4d08fee6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a96431313545f7a1cac55563af9d08)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:18.827962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38eaa9-c73a-4c94-b5ab-2e4d08fee6d1 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:18.923867 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-3d38eaa9-c73a-4c94-b5ab-2e4d08fee6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a96431313545f7a1cac55563af9d08'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:18.925789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-3d38eaa9-c73a-4c94-b5ab-2e4d08fee6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a96431313545f7a1cac55563af9d08'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:18.940535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-3d38eaa9-c73a-4c94-b5ab-2e4d08fee6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a96431313545f7a1cac55563af9d08'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:18.961459 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-3d38eaa9-c73a-4c94-b5ab-2e4d08fee6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a96431313545f7a1cac55563af9d08'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:18.973966 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-3d38eaa9-c73a-4c94-b5ab-2e4d08fee6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a96431313545f7a1cac55563af9d08'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:18.984186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1287/2560] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:14:18 2022] DELETE /identity/v3/users/f3a96431313545f7a1cac55563af9d08 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:19.802275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:19.805144 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:19.845403 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba3565-2328-4c8d-a84e-2c7acb33dfac admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:20.008016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06f5e6-30a1-40b9-9b02-401d714c980e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:20.009459 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06f5e6-30a1-40b9-9b02-401d714c980e admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:20.009937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06f5e6-30a1-40b9-9b02-401d714c980e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:20.010427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06f5e6-30a1-40b9-9b02-401d714c980e admin admin] PATH_INFO: `/v3/projects/9405225c7a3342409cfefd450e935322` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:20.012983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06f5e6-30a1-40b9-9b02-401d714c980e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9405225c7a3342409cfefd450e935322)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:20.017023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06f5e6-30a1-40b9-9b02-401d714c980e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:20.059528 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:20.113299 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-9c06f5e6-30a1-40b9-9b02-401d714c980e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9405225c7a3342409cfefd450e935322', 'request_id': 'req-9c06f5e6-30a1-40b9-9b02-401d714c980e'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:20.132460 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-9c06f5e6-30a1-40b9-9b02-401d714c980e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9405225c7a3342409cfefd450e935322', 'request_id': 'req-9c06f5e6-30a1-40b9-9b02-401d714c980e'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:20.144991 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-9c06f5e6-30a1-40b9-9b02-401d714c980e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9405225c7a3342409cfefd450e935322', 'request_id': 'req-9c06f5e6-30a1-40b9-9b02-401d714c980e'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:20.165278 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-9c06f5e6-30a1-40b9-9b02-401d714c980e admin admin] The token cache is being invalidate because project 9405225c7a3342409cfefd450e935322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:14:20.165885 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-9c06f5e6-30a1-40b9-9b02-401d714c980e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:20.166778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-9c06f5e6-30a1-40b9-9b02-401d714c980e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:20.168628 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1274/2561] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:14:19 2022] DELETE /identity/v3/projects/9405225c7a3342409cfefd450e935322 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:20.178541 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f77f8c-c7b4-49bc-8753-50806170332b None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:20.179153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f77f8c-c7b4-49bc-8753-50806170332b None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:20.179916 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f77f8c-c7b4-49bc-8753-50806170332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:20.217476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-b5f77f8c-c7b4-49bc-8753-50806170332b None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:20.219923 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b5f77f8c-c7b4-49bc-8753-50806170332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:20.324417 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1288/2562] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:20.336521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904a3f5-5abd-43c4-a234-0d8df132d4e0 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:20.337004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904a3f5-5abd-43c4-a234-0d8df132d4e0 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:20.337520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904a3f5-5abd-43c4-a234-0d8df132d4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:20.370932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-9904a3f5-5abd-43c4-a234-0d8df132d4e0 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:20.372994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-9904a3f5-5abd-43c4-a234-0d8df132d4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:20.384560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1275/2563] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:20.390413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f77f8c-c7b4-49bc-8753-50806170332b None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:20.398410 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:20.411061 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f77f8c-c7b4-49bc-8753-50806170332b None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:20.420751 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716a2fe-a7d5-4e28-aeb9-2c928ed3262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:20.421918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716a2fe-a7d5-4e28-aeb9-2c928ed3262a admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:20.422402 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716a2fe-a7d5-4e28-aeb9-2c928ed3262a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:20.422973 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716a2fe-a7d5-4e28-aeb9-2c928ed3262a admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:20.424186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716a2fe-a7d5-4e28-aeb9-2c928ed3262a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:14:20.424768 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716a2fe-a7d5-4e28-aeb9-2c928ed3262a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:20.427889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716a2fe-a7d5-4e28-aeb9-2c928ed3262a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:20.449533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1289/2564] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:14:20.454274 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904a3f5-5abd-43c4-a234-0d8df132d4e0 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:20.466945 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904a3f5-5abd-43c4-a234-0d8df132d4e0 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:20.474686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5b1e7-672f-4d01-acb0-35146c9a7981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:20.475730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5b1e7-672f-4d01-acb0-35146c9a7981 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:20.476205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5b1e7-672f-4d01-acb0-35146c9a7981 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:20.476712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5b1e7-672f-4d01-acb0-35146c9a7981 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:20.477870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5b1e7-672f-4d01-acb0-35146c9a7981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:20.481616 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5b1e7-672f-4d01-acb0-35146c9a7981 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:20.536296 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1276/2565] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:14:20 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:14:20.538312 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716a2fe-a7d5-4e28-aeb9-2c928ed3262a admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:20.565890 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716a2fe-a7d5-4e28-aeb9-2c928ed3262a admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:20.669695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff71eec-a5d4-4a97-9268-66b54f5076a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:20.671087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff71eec-a5d4-4a97-9268-66b54f5076a6 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:20.671370 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff71eec-a5d4-4a97-9268-66b54f5076a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:20.671653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff71eec-a5d4-4a97-9268-66b54f5076a6 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:20.672306 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff71eec-a5d4-4a97-9268-66b54f5076a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:20.675519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff71eec-a5d4-4a97-9268-66b54f5076a6 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:20.710151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1290/2566] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:14:20 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:14:20.711477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5b1e7-672f-4d01-acb0-35146c9a7981 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:20.723955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5b1e7-672f-4d01-acb0-35146c9a7981 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:20.729860 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48967ee-fb7c-447c-a43a-35e5a11c6277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:20.730504 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48967ee-fb7c-447c-a43a-35e5a11c6277 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:20.730785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48967ee-fb7c-447c-a43a-35e5a11c6277 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:20.731519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48967ee-fb7c-447c-a43a-35e5a11c6277 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:20.731703 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48967ee-fb7c-447c-a43a-35e5a11c6277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:20.733328 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48967ee-fb7c-447c-a43a-35e5a11c6277 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:20.750719 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1277/2567] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:20.752119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff71eec-a5d4-4a97-9268-66b54f5076a6 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:20.769653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff71eec-a5d4-4a97-9268-66b54f5076a6 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:20.777593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed6ea5-4346-411e-91c5-8e0445533280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:20.778652 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed6ea5-4346-411e-91c5-8e0445533280 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:20.779130 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed6ea5-4346-411e-91c5-8e0445533280 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:20.779449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed6ea5-4346-411e-91c5-8e0445533280 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:20.780593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed6ea5-4346-411e-91c5-8e0445533280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:20.782045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed6ea5-4346-411e-91c5-8e0445533280 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:20.796176 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1291/2568] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:20.800913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48967ee-fb7c-447c-a43a-35e5a11c6277 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:20.812515 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48967ee-fb7c-447c-a43a-35e5a11c6277 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:20.823515 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b10c38-30a2-49d6-8e11-31a425a01834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:20.824845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b10c38-30a2-49d6-8e11-31a425a01834 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:20.825405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b10c38-30a2-49d6-8e11-31a425a01834 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:20.825962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b10c38-30a2-49d6-8e11-31a425a01834 admin admin] PATH_INFO: `/v3/projects/aabb618d9452435e9b04161a73b3a8d9/users/b66cace887cb47488cf7c73b56a80552/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:20.858653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b10c38-30a2-49d6-8e11-31a425a01834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aabb618d9452435e9b04161a73b3a8d9, user_id=b66cace887cb47488cf7c73b56a80552, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:20.861633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b10c38-30a2-49d6-8e11-31a425a01834 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:20.876863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1278/2569] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:14:20 2022] PUT /identity/v3/projects/aabb618d9452435e9b04161a73b3a8d9/users/b66cace887cb47488cf7c73b56a80552/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:14:20.888554 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3893760-20a2-4b1d-9878-122b3a96c5d6 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:20.889029 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3893760-20a2-4b1d-9878-122b3a96c5d6 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:20.889779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3893760-20a2-4b1d-9878-122b3a96c5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:20.932073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-b3893760-20a2-4b1d-9878-122b3a96c5d6 None None] MFA Rules not processed for user `b66cace887cb47488cf7c73b56a80552`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:20.936712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b3893760-20a2-4b1d-9878-122b3a96c5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:21.022467 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24b193-a0ac-4016-88e9-11cd43002c78 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:21.022868 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24b193-a0ac-4016-88e9-11cd43002c78 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:21.023243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24b193-a0ac-4016-88e9-11cd43002c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:21.050254 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-4d24b193-a0ac-4016-88e9-11cd43002c78 None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:21.051177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1292/2570] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:21.055201 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4d24b193-a0ac-4016-88e9-11cd43002c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:21.056352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3893760-20a2-4b1d-9878-122b3a96c5d6 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:21.142824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:21.143452 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1279/2571] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Sep 7 13:14:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:14:21.148644 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3893760-20a2-4b1d-9878-122b3a96c5d6 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:21.157898 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4516a7e-5ede-48b1-97b5-de2c4f22a379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:21.158588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4516a7e-5ede-48b1-97b5-de2c4f22a379 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:21.158954 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4516a7e-5ede-48b1-97b5-de2c4f22a379 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:21.159313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4516a7e-5ede-48b1-97b5-de2c4f22a379 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:21.160566 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4516a7e-5ede-48b1-97b5-de2c4f22a379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:21.163736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24b193-a0ac-4016-88e9-11cd43002c78 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:21.164661 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4516a7e-5ede-48b1-97b5-de2c4f22a379 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:21.165753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4d24b193-a0ac-4016-88e9-11cd43002c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:21.203714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1293/2572] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:14:21 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:14:21.208655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4516a7e-5ede-48b1-97b5-de2c4f22a379 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:21.237921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:21.280307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24b193-a0ac-4016-88e9-11cd43002c78 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:21.328084 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4516a7e-5ede-48b1-97b5-de2c4f22a379 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:21.339107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895aa2e-ecab-417b-beaf-57fb2bbb7c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:21.340632 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895aa2e-ecab-417b-beaf-57fb2bbb7c46 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:21.341539 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895aa2e-ecab-417b-beaf-57fb2bbb7c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:21.342607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895aa2e-ecab-417b-beaf-57fb2bbb7c46 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:21.344163 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895aa2e-ecab-417b-beaf-57fb2bbb7c46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:21.348978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895aa2e-ecab-417b-beaf-57fb2bbb7c46 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:21.396000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1294/2573] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:14:21 2022] POST /identity/v3/users => generated 301 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:14:21.403329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895aa2e-ecab-417b-beaf-57fb2bbb7c46 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:21.416337 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72b94f-5aa6-404a-9083-d326b886b0ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:21.417982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72b94f-5aa6-404a-9083-d326b886b0ac service swift] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:21.418480 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72b94f-5aa6-404a-9083-d326b886b0ac service swift] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:21.419009 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72b94f-5aa6-404a-9083-d326b886b0ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:21.419789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895aa2e-ecab-417b-beaf-57fb2bbb7c46 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:21.429387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541a611-6d18-4f5b-8421-cfde824425af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:21.430406 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541a611-6d18-4f5b-8421-cfde824425af admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:21.431129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541a611-6d18-4f5b-8421-cfde824425af admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:21.431979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541a611-6d18-4f5b-8421-cfde824425af admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:21.432781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541a611-6d18-4f5b-8421-cfde824425af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:21.435894 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541a611-6d18-4f5b-8421-cfde824425af admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:21.459144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1295/2574] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:21.470118 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541a611-6d18-4f5b-8421-cfde824425af admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:21.491612 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541a611-6d18-4f5b-8421-cfde824425af admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:21.505998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2753eeb-9f78-457b-9423-f586f6a256b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:21.508714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2753eeb-9f78-457b-9423-f586f6a256b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:21.509469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2753eeb-9f78-457b-9423-f586f6a256b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:21.510192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2753eeb-9f78-457b-9423-f586f6a256b1 admin admin] PATH_INFO: `/v3/projects/d88c9bd222f64172bccccec85675a26f/users/8ffb7e1606664239a5abd73b89594397/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:21.545572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72b94f-5aa6-404a-9083-d326b886b0ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:21.545572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72b94f-5aa6-404a-9083-d326b886b0ac service swift] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:21.560165 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2753eeb-9f78-457b-9423-f586f6a256b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d88c9bd222f64172bccccec85675a26f, user_id=8ffb7e1606664239a5abd73b89594397, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:21.561244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1280/2575] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:14:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 13:14:21.564442 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2753eeb-9f78-457b-9423-f586f6a256b1 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:21.589689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1296/2576] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:14:21 2022] PUT /identity/v3/projects/d88c9bd222f64172bccccec85675a26f/users/8ffb7e1606664239a5abd73b89594397/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:21.595689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72b94f-5aa6-404a-9083-d326b886b0ac service swift] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:21.615544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72b94f-5aa6-404a-9083-d326b886b0ac service swift] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:21.819307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a1d2d-bddb-4710-a3cc-85c42da2885e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:21.820351 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a1d2d-bddb-4710-a3cc-85c42da2885e admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:21.825695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a1d2d-bddb-4710-a3cc-85c42da2885e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:21.825695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a1d2d-bddb-4710-a3cc-85c42da2885e admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:21.825695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a1d2d-bddb-4710-a3cc-85c42da2885e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:21.825695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a1d2d-bddb-4710-a3cc-85c42da2885e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:21.856459 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1281/2577] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:21.859207 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2753eeb-9f78-457b-9423-f586f6a256b1 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:21.877024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2753eeb-9f78-457b-9423-f586f6a256b1 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:21.885911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23a3ca-cf9e-43df-9f7e-4f6157c1858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:21.887077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23a3ca-cf9e-43df-9f7e-4f6157c1858e admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:21.887577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23a3ca-cf9e-43df-9f7e-4f6157c1858e admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:21.887949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23a3ca-cf9e-43df-9f7e-4f6157c1858e admin admin] PATH_INFO: `/v3/projects/d88c9bd222f64172bccccec85675a26f/users/8ffb7e1606664239a5abd73b89594397/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:21.891287 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23a3ca-cf9e-43df-9f7e-4f6157c1858e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d88c9bd222f64172bccccec85675a26f, user_id=8ffb7e1606664239a5abd73b89594397, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:21.896263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23a3ca-cf9e-43df-9f7e-4f6157c1858e admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:21.917233 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1297/2578] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:14:21 2022] PUT /identity/v3/projects/d88c9bd222f64172bccccec85675a26f/users/8ffb7e1606664239a5abd73b89594397/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:21.935525 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06ea1b-cf55-452c-9bf9-afd65237e47c None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:21.935852 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06ea1b-cf55-452c-9bf9-afd65237e47c None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:21.936120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06ea1b-cf55-452c-9bf9-afd65237e47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:21.991006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-0a06ea1b-cf55-452c-9bf9-afd65237e47c None None] MFA Rules not processed for user `8ffb7e1606664239a5abd73b89594397`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:21.992975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0a06ea1b-cf55-452c-9bf9-afd65237e47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:22.020946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:22.141308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1282/2579] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:21 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:14:22.155914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23a3ca-cf9e-43df-9f7e-4f6157c1858e admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:22.158924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7d23a3ca-cf9e-43df-9f7e-4f6157c1858e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:22.288138 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23a3ca-cf9e-43df-9f7e-4f6157c1858e admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:22.297831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1e2df-d7cc-49b7-9e1f-3278c0a4436a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:22.299136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1e2df-d7cc-49b7-9e1f-3278c0a4436a service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:22.299859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1e2df-d7cc-49b7-9e1f-3278c0a4436a service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:22.300886 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1e2df-d7cc-49b7-9e1f-3278c0a4436a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:22.318124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1e2df-d7cc-49b7-9e1f-3278c0a4436a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:22.319640 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1e2df-d7cc-49b7-9e1f-3278c0a4436a service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:22.353958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1298/2580] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:22 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:22.578252 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06ea1b-cf55-452c-9bf9-afd65237e47c None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:22.715593 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06ea1b-cf55-452c-9bf9-afd65237e47c None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:22.721543 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3ff21-d969-43b6-824a-139363653a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:22.722242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3ff21-d969-43b6-824a-139363653a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:22.722523 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3ff21-d969-43b6-824a-139363653a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:22.722794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3ff21-d969-43b6-824a-139363653a18 admin admin] PATH_INFO: `/v3/users/b66cace887cb47488cf7c73b56a80552` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:22.724052 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3ff21-d969-43b6-824a-139363653a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66cace887cb47488cf7c73b56a80552)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:22.726154 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3ff21-d969-43b6-824a-139363653a18 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:22.880689 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-73c3ff21-d969-43b6-824a-139363653a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66cace887cb47488cf7c73b56a80552'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:22.882053 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-73c3ff21-d969-43b6-824a-139363653a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66cace887cb47488cf7c73b56a80552'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:22.907653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-73c3ff21-d969-43b6-824a-139363653a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66cace887cb47488cf7c73b56a80552'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:22.909601 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-73c3ff21-d969-43b6-824a-139363653a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66cace887cb47488cf7c73b56a80552'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:22.928547 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-73c3ff21-d969-43b6-824a-139363653a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66cace887cb47488cf7c73b56a80552'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:22.973287 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1283/2581] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:14:22 2022] DELETE /identity/v3/users/b66cace887cb47488cf7c73b56a80552 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:22.980144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6368c24-69f3-4e5a-95b6-74d54e121949 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:22.980584 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6368c24-69f3-4e5a-95b6-74d54e121949 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:22.981009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6368c24-69f3-4e5a-95b6-74d54e121949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:23.010866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-f6368c24-69f3-4e5a-95b6-74d54e121949 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:23.013000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f6368c24-69f3-4e5a-95b6-74d54e121949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:23.049131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:23.153984 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1299/2582] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:23.175033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3ff21-d969-43b6-824a-139363653a18 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:23.177680 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-73c3ff21-d969-43b6-824a-139363653a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:23.301526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:23.365507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3ff21-d969-43b6-824a-139363653a18 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:23.371421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300c660-d362-4183-a098-8a0d6a34de97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:23.372762 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300c660-d362-4183-a098-8a0d6a34de97 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:23.372884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300c660-d362-4183-a098-8a0d6a34de97 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:23.373259 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300c660-d362-4183-a098-8a0d6a34de97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:23.394650 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300c660-d362-4183-a098-8a0d6a34de97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:23.396119 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300c660-d362-4183-a098-8a0d6a34de97 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:23.409937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1284/2583] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:23.962901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6368c24-69f3-4e5a-95b6-74d54e121949 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:23.965017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f6368c24-69f3-4e5a-95b6-74d54e121949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:23.999324 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6368c24-69f3-4e5a-95b6-74d54e121949 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:24.035765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a1d0a-d25c-497c-9222-736d0ade74d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:24.038083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a1d0a-d25c-497c-9222-736d0ade74d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:24.038738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a1d0a-d25c-497c-9222-736d0ade74d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:24.045024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a1d0a-d25c-497c-9222-736d0ade74d2 admin admin] PATH_INFO: `/v3/projects/aabb618d9452435e9b04161a73b3a8d9` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:24.055358 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a1d0a-d25c-497c-9222-736d0ade74d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aabb618d9452435e9b04161a73b3a8d9)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:24.055358 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a1d0a-d25c-497c-9222-736d0ade74d2 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:24.239047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b41a1d0a-d25c-497c-9222-736d0ade74d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aabb618d9452435e9b04161a73b3a8d9', 'request_id': 'req-b41a1d0a-d25c-497c-9222-736d0ade74d2'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:24.274838 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b41a1d0a-d25c-497c-9222-736d0ade74d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aabb618d9452435e9b04161a73b3a8d9', 'request_id': 'req-b41a1d0a-d25c-497c-9222-736d0ade74d2'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:24.314452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b41a1d0a-d25c-497c-9222-736d0ade74d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aabb618d9452435e9b04161a73b3a8d9', 'request_id': 'req-b41a1d0a-d25c-497c-9222-736d0ade74d2'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:24.374497 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b41a1d0a-d25c-497c-9222-736d0ade74d2 admin admin] The token cache is being invalidate because project aabb618d9452435e9b04161a73b3a8d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:14:24.375017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b41a1d0a-d25c-497c-9222-736d0ade74d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:24.376265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b41a1d0a-d25c-497c-9222-736d0ade74d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:24.380524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1300/2584] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:14:23 2022] DELETE /identity/v3/projects/aabb618d9452435e9b04161a73b3a8d9 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:24.386773 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300c660-d362-4183-a098-8a0d6a34de97 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:24.403128 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300c660-d362-4183-a098-8a0d6a34de97 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:24.570022 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6182b-c4eb-4870-bf41-542781366c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:24.571251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6182b-c4eb-4870-bf41-542781366c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:24.572693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6182b-c4eb-4870-bf41-542781366c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:24.572693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6182b-c4eb-4870-bf41-542781366c85 admin admin] PATH_INFO: `/v3/users/8ffb7e1606664239a5abd73b89594397` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:24.574635 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6182b-c4eb-4870-bf41-542781366c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ffb7e1606664239a5abd73b89594397)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:24.579868 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6182b-c4eb-4870-bf41-542781366c85 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:24.696119 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-74e6182b-c4eb-4870-bf41-542781366c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ffb7e1606664239a5abd73b89594397'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:24.697212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-74e6182b-c4eb-4870-bf41-542781366c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ffb7e1606664239a5abd73b89594397'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:24.713217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-74e6182b-c4eb-4870-bf41-542781366c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ffb7e1606664239a5abd73b89594397'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:24.715391 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-74e6182b-c4eb-4870-bf41-542781366c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ffb7e1606664239a5abd73b89594397'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:24.733713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-74e6182b-c4eb-4870-bf41-542781366c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ffb7e1606664239a5abd73b89594397'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:24.763779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1285/2585] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:14:24 2022] DELETE /identity/v3/users/8ffb7e1606664239a5abd73b89594397 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:25.315849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a1d0a-d25c-497c-9222-736d0ade74d2 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:25.315849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b41a1d0a-d25c-497c-9222-736d0ade74d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:25.341027 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a1d0a-d25c-497c-9222-736d0ade74d2 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:25.474272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622d4ea-4606-464e-a392-f51f43479976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:25.475263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622d4ea-4606-464e-a392-f51f43479976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:25.475545 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622d4ea-4606-464e-a392-f51f43479976 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:25.475892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622d4ea-4606-464e-a392-f51f43479976 admin admin] PATH_INFO: `/v3/projects/d88c9bd222f64172bccccec85675a26f` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:25.477329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622d4ea-4606-464e-a392-f51f43479976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d88c9bd222f64172bccccec85675a26f)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:25.480252 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622d4ea-4606-464e-a392-f51f43479976 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:25.645607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c622d4ea-4606-464e-a392-f51f43479976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd88c9bd222f64172bccccec85675a26f', 'request_id': 'req-c622d4ea-4606-464e-a392-f51f43479976'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:25.659353 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:25.684087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c622d4ea-4606-464e-a392-f51f43479976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd88c9bd222f64172bccccec85675a26f', 'request_id': 'req-c622d4ea-4606-464e-a392-f51f43479976'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:25.703112 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c622d4ea-4606-464e-a392-f51f43479976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd88c9bd222f64172bccccec85675a26f', 'request_id': 'req-c622d4ea-4606-464e-a392-f51f43479976'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:25.735192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c622d4ea-4606-464e-a392-f51f43479976 admin admin] The token cache is being invalidate because project d88c9bd222f64172bccccec85675a26f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:14:25.736223 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c622d4ea-4606-464e-a392-f51f43479976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:25.738010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c622d4ea-4606-464e-a392-f51f43479976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:25.740449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1301/2586] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:14:25 2022] DELETE /identity/v3/projects/d88c9bd222f64172bccccec85675a26f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:25.751087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446f88d-3029-4fb5-beac-f1adbdd83ee3 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:25.752001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446f88d-3029-4fb5-beac-f1adbdd83ee3 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:25.752203 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446f88d-3029-4fb5-beac-f1adbdd83ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:25.799105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-9446f88d-3029-4fb5-beac-f1adbdd83ee3 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:25.800819 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-9446f88d-3029-4fb5-beac-f1adbdd83ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:25.907319 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:25.940105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1286/2587] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:25.956971 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72138cac-834c-4949-bb8c-efd76e603d27 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:25.957477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72138cac-834c-4949-bb8c-efd76e603d27 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:25.957955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72138cac-834c-4949-bb8c-efd76e603d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:26.021414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-72138cac-834c-4949-bb8c-efd76e603d27 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:26.022946 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-72138cac-834c-4949-bb8c-efd76e603d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:26.038008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1302/2588] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:26.044438 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446f88d-3029-4fb5-beac-f1adbdd83ee3 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:26.062464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446f88d-3029-4fb5-beac-f1adbdd83ee3 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:26.069311 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd2392-2826-4b69-b5e5-2852c3a88195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:26.070071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd2392-2826-4b69-b5e5-2852c3a88195 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:26.070454 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd2392-2826-4b69-b5e5-2852c3a88195 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:26.070826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd2392-2826-4b69-b5e5-2852c3a88195 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:26.071592 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd2392-2826-4b69-b5e5-2852c3a88195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:14:26.072010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd2392-2826-4b69-b5e5-2852c3a88195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:26.074244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd2392-2826-4b69-b5e5-2852c3a88195 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:26.098402 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1287/2589] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:14:26.107410 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72138cac-834c-4949-bb8c-efd76e603d27 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:26.131030 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72138cac-834c-4949-bb8c-efd76e603d27 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:26.153811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4867f57-75be-4c86-8799-cfe2dc5c38da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:26.155114 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4867f57-75be-4c86-8799-cfe2dc5c38da admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:26.155714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4867f57-75be-4c86-8799-cfe2dc5c38da admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:26.156139 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4867f57-75be-4c86-8799-cfe2dc5c38da admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:26.157443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4867f57-75be-4c86-8799-cfe2dc5c38da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:26.172629 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4867f57-75be-4c86-8799-cfe2dc5c38da admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:26.240448 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1303/2590] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:14:26 2022] POST /identity/v3/projects => generated 409 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:14:26.250045 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd2392-2826-4b69-b5e5-2852c3a88195 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:26.277899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd2392-2826-4b69-b5e5-2852c3a88195 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:26.403627 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d265107-ce16-4dfb-87d9-4778ef1eb2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:26.404534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d265107-ce16-4dfb-87d9-4778ef1eb2fe admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:26.404810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d265107-ce16-4dfb-87d9-4778ef1eb2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:26.405246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d265107-ce16-4dfb-87d9-4778ef1eb2fe admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:26.405915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d265107-ce16-4dfb-87d9-4778ef1eb2fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:26.409266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d265107-ce16-4dfb-87d9-4778ef1eb2fe admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:26.440081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1288/2591] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:14:26 2022] POST /identity/v3/users => generated 305 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:14:26.443738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4867f57-75be-4c86-8799-cfe2dc5c38da admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:26.462137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4867f57-75be-4c86-8799-cfe2dc5c38da admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:26.474999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d139f3a-c2f9-4cd4-8948-cb243abacc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:26.474999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d139f3a-c2f9-4cd4-8948-cb243abacc6a admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:26.474999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d139f3a-c2f9-4cd4-8948-cb243abacc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:26.474999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d139f3a-c2f9-4cd4-8948-cb243abacc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:26.475718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d139f3a-c2f9-4cd4-8948-cb243abacc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:26.475718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d139f3a-c2f9-4cd4-8948-cb243abacc6a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:26.493830 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1304/2592] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:14:26.503122 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d265107-ce16-4dfb-87d9-4778ef1eb2fe admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:26.524662 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d265107-ce16-4dfb-87d9-4778ef1eb2fe admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:26.532983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b08b5-abfa-4191-ac7e-19e04196e111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:26.533825 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b08b5-abfa-4191-ac7e-19e04196e111 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:26.534205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b08b5-abfa-4191-ac7e-19e04196e111 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:26.534483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b08b5-abfa-4191-ac7e-19e04196e111 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:26.536059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b08b5-abfa-4191-ac7e-19e04196e111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:26.537977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b08b5-abfa-4191-ac7e-19e04196e111 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:26.562981 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1289/2593] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:26.565797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d139f3a-c2f9-4cd4-8948-cb243abacc6a admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:26.584996 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d139f3a-c2f9-4cd4-8948-cb243abacc6a admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:26.594793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6e207-2661-4b3f-ba3e-394efd2315f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:26.596034 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e207-2661-4b3f-ba3e-394efd2315f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:26.596613 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e207-2661-4b3f-ba3e-394efd2315f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:26.596901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e207-2661-4b3f-ba3e-394efd2315f6 admin admin] PATH_INFO: `/v3/projects/74ee09c2f59b4cc6b55208a8dfb71b3f/users/973f9f70b97347b09e18c795df6482db/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:26.624507 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6e207-2661-4b3f-ba3e-394efd2315f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ee09c2f59b4cc6b55208a8dfb71b3f, user_id=973f9f70b97347b09e18c795df6482db, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:26.628451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6e207-2661-4b3f-ba3e-394efd2315f6 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:26.653817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1305/2594] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:14:26 2022] PUT /identity/v3/projects/74ee09c2f59b4cc6b55208a8dfb71b3f/users/973f9f70b97347b09e18c795df6482db/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:26.672517 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed800f6f-24fd-4c2b-a9de-531c9bbd6f5f None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:26.675864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed800f6f-24fd-4c2b-a9de-531c9bbd6f5f None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:26.675864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed800f6f-24fd-4c2b-a9de-531c9bbd6f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:26.732419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ed800f6f-24fd-4c2b-a9de-531c9bbd6f5f None None] MFA Rules not processed for user `973f9f70b97347b09e18c795df6482db`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:26.734946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ed800f6f-24fd-4c2b-a9de-531c9bbd6f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:26.900738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1290/2595] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:26 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:26.906188 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6e207-2661-4b3f-ba3e-394efd2315f6 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:27.160017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6e207-2661-4b3f-ba3e-394efd2315f6 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:27.174170 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b1519-0304-4ae6-a661-6152345255ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:27.174910 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b1519-0304-4ae6-a661-6152345255ad admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:27.175376 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b1519-0304-4ae6-a661-6152345255ad admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:27.176017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b1519-0304-4ae6-a661-6152345255ad admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:27.177202 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b1519-0304-4ae6-a661-6152345255ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:27.181492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b1519-0304-4ae6-a661-6152345255ad admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:27.230978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1306/2596] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:14:26 2022] POST /identity/v3/projects => generated 409 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:14:27.238143 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed800f6f-24fd-4c2b-a9de-531c9bbd6f5f None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:27.266587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed800f6f-24fd-4c2b-a9de-531c9bbd6f5f None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:27.409458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:27.442921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9877fe-f2cf-41c6-a66d-ec6164720d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:27.442921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9877fe-f2cf-41c6-a66d-ec6164720d6f admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:27.442921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9877fe-f2cf-41c6-a66d-ec6164720d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:27.442921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9877fe-f2cf-41c6-a66d-ec6164720d6f admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:27.443417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9877fe-f2cf-41c6-a66d-ec6164720d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:27.447622 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9877fe-f2cf-41c6-a66d-ec6164720d6f admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:27.485628 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1291/2597] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:14:27 2022] POST /identity/v3/users => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:14:27.492048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b1519-0304-4ae6-a661-6152345255ad admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:27.513167 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b1519-0304-4ae6-a661-6152345255ad admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:27.533108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee9aa2-1da4-43fb-990b-892f190915f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:27.534703 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee9aa2-1da4-43fb-990b-892f190915f9 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:27.535283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee9aa2-1da4-43fb-990b-892f190915f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:27.535777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee9aa2-1da4-43fb-990b-892f190915f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:27.537412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee9aa2-1da4-43fb-990b-892f190915f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:27.540801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee9aa2-1da4-43fb-990b-892f190915f9 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:27.566550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1307/2598] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:14:27.574123 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9877fe-f2cf-41c6-a66d-ec6164720d6f admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:27.599320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9877fe-f2cf-41c6-a66d-ec6164720d6f admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:27.611494 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2f4ad-b810-458c-81ff-4de1848aefef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:27.620812 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2f4ad-b810-458c-81ff-4de1848aefef admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:27.621653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2f4ad-b810-458c-81ff-4de1848aefef admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:27.621962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2f4ad-b810-458c-81ff-4de1848aefef admin admin] PATH_INFO: `/v3/projects/04a4c8d1fe2d48e296b18139e8a8140b/users/8e488cf3c05449eaa7640416892c3527/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:27.652939 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2f4ad-b810-458c-81ff-4de1848aefef admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a4c8d1fe2d48e296b18139e8a8140b, user_id=8e488cf3c05449eaa7640416892c3527, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:27.657001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2f4ad-b810-458c-81ff-4de1848aefef admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:27.688207 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1292/2599] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:14:27 2022] PUT /identity/v3/projects/04a4c8d1fe2d48e296b18139e8a8140b/users/8e488cf3c05449eaa7640416892c3527/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:27.694764 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee9aa2-1da4-43fb-990b-892f190915f9 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:27.713092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee9aa2-1da4-43fb-990b-892f190915f9 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:27.849412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:27.873345 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c60f2-a883-4477-acdc-fd5a4e3a91f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:27.874409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c60f2-a883-4477-acdc-fd5a4e3a91f4 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:27.874856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c60f2-a883-4477-acdc-fd5a4e3a91f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:27.875326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c60f2-a883-4477-acdc-fd5a4e3a91f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:27.877011 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c60f2-a883-4477-acdc-fd5a4e3a91f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:27.880285 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c60f2-a883-4477-acdc-fd5a4e3a91f4 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:27.910727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1308/2600] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:27.912277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2f4ad-b810-458c-81ff-4de1848aefef admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:27.932688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2f4ad-b810-458c-81ff-4de1848aefef admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:27.940768 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cfcfd-e877-4b07-9cab-a16336ac8eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:27.941788 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cfcfd-e877-4b07-9cab-a16336ac8eea admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:27.942275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cfcfd-e877-4b07-9cab-a16336ac8eea admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:27.942743 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cfcfd-e877-4b07-9cab-a16336ac8eea admin admin] PATH_INFO: `/v3/projects/04a4c8d1fe2d48e296b18139e8a8140b/users/8e488cf3c05449eaa7640416892c3527/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:27.946594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cfcfd-e877-4b07-9cab-a16336ac8eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a4c8d1fe2d48e296b18139e8a8140b, user_id=8e488cf3c05449eaa7640416892c3527, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:27.952001 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cfcfd-e877-4b07-9cab-a16336ac8eea admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:27.975004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1293/2601] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:14:27 2022] PUT /identity/v3/projects/04a4c8d1fe2d48e296b18139e8a8140b/users/8e488cf3c05449eaa7640416892c3527/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:14:27.995467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b34be-5c43-4a53-942a-5dec573ef865 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:27.995467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b34be-5c43-4a53-942a-5dec573ef865 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:27.995467 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b34be-5c43-4a53-942a-5dec573ef865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:28.054833 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-143b34be-5c43-4a53-942a-5dec573ef865 None None] MFA Rules not processed for user `8e488cf3c05449eaa7640416892c3527`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:28.056973 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-143b34be-5c43-4a53-942a-5dec573ef865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:28.227235 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1309/2602] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:27 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:28.258836 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cfcfd-e877-4b07-9cab-a16336ac8eea admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:28.261716 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0d9cfcfd-e877-4b07-9cab-a16336ac8eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:28.437459 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cfcfd-e877-4b07-9cab-a16336ac8eea admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:28.442668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b7a74-10e8-49fb-8671-500bf11b4abc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:28.443758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b7a74-10e8-49fb-8671-500bf11b4abc service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:28.444331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b7a74-10e8-49fb-8671-500bf11b4abc service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:28.444749 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b7a74-10e8-49fb-8671-500bf11b4abc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:28.471636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b7a74-10e8-49fb-8671-500bf11b4abc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:28.475288 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b7a74-10e8-49fb-8671-500bf11b4abc service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:28.500338 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1294/2603] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:28 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:29.037272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b34be-5c43-4a53-942a-5dec573ef865 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:29.057327 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b34be-5c43-4a53-942a-5dec573ef865 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:29.066526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcade3-33e6-4931-8fa8-a5791b1eb9c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:29.067587 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcade3-33e6-4931-8fa8-a5791b1eb9c4 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:29.068173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcade3-33e6-4931-8fa8-a5791b1eb9c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:29.068630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcade3-33e6-4931-8fa8-a5791b1eb9c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:29.195074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcade3-33e6-4931-8fa8-a5791b1eb9c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:29.197757 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcade3-33e6-4931-8fa8-a5791b1eb9c4 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:29.215704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1310/2604] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:29 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:35.840831 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b7a74-10e8-49fb-8671-500bf11b4abc service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:35.953795 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b7a74-10e8-49fb-8671-500bf11b4abc service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:35.960053 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4e439-189d-43f9-9514-8e28e9f9ec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:35.960755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4e439-189d-43f9-9514-8e28e9f9ec76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:35.961086 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4e439-189d-43f9-9514-8e28e9f9ec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:35.961874 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4e439-189d-43f9-9514-8e28e9f9ec76 admin admin] PATH_INFO: `/v3/users/973f9f70b97347b09e18c795df6482db` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:35.963176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4e439-189d-43f9-9514-8e28e9f9ec76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=973f9f70b97347b09e18c795df6482db)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:35.965208 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4e439-189d-43f9-9514-8e28e9f9ec76 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:36.050477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f2a4e439-189d-43f9-9514-8e28e9f9ec76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973f9f70b97347b09e18c795df6482db'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:36.051206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f2a4e439-189d-43f9-9514-8e28e9f9ec76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973f9f70b97347b09e18c795df6482db'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:36.053295 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:36.065619 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f2a4e439-189d-43f9-9514-8e28e9f9ec76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973f9f70b97347b09e18c795df6482db'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:36.069310 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f2a4e439-189d-43f9-9514-8e28e9f9ec76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973f9f70b97347b09e18c795df6482db'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:36.082633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f2a4e439-189d-43f9-9514-8e28e9f9ec76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973f9f70b97347b09e18c795df6482db'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:36.120926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1295/2605] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:14:35 2022] DELETE /identity/v3/users/973f9f70b97347b09e18c795df6482db => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:14:36.127071 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557203b-c8a5-4e73-a745-b1ff2838ba13 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:36.127793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557203b-c8a5-4e73-a745-b1ff2838ba13 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:36.127793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557203b-c8a5-4e73-a745-b1ff2838ba13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:36.154832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-2557203b-c8a5-4e73-a745-b1ff2838ba13 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:36.156629 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-2557203b-c8a5-4e73-a745-b1ff2838ba13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:36.245665 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1311/2606] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:36.263303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4e439-189d-43f9-9514-8e28e9f9ec76 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:36.265018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f2a4e439-189d-43f9-9514-8e28e9f9ec76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:36.341365 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4e439-189d-43f9-9514-8e28e9f9ec76 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:36.345514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29ce75-5c50-4e13-a9d4-8f23e08a08dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:36.346268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29ce75-5c50-4e13-a9d4-8f23e08a08dc service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:36.346547 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29ce75-5c50-4e13-a9d4-8f23e08a08dc service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:36.346827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29ce75-5c50-4e13-a9d4-8f23e08a08dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:36.357681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29ce75-5c50-4e13-a9d4-8f23e08a08dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:36.359362 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29ce75-5c50-4e13-a9d4-8f23e08a08dc service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:36.371964 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1296/2607] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:36.796780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557203b-c8a5-4e73-a745-b1ff2838ba13 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:36.798329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-2557203b-c8a5-4e73-a745-b1ff2838ba13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:36.811660 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557203b-c8a5-4e73-a745-b1ff2838ba13 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:36.819693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20b5e6-4b25-4041-b015-d9c6b4fcff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:36.820038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20b5e6-4b25-4041-b015-d9c6b4fcff65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:36.820038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20b5e6-4b25-4041-b015-d9c6b4fcff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:36.820766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20b5e6-4b25-4041-b015-d9c6b4fcff65 admin admin] PATH_INFO: `/v3/projects/74ee09c2f59b4cc6b55208a8dfb71b3f` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:36.821938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20b5e6-4b25-4041-b015-d9c6b4fcff65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ee09c2f59b4cc6b55208a8dfb71b3f)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:36.823971 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20b5e6-4b25-4041-b015-d9c6b4fcff65 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:36.832264 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:36.904343 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ed20b5e6-4b25-4041-b015-d9c6b4fcff65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ee09c2f59b4cc6b55208a8dfb71b3f', 'request_id': 'req-ed20b5e6-4b25-4041-b015-d9c6b4fcff65'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:36.914356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ed20b5e6-4b25-4041-b015-d9c6b4fcff65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ee09c2f59b4cc6b55208a8dfb71b3f', 'request_id': 'req-ed20b5e6-4b25-4041-b015-d9c6b4fcff65'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:36.924995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ed20b5e6-4b25-4041-b015-d9c6b4fcff65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ee09c2f59b4cc6b55208a8dfb71b3f', 'request_id': 'req-ed20b5e6-4b25-4041-b015-d9c6b4fcff65'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:36.940226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ed20b5e6-4b25-4041-b015-d9c6b4fcff65 admin admin] The token cache is being invalidate because project 74ee09c2f59b4cc6b55208a8dfb71b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:14:36.940775 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ed20b5e6-4b25-4041-b015-d9c6b4fcff65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:36.941593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ed20b5e6-4b25-4041-b015-d9c6b4fcff65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:36.943123 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1312/2608] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:14:36 2022] DELETE /identity/v3/projects/74ee09c2f59b4cc6b55208a8dfb71b3f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:36.947657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29ce75-5c50-4e13-a9d4-8f23e08a08dc service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:36.959099 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29ce75-5c50-4e13-a9d4-8f23e08a08dc service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:37.032274 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f13be-858e-41c7-93fc-419a85d9fd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:37.032970 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f13be-858e-41c7-93fc-419a85d9fd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:37.033290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f13be-858e-41c7-93fc-419a85d9fd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:37.033652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f13be-858e-41c7-93fc-419a85d9fd7f admin admin] PATH_INFO: `/v3/users/8e488cf3c05449eaa7640416892c3527` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:37.035393 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f13be-858e-41c7-93fc-419a85d9fd7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e488cf3c05449eaa7640416892c3527)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:37.037240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f13be-858e-41c7-93fc-419a85d9fd7f admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:37.100258 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d61f13be-858e-41c7-93fc-419a85d9fd7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e488cf3c05449eaa7640416892c3527'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:37.101271 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d61f13be-858e-41c7-93fc-419a85d9fd7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e488cf3c05449eaa7640416892c3527'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:37.111564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d61f13be-858e-41c7-93fc-419a85d9fd7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e488cf3c05449eaa7640416892c3527'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:37.112472 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d61f13be-858e-41c7-93fc-419a85d9fd7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e488cf3c05449eaa7640416892c3527'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:37.125319 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d61f13be-858e-41c7-93fc-419a85d9fd7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e488cf3c05449eaa7640416892c3527'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:37.135013 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:37.156172 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1297/2609] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:14:36 2022] DELETE /identity/v3/users/8e488cf3c05449eaa7640416892c3527 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:37.441089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32943164-86a8-4d1f-a7ae-1644fa4ec419 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:37.441827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32943164-86a8-4d1f-a7ae-1644fa4ec419 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:37.441827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32943164-86a8-4d1f-a7ae-1644fa4ec419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:37.467468 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-32943164-86a8-4d1f-a7ae-1644fa4ec419 None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:37.468979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-32943164-86a8-4d1f-a7ae-1644fa4ec419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:37.529587 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f13be-858e-41c7-93fc-419a85d9fd7f admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:37.542966 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d61f13be-858e-41c7-93fc-419a85d9fd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:37.573370 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1313/2610] 10.222.0.30 () {58 vars in 967 bytes} [Wed Sep 7 13:14:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:37.591451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32943164-86a8-4d1f-a7ae-1644fa4ec419 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:37.594045 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-32943164-86a8-4d1f-a7ae-1644fa4ec419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:37.657616 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f13be-858e-41c7-93fc-419a85d9fd7f admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:37.666413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bb74c-74d0-4844-9186-bfd49c3635a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:37.666413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bb74c-74d0-4844-9186-bfd49c3635a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:37.666858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bb74c-74d0-4844-9186-bfd49c3635a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:37.666858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bb74c-74d0-4844-9186-bfd49c3635a0 admin admin] PATH_INFO: `/v3/projects/04a4c8d1fe2d48e296b18139e8a8140b` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:37.668360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bb74c-74d0-4844-9186-bfd49c3635a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a4c8d1fe2d48e296b18139e8a8140b)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:37.671836 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bb74c-74d0-4844-9186-bfd49c3635a0 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:37.717218 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32943164-86a8-4d1f-a7ae-1644fa4ec419 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:37.732611 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660b082-02e3-4090-9911-ff82018c6c93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:37.733329 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660b082-02e3-4090-9911-ff82018c6c93 service swift] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:37.733817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660b082-02e3-4090-9911-ff82018c6c93 service swift] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:37.734238 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660b082-02e3-4090-9911-ff82018c6c93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:37.748268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660b082-02e3-4090-9911-ff82018c6c93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:37.751389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660b082-02e3-4090-9911-ff82018c6c93 service swift] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:37.768487 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1314/2611] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:14:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 13:14:37.772664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-728bb74c-74d0-4844-9186-bfd49c3635a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a4c8d1fe2d48e296b18139e8a8140b', 'request_id': 'req-728bb74c-74d0-4844-9186-bfd49c3635a0'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:37.797927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-728bb74c-74d0-4844-9186-bfd49c3635a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a4c8d1fe2d48e296b18139e8a8140b', 'request_id': 'req-728bb74c-74d0-4844-9186-bfd49c3635a0'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:37.812577 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-728bb74c-74d0-4844-9186-bfd49c3635a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a4c8d1fe2d48e296b18139e8a8140b', 'request_id': 'req-728bb74c-74d0-4844-9186-bfd49c3635a0'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:37.835821 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-728bb74c-74d0-4844-9186-bfd49c3635a0 admin admin] The token cache is being invalidate because project 04a4c8d1fe2d48e296b18139e8a8140b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:14:37.836028 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-728bb74c-74d0-4844-9186-bfd49c3635a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:37.836859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-728bb74c-74d0-4844-9186-bfd49c3635a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:37.838758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1298/2612] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:14:37 2022] DELETE /identity/v3/projects/04a4c8d1fe2d48e296b18139e8a8140b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:14:37.843939 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998b5f8-19ab-404c-a73f-eaaf6f749c6a None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:37.844226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998b5f8-19ab-404c-a73f-eaaf6f749c6a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:37.844534 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998b5f8-19ab-404c-a73f-eaaf6f749c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:37.872585 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-4998b5f8-19ab-404c-a73f-eaaf6f749c6a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:37.873903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-4998b5f8-19ab-404c-a73f-eaaf6f749c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:37.906515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:37.960415 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1315/2613] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:14:37.968759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc89992-a33e-432a-8872-f0cbae405bfd None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:37.969255 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc89992-a33e-432a-8872-f0cbae405bfd None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:37.969341 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc89992-a33e-432a-8872-f0cbae405bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:37.992815 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-9cc89992-a33e-432a-8872-f0cbae405bfd None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:37.994074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-9cc89992-a33e-432a-8872-f0cbae405bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:38.003584 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1299/2614] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:38.008925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998b5f8-19ab-404c-a73f-eaaf6f749c6a None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:38.030562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998b5f8-19ab-404c-a73f-eaaf6f749c6a None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:38.038157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bbb3d-6c65-4bf7-91e4-2bde174bed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:38.038920 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bbb3d-6c65-4bf7-91e4-2bde174bed7d admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:38.039266 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bbb3d-6c65-4bf7-91e4-2bde174bed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:38.039558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bbb3d-6c65-4bf7-91e4-2bde174bed7d admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:38.040201 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bbb3d-6c65-4bf7-91e4-2bde174bed7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:14:38.040693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bbb3d-6c65-4bf7-91e4-2bde174bed7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:38.042339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bbb3d-6c65-4bf7-91e4-2bde174bed7d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:38.059223 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1316/2615] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:14:38.064359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc89992-a33e-432a-8872-f0cbae405bfd None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:38.079822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc89992-a33e-432a-8872-f0cbae405bfd None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:38.087823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ecddd-8bcd-4bba-b981-38ca9830c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:38.088889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ecddd-8bcd-4bba-b981-38ca9830c4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:38.089977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ecddd-8bcd-4bba-b981-38ca9830c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:38.089977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ecddd-8bcd-4bba-b981-38ca9830c4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:38.090912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ecddd-8bcd-4bba-b981-38ca9830c4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:38.093331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ecddd-8bcd-4bba-b981-38ca9830c4c4 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:38.133357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1300/2616] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:14:38 2022] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:14:38.139135 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bbb3d-6c65-4bf7-91e4-2bde174bed7d admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:38.152316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bbb3d-6c65-4bf7-91e4-2bde174bed7d admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:38.242906 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11882bbd-db3c-44ca-90f9-7862c2fcb073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:38.243875 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11882bbd-db3c-44ca-90f9-7862c2fcb073 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:38.244189 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11882bbd-db3c-44ca-90f9-7862c2fcb073 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:38.244723 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11882bbd-db3c-44ca-90f9-7862c2fcb073 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:38.245849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11882bbd-db3c-44ca-90f9-7862c2fcb073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:38.249552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11882bbd-db3c-44ca-90f9-7862c2fcb073 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:38.291318 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1317/2617] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:14:38 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:14:38.298405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ecddd-8bcd-4bba-b981-38ca9830c4c4 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:38.316783 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ecddd-8bcd-4bba-b981-38ca9830c4c4 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:38.322645 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330257a-0605-4079-95d4-513bb5fcab9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:38.323276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330257a-0605-4079-95d4-513bb5fcab9e admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:38.323559 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330257a-0605-4079-95d4-513bb5fcab9e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:38.323826 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330257a-0605-4079-95d4-513bb5fcab9e admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:38.324518 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330257a-0605-4079-95d4-513bb5fcab9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:38.326140 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330257a-0605-4079-95d4-513bb5fcab9e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:38.343988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1301/2618] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:38.351298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11882bbd-db3c-44ca-90f9-7862c2fcb073 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:38.362796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11882bbd-db3c-44ca-90f9-7862c2fcb073 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:38.368647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b465c3e-afb0-4621-a644-a7c7461da775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:38.369319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b465c3e-afb0-4621-a644-a7c7461da775 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:38.369669 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b465c3e-afb0-4621-a644-a7c7461da775 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:38.370005 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b465c3e-afb0-4621-a644-a7c7461da775 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:38.370663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b465c3e-afb0-4621-a644-a7c7461da775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:38.372308 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b465c3e-afb0-4621-a644-a7c7461da775 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:38.386676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1318/2619] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:38.395417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330257a-0605-4079-95d4-513bb5fcab9e admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:38.406773 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330257a-0605-4079-95d4-513bb5fcab9e admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:38.412006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380abe2-1c84-437d-918b-59619940bb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:38.412780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380abe2-1c84-437d-918b-59619940bb80 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:38.413057 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380abe2-1c84-437d-918b-59619940bb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:38.413334 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380abe2-1c84-437d-918b-59619940bb80 admin admin] PATH_INFO: `/v3/projects/363e29f342634bb2a05982138b099ca6/users/1d09e68b87534a59bd5e8c69a5a55fb4/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:38.438989 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380abe2-1c84-437d-918b-59619940bb80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=363e29f342634bb2a05982138b099ca6, user_id=1d09e68b87534a59bd5e8c69a5a55fb4, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:38.443323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380abe2-1c84-437d-918b-59619940bb80 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:38.465772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1302/2620] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:14:38 2022] PUT /identity/v3/projects/363e29f342634bb2a05982138b099ca6/users/1d09e68b87534a59bd5e8c69a5a55fb4/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:38.479778 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81ea36-175c-4e10-99ee-408d61f96933 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:38.480536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81ea36-175c-4e10-99ee-408d61f96933 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:38.480536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81ea36-175c-4e10-99ee-408d61f96933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:38.519533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-8b81ea36-175c-4e10-99ee-408d61f96933 None None] MFA Rules not processed for user `1d09e68b87534a59bd5e8c69a5a55fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:38.520806 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8b81ea36-175c-4e10-99ee-408d61f96933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:38.601669 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1319/2621] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:38.607277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380abe2-1c84-437d-918b-59619940bb80 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:38.624320 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:38.691081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380abe2-1c84-437d-918b-59619940bb80 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:38.697428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82668ede-2271-4807-8256-f0e67f17f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:38.699298 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82668ede-2271-4807-8256-f0e67f17f026 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:38.699298 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82668ede-2271-4807-8256-f0e67f17f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:38.699298 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82668ede-2271-4807-8256-f0e67f17f026 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:38.699298 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82668ede-2271-4807-8256-f0e67f17f026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:38.701476 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82668ede-2271-4807-8256-f0e67f17f026 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:38.754123 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1303/2622] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:14:38 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:14:38.759552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81ea36-175c-4e10-99ee-408d61f96933 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:38.771964 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81ea36-175c-4e10-99ee-408d61f96933 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:38.799094 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:38.856234 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bac161-1e0d-46be-b6a4-d0a295ad3b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:38.857383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac161-1e0d-46be-b6a4-d0a295ad3b57 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:38.858545 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac161-1e0d-46be-b6a4-d0a295ad3b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:38.858545 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac161-1e0d-46be-b6a4-d0a295ad3b57 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:38.859280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bac161-1e0d-46be-b6a4-d0a295ad3b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:38.863564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bac161-1e0d-46be-b6a4-d0a295ad3b57 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:38.900906 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1320/2623] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:14:38 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:14:38.906864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82668ede-2271-4807-8256-f0e67f17f026 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:38.920331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82668ede-2271-4807-8256-f0e67f17f026 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:38.928006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014406c-5e91-4922-8c12-013a34b11242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:38.928678 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014406c-5e91-4922-8c12-013a34b11242 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:38.928960 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014406c-5e91-4922-8c12-013a34b11242 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:38.929237 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014406c-5e91-4922-8c12-013a34b11242 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:38.929901 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014406c-5e91-4922-8c12-013a34b11242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:38.931573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014406c-5e91-4922-8c12-013a34b11242 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:38.945882 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1304/2624] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:38.950387 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bac161-1e0d-46be-b6a4-d0a295ad3b57 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:38.962421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bac161-1e0d-46be-b6a4-d0a295ad3b57 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:38.967603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7ad08-f495-4f05-a4d1-d0d75b86dcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:38.968317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7ad08-f495-4f05-a4d1-d0d75b86dcd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:38.968647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7ad08-f495-4f05-a4d1-d0d75b86dcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:38.968971 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7ad08-f495-4f05-a4d1-d0d75b86dcd2 admin admin] PATH_INFO: `/v3/projects/7d2ac96ed9164d9190050379655ff205/users/77882897af404ac1aad17bfd22910f2d/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:38.989707 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7ad08-f495-4f05-a4d1-d0d75b86dcd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2ac96ed9164d9190050379655ff205, user_id=77882897af404ac1aad17bfd22910f2d, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:38.993654 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7ad08-f495-4f05-a4d1-d0d75b86dcd2 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:39.014445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1321/2625] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:14:38 2022] PUT /identity/v3/projects/7d2ac96ed9164d9190050379655ff205/users/77882897af404ac1aad17bfd22910f2d/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:39.018824 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014406c-5e91-4922-8c12-013a34b11242 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:39.034204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014406c-5e91-4922-8c12-013a34b11242 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:39.130292 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c2cce-6c4d-41a5-9a30-ef52c29c0b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:39.131644 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c2cce-6c4d-41a5-9a30-ef52c29c0b05 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:39.132037 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c2cce-6c4d-41a5-9a30-ef52c29c0b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:39.132445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c2cce-6c4d-41a5-9a30-ef52c29c0b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:39.133223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c2cce-6c4d-41a5-9a30-ef52c29c0b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:39.135167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c2cce-6c4d-41a5-9a30-ef52c29c0b05 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:39.146751 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1305/2626] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:39.151685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7ad08-f495-4f05-a4d1-d0d75b86dcd2 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:39.163810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7ad08-f495-4f05-a4d1-d0d75b86dcd2 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:39.169054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425da207-0deb-4caf-98dd-6bb5aae9dfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:39.169735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425da207-0deb-4caf-98dd-6bb5aae9dfd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:39.170011 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425da207-0deb-4caf-98dd-6bb5aae9dfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:39.170285 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425da207-0deb-4caf-98dd-6bb5aae9dfd7 admin admin] PATH_INFO: `/v3/projects/7d2ac96ed9164d9190050379655ff205/users/77882897af404ac1aad17bfd22910f2d/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:39.172291 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425da207-0deb-4caf-98dd-6bb5aae9dfd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2ac96ed9164d9190050379655ff205, user_id=77882897af404ac1aad17bfd22910f2d, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:39.175168 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425da207-0deb-4caf-98dd-6bb5aae9dfd7 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:39.188954 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1322/2627] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:14:39 2022] PUT /identity/v3/projects/7d2ac96ed9164d9190050379655ff205/users/77882897af404ac1aad17bfd22910f2d/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:14:39.201554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a173e-dfc1-44e2-b478-b87fb410af9b None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:39.201882 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a173e-dfc1-44e2-b478-b87fb410af9b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:39.202222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a173e-dfc1-44e2-b478-b87fb410af9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:39.242203 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-817a173e-dfc1-44e2-b478-b87fb410af9b None None] MFA Rules not processed for user `77882897af404ac1aad17bfd22910f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:39.244028 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-817a173e-dfc1-44e2-b478-b87fb410af9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:39.333763 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1306/2628] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:39.353002 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425da207-0deb-4caf-98dd-6bb5aae9dfd7 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:39.354944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-425da207-0deb-4caf-98dd-6bb5aae9dfd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:39.441213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425da207-0deb-4caf-98dd-6bb5aae9dfd7 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:39.445381 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d53dd-66e0-4bd9-b986-014e87fa0363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:39.446141 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d53dd-66e0-4bd9-b986-014e87fa0363 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:39.446299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d53dd-66e0-4bd9-b986-014e87fa0363 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:39.446551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d53dd-66e0-4bd9-b986-014e87fa0363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:39.457662 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d53dd-66e0-4bd9-b986-014e87fa0363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:39.459102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d53dd-66e0-4bd9-b986-014e87fa0363 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:39.472364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1323/2629] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:40.198805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a173e-dfc1-44e2-b478-b87fb410af9b None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:40.209748 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:40.284072 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a173e-dfc1-44e2-b478-b87fb410af9b None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:40.289201 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac498efe-6268-4b03-b6aa-0a2d29ba9975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:40.289845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac498efe-6268-4b03-b6aa-0a2d29ba9975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:40.290119 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac498efe-6268-4b03-b6aa-0a2d29ba9975 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:40.290391 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac498efe-6268-4b03-b6aa-0a2d29ba9975 admin admin] PATH_INFO: `/v3/users/1d09e68b87534a59bd5e8c69a5a55fb4` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:40.291716 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac498efe-6268-4b03-b6aa-0a2d29ba9975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d09e68b87534a59bd5e8c69a5a55fb4)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:40.293726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac498efe-6268-4b03-b6aa-0a2d29ba9975 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:40.366696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ac498efe-6268-4b03-b6aa-0a2d29ba9975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d09e68b87534a59bd5e8c69a5a55fb4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:40.367579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ac498efe-6268-4b03-b6aa-0a2d29ba9975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d09e68b87534a59bd5e8c69a5a55fb4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:40.377143 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ac498efe-6268-4b03-b6aa-0a2d29ba9975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d09e68b87534a59bd5e8c69a5a55fb4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:40.378203 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ac498efe-6268-4b03-b6aa-0a2d29ba9975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d09e68b87534a59bd5e8c69a5a55fb4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:40.386794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-ac498efe-6268-4b03-b6aa-0a2d29ba9975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d09e68b87534a59bd5e8c69a5a55fb4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:40.408446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1307/2630] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:14:40 2022] DELETE /identity/v3/users/1d09e68b87534a59bd5e8c69a5a55fb4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:40.413319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b823fc-b863-4103-bd8e-626ba638c520 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:40.413892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b823fc-b863-4103-bd8e-626ba638c520 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:40.413892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b823fc-b863-4103-bd8e-626ba638c520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:40.436784 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-23b823fc-b863-4103-bd8e-626ba638c520 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:40.438083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-23b823fc-b863-4103-bd8e-626ba638c520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:40.520968 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1324/2631] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:40.535397 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac498efe-6268-4b03-b6aa-0a2d29ba9975 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:40.536946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ac498efe-6268-4b03-b6aa-0a2d29ba9975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:40.608222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac498efe-6268-4b03-b6aa-0a2d29ba9975 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:40.612275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767c29e-3be1-4b95-8064-9a2a231c84bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:40.612965 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767c29e-3be1-4b95-8064-9a2a231c84bb service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:40.613303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767c29e-3be1-4b95-8064-9a2a231c84bb service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:40.613469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767c29e-3be1-4b95-8064-9a2a231c84bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:40.623762 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767c29e-3be1-4b95-8064-9a2a231c84bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:40.625268 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767c29e-3be1-4b95-8064-9a2a231c84bb service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:40.638326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1308/2632] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:40.977956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b823fc-b863-4103-bd8e-626ba638c520 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:40.980301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-23b823fc-b863-4103-bd8e-626ba638c520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:41.016041 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b823fc-b863-4103-bd8e-626ba638c520 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:41.023678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:41.024777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:41.025188 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:41.025728 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef admin admin] PATH_INFO: `/v3/projects/363e29f342634bb2a05982138b099ca6` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:41.027539 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=363e29f342634bb2a05982138b099ca6)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:41.029792 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:41.050142 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:41.098624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '363e29f342634bb2a05982138b099ca6', 'request_id': 'req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:41.106288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '363e29f342634bb2a05982138b099ca6', 'request_id': 'req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:41.114513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '363e29f342634bb2a05982138b099ca6', 'request_id': 'req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:41.130586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef admin admin] The token cache is being invalidate because project 363e29f342634bb2a05982138b099ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:14:41.130930 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:41.131702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:41.134314 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1325/2633] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:14:40 2022] DELETE /identity/v3/projects/363e29f342634bb2a05982138b099ca6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:41.140189 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767c29e-3be1-4b95-8064-9a2a231c84bb service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:41.154636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767c29e-3be1-4b95-8064-9a2a231c84bb service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:41.190992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:41.230109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c4d5d-a685-4e77-8263-cf0ca89e9ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:41.230961 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c4d5d-a685-4e77-8263-cf0ca89e9ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:41.231135 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c4d5d-a685-4e77-8263-cf0ca89e9ead admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:41.231280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c4d5d-a685-4e77-8263-cf0ca89e9ead admin admin] PATH_INFO: `/v3/users/77882897af404ac1aad17bfd22910f2d` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:41.232663 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c4d5d-a685-4e77-8263-cf0ca89e9ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=77882897af404ac1aad17bfd22910f2d)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:41.234630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c4d5d-a685-4e77-8263-cf0ca89e9ead admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:41.304097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-603c4d5d-a685-4e77-8263-cf0ca89e9ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77882897af404ac1aad17bfd22910f2d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:41.305404 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-603c4d5d-a685-4e77-8263-cf0ca89e9ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77882897af404ac1aad17bfd22910f2d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:41.317095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-603c4d5d-a685-4e77-8263-cf0ca89e9ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77882897af404ac1aad17bfd22910f2d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:41.318090 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-603c4d5d-a685-4e77-8263-cf0ca89e9ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77882897af404ac1aad17bfd22910f2d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:41.328574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-603c4d5d-a685-4e77-8263-cf0ca89e9ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77882897af404ac1aad17bfd22910f2d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:41.354502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1309/2634] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:14:41 2022] DELETE /identity/v3/users/77882897af404ac1aad17bfd22910f2d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:41.689126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:41.691819 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:41.713339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c2286-93b7-4b4e-b1c8-752e6051e7ef admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:41.786812 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ecc53-62e8-4435-803c-56d3c97803e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:41.787469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ecc53-62e8-4435-803c-56d3c97803e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:41.787777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ecc53-62e8-4435-803c-56d3c97803e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:41.788080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ecc53-62e8-4435-803c-56d3c97803e6 admin admin] PATH_INFO: `/v3/projects/7d2ac96ed9164d9190050379655ff205` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:41.789377 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ecc53-62e8-4435-803c-56d3c97803e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2ac96ed9164d9190050379655ff205)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:41.791385 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ecc53-62e8-4435-803c-56d3c97803e6 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:41.861799 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ce5ecc53-62e8-4435-803c-56d3c97803e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2ac96ed9164d9190050379655ff205', 'request_id': 'req-ce5ecc53-62e8-4435-803c-56d3c97803e6'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:41.868918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ce5ecc53-62e8-4435-803c-56d3c97803e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2ac96ed9164d9190050379655ff205', 'request_id': 'req-ce5ecc53-62e8-4435-803c-56d3c97803e6'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:41.875217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ce5ecc53-62e8-4435-803c-56d3c97803e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2ac96ed9164d9190050379655ff205', 'request_id': 'req-ce5ecc53-62e8-4435-803c-56d3c97803e6'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:41.892092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ce5ecc53-62e8-4435-803c-56d3c97803e6 admin admin] The token cache is being invalidate because project 7d2ac96ed9164d9190050379655ff205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:14:41.892340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ce5ecc53-62e8-4435-803c-56d3c97803e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:41.893344 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-ce5ecc53-62e8-4435-803c-56d3c97803e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:41.895201 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1326/2635] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:14:41 2022] DELETE /identity/v3/projects/7d2ac96ed9164d9190050379655ff205 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:41.901750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdb6fd-4f27-4722-a2b8-c7a1dbbf3a2b None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:41.902074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdb6fd-4f27-4722-a2b8-c7a1dbbf3a2b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:41.902394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdb6fd-4f27-4722-a2b8-c7a1dbbf3a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:41.935062 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-b8cdb6fd-4f27-4722-a2b8-c7a1dbbf3a2b None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:41.936430 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b8cdb6fd-4f27-4722-a2b8-c7a1dbbf3a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:42.006357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1310/2636] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:14:42.017480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf549be-3c05-429e-ade7-d5b171f9d90e None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:42.017801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf549be-3c05-429e-ade7-d5b171f9d90e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:42.018232 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf549be-3c05-429e-ade7-d5b171f9d90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:42.041064 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-7bf549be-3c05-429e-ade7-d5b171f9d90e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:42.042748 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7bf549be-3c05-429e-ade7-d5b171f9d90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:42.053880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1327/2637] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:42.058702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdb6fd-4f27-4722-a2b8-c7a1dbbf3a2b None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:42.070782 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdb6fd-4f27-4722-a2b8-c7a1dbbf3a2b None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:42.076580 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d152c-1c98-4282-8dc6-7c135872f7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:42.077335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d152c-1c98-4282-8dc6-7c135872f7ef admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:42.077485 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d152c-1c98-4282-8dc6-7c135872f7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:42.077730 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d152c-1c98-4282-8dc6-7c135872f7ef admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:42.078391 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d152c-1c98-4282-8dc6-7c135872f7ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:14:42.078686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d152c-1c98-4282-8dc6-7c135872f7ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:42.080421 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d152c-1c98-4282-8dc6-7c135872f7ef admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:42.094105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1311/2638] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:14:42.099318 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf549be-3c05-429e-ade7-d5b171f9d90e None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:42.109419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf549be-3c05-429e-ade7-d5b171f9d90e None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:42.115933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a8e58-1323-4ec7-b4cf-611d5a8082ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:42.116849 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a8e58-1323-4ec7-b4cf-611d5a8082ba admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:42.117281 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a8e58-1323-4ec7-b4cf-611d5a8082ba admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:42.117737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a8e58-1323-4ec7-b4cf-611d5a8082ba admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:42.118785 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a8e58-1323-4ec7-b4cf-611d5a8082ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:42.121738 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a8e58-1323-4ec7-b4cf-611d5a8082ba admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:42.163871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1328/2639] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:14:42 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:14:42.168713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d152c-1c98-4282-8dc6-7c135872f7ef admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:42.180275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d152c-1c98-4282-8dc6-7c135872f7ef admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:42.223702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:42.270119 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5eb28f-624b-4234-b2fb-8c0932867cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:42.271135 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5eb28f-624b-4234-b2fb-8c0932867cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:42.271135 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5eb28f-624b-4234-b2fb-8c0932867cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:42.271432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5eb28f-624b-4234-b2fb-8c0932867cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:42.271905 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5eb28f-624b-4234-b2fb-8c0932867cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:42.273883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5eb28f-624b-4234-b2fb-8c0932867cb7 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:42.301008 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1312/2640] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:14:42 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:14:42.312638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a8e58-1323-4ec7-b4cf-611d5a8082ba admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:42.324871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:42.329952 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a8e58-1323-4ec7-b4cf-611d5a8082ba admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:42.337836 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e3754-8658-4d7b-a832-538740294b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:42.337836 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e3754-8658-4d7b-a832-538740294b9b admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:42.337836 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e3754-8658-4d7b-a832-538740294b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:42.337836 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e3754-8658-4d7b-a832-538740294b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:42.340464 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e3754-8658-4d7b-a832-538740294b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:42.344663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e3754-8658-4d7b-a832-538740294b9b admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:42.356967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1329/2641] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:42.362824 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5eb28f-624b-4234-b2fb-8c0932867cb7 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:42.374302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5eb28f-624b-4234-b2fb-8c0932867cb7 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:42.380740 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ac132-653e-417f-bafb-078972abc9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:42.381372 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ac132-653e-417f-bafb-078972abc9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:42.381648 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ac132-653e-417f-bafb-078972abc9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:42.381916 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ac132-653e-417f-bafb-078972abc9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:42.382638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ac132-653e-417f-bafb-078972abc9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:42.384345 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ac132-653e-417f-bafb-078972abc9d4 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:42.401837 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1313/2642] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:42.408193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e3754-8658-4d7b-a832-538740294b9b admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:42.425469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e3754-8658-4d7b-a832-538740294b9b admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:42.432536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6ee87-8685-4644-9389-b10837a01f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:42.433674 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6ee87-8685-4644-9389-b10837a01f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:42.434082 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6ee87-8685-4644-9389-b10837a01f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:42.434555 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6ee87-8685-4644-9389-b10837a01f70 admin admin] PATH_INFO: `/v3/projects/c6becd4252464a6e87415062630e20f2/users/931f004314c84465b4492199c30a0968/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:42.460748 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6ee87-8685-4644-9389-b10837a01f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6becd4252464a6e87415062630e20f2, user_id=931f004314c84465b4492199c30a0968, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:42.465257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6ee87-8685-4644-9389-b10837a01f70 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:42.487880 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1330/2643] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:14:42 2022] PUT /identity/v3/projects/c6becd4252464a6e87415062630e20f2/users/931f004314c84465b4492199c30a0968/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:42.588425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2eaf4-c17c-44d7-8795-90920f433951 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:42.588720 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2eaf4-c17c-44d7-8795-90920f433951 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:42.588954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2eaf4-c17c-44d7-8795-90920f433951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:42.631852 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-95f2eaf4-c17c-44d7-8795-90920f433951 None None] MFA Rules not processed for user `931f004314c84465b4492199c30a0968`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:42.633859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-95f2eaf4-c17c-44d7-8795-90920f433951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:42.733008 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1314/2644] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:42.745783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6ee87-8685-4644-9389-b10837a01f70 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:42.748081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-99d6ee87-8685-4644-9389-b10837a01f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:42.818465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6ee87-8685-4644-9389-b10837a01f70 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:42.822317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c7986-43c2-4e32-bfb4-58985c81f7ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:42.822951 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c7986-43c2-4e32-bfb4-58985c81f7ac service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:42.823236 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c7986-43c2-4e32-bfb4-58985c81f7ac service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:42.823497 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c7986-43c2-4e32-bfb4-58985c81f7ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:42.833463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c7986-43c2-4e32-bfb4-58985c81f7ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:42.834959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c7986-43c2-4e32-bfb4-58985c81f7ac service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:42.846134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1331/2645] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:14:52.148710 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2eaf4-c17c-44d7-8795-90920f433951 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:52.161630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2eaf4-c17c-44d7-8795-90920f433951 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:52.165786 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b30ea-709e-419f-abb3-40ec5e7d79fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:52.166476 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b30ea-709e-419f-abb3-40ec5e7d79fe service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:52.166696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b30ea-709e-419f-abb3-40ec5e7d79fe service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:52.166967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b30ea-709e-419f-abb3-40ec5e7d79fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:52.169064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-cf8b30ea-709e-419f-abb3-40ec5e7d79fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:52.261745 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b30ea-709e-419f-abb3-40ec5e7d79fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:52.264472 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b30ea-709e-419f-abb3-40ec5e7d79fe service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:52.281176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1315/2646] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:14:52.841073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:55.275928 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c7986-43c2-4e32-bfb4-58985c81f7ac service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:55.375187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c7986-43c2-4e32-bfb4-58985c81f7ac service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:55.382321 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9878d-a830-4369-89c9-7d3b6a81bc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:55.383226 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9878d-a830-4369-89c9-7d3b6a81bc5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:55.383573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9878d-a830-4369-89c9-7d3b6a81bc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:55.383856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9878d-a830-4369-89c9-7d3b6a81bc5e admin admin] PATH_INFO: `/v3/users/931f004314c84465b4492199c30a0968` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:55.385172 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9878d-a830-4369-89c9-7d3b6a81bc5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=931f004314c84465b4492199c30a0968)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:55.387353 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9878d-a830-4369-89c9-7d3b6a81bc5e admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:55.448305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8ee9878d-a830-4369-89c9-7d3b6a81bc5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931f004314c84465b4492199c30a0968'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:55.449383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8ee9878d-a830-4369-89c9-7d3b6a81bc5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931f004314c84465b4492199c30a0968'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:55.465235 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8ee9878d-a830-4369-89c9-7d3b6a81bc5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931f004314c84465b4492199c30a0968'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:55.487593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8ee9878d-a830-4369-89c9-7d3b6a81bc5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931f004314c84465b4492199c30a0968'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:55.499745 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8ee9878d-a830-4369-89c9-7d3b6a81bc5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931f004314c84465b4492199c30a0968'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:55.510603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1332/2647] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:14:55 2022] DELETE /identity/v3/users/931f004314c84465b4492199c30a0968 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:55.519274 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2df945-b8b0-43e9-9717-40d6d6c96029 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:55.519984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2df945-b8b0-43e9-9717-40d6d6c96029 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:55.520473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2df945-b8b0-43e9-9717-40d6d6c96029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:55.554699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-0b2df945-b8b0-43e9-9717-40d6d6c96029 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:55.557439 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0b2df945-b8b0-43e9-9717-40d6d6c96029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:55.646108 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:55.681214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1316/2648] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:55.694364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9878d-a830-4369-89c9-7d3b6a81bc5e admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:55.696338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8ee9878d-a830-4369-89c9-7d3b6a81bc5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:55.805577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9878d-a830-4369-89c9-7d3b6a81bc5e admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:55.810412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed186118-1caf-46e9-9474-d542fadefe3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:55.811273 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed186118-1caf-46e9-9474-d542fadefe3b service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:55.811700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed186118-1caf-46e9-9474-d542fadefe3b service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:55.812207 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed186118-1caf-46e9-9474-d542fadefe3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:55.826286 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed186118-1caf-46e9-9474-d542fadefe3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:55.828124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed186118-1caf-46e9-9474-d542fadefe3b service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:55.839628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1333/2649] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:56.264230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2df945-b8b0-43e9-9717-40d6d6c96029 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:56.266295 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-0b2df945-b8b0-43e9-9717-40d6d6c96029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:56.292442 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2df945-b8b0-43e9-9717-40d6d6c96029 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:56.300333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed3a8a-567b-4c85-aa46-47f3e590023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:56.302013 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed3a8a-567b-4c85-aa46-47f3e590023a admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:56.302465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed3a8a-567b-4c85-aa46-47f3e590023a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:56.303020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed3a8a-567b-4c85-aa46-47f3e590023a admin admin] PATH_INFO: `/v3/projects/c6becd4252464a6e87415062630e20f2` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:56.305172 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed3a8a-567b-4c85-aa46-47f3e590023a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6becd4252464a6e87415062630e20f2)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:56.308210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed3a8a-567b-4c85-aa46-47f3e590023a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:56.383255 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-1fed3a8a-567b-4c85-aa46-47f3e590023a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6becd4252464a6e87415062630e20f2', 'request_id': 'req-1fed3a8a-567b-4c85-aa46-47f3e590023a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:56.394700 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-1fed3a8a-567b-4c85-aa46-47f3e590023a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6becd4252464a6e87415062630e20f2', 'request_id': 'req-1fed3a8a-567b-4c85-aa46-47f3e590023a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:56.402336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-1fed3a8a-567b-4c85-aa46-47f3e590023a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6becd4252464a6e87415062630e20f2', 'request_id': 'req-1fed3a8a-567b-4c85-aa46-47f3e590023a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:56.415230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-1fed3a8a-567b-4c85-aa46-47f3e590023a admin admin] The token cache is being invalidate because project c6becd4252464a6e87415062630e20f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:14:56.415558 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-1fed3a8a-567b-4c85-aa46-47f3e590023a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:56.416181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-1fed3a8a-567b-4c85-aa46-47f3e590023a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:56.417894 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1317/2650] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:14:56 2022] DELETE /identity/v3/projects/c6becd4252464a6e87415062630e20f2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:14:56.424413 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26947b7-cda1-451a-9e62-d76cb3f92e87 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:56.425492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26947b7-cda1-451a-9e62-d76cb3f92e87 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:56.425492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26947b7-cda1-451a-9e62-d76cb3f92e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:56.458750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-c26947b7-cda1-451a-9e62-d76cb3f92e87 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:56.460978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c26947b7-cda1-451a-9e62-d76cb3f92e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:56.490345 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:56.564933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1334/2651] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:56.576306 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f7da4-3df0-4862-b8a2-24e64e0d1aa1 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:56.577055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f7da4-3df0-4862-b8a2-24e64e0d1aa1 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:56.577055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f7da4-3df0-4862-b8a2-24e64e0d1aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:56.607018 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-120f7da4-3df0-4862-b8a2-24e64e0d1aa1 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:56.608925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-120f7da4-3df0-4862-b8a2-24e64e0d1aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:56.618030 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1318/2652] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:56.622942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26947b7-cda1-451a-9e62-d76cb3f92e87 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:56.634622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26947b7-cda1-451a-9e62-d76cb3f92e87 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:56.640106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a54cd-05fc-43c6-8f1e-4c6acf9b705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:56.640847 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a54cd-05fc-43c6-8f1e-4c6acf9b705c admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:56.641129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a54cd-05fc-43c6-8f1e-4c6acf9b705c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:56.641405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a54cd-05fc-43c6-8f1e-4c6acf9b705c admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:56.642080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a54cd-05fc-43c6-8f1e-4c6acf9b705c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:14:56.642382 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a54cd-05fc-43c6-8f1e-4c6acf9b705c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:56.644288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a54cd-05fc-43c6-8f1e-4c6acf9b705c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:56.659260 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1335/2653] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:14:56.663887 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f7da4-3df0-4862-b8a2-24e64e0d1aa1 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:56.675073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f7da4-3df0-4862-b8a2-24e64e0d1aa1 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:56.690625 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57cfcb-1798-4db5-a49e-388a852d7ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:56.691380 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57cfcb-1798-4db5-a49e-388a852d7ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:56.691851 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57cfcb-1798-4db5-a49e-388a852d7ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:56.692310 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57cfcb-1798-4db5-a49e-388a852d7ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:56.693555 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57cfcb-1798-4db5-a49e-388a852d7ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:56.697256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57cfcb-1798-4db5-a49e-388a852d7ad5 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:56.744876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1319/2654] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:14:56 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:14:56.751592 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a54cd-05fc-43c6-8f1e-4c6acf9b705c admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:56.769186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a54cd-05fc-43c6-8f1e-4c6acf9b705c admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:56.873267 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f21f6a-e5dc-4c77-8970-484d1b27859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:56.874244 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f21f6a-e5dc-4c77-8970-484d1b27859c admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:56.874698 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f21f6a-e5dc-4c77-8970-484d1b27859c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:56.874954 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f21f6a-e5dc-4c77-8970-484d1b27859c admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:56.876600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f21f6a-e5dc-4c77-8970-484d1b27859c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:56.880435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f21f6a-e5dc-4c77-8970-484d1b27859c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:56.913462 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1336/2655] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:14:56 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:14:56.919105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57cfcb-1798-4db5-a49e-388a852d7ad5 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:56.935134 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57cfcb-1798-4db5-a49e-388a852d7ad5 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:56.942670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19822d-4019-4307-aef5-40df68ab2867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:56.943606 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19822d-4019-4307-aef5-40df68ab2867 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:56.944231 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19822d-4019-4307-aef5-40df68ab2867 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:56.944645 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19822d-4019-4307-aef5-40df68ab2867 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:56.945405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19822d-4019-4307-aef5-40df68ab2867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:56.947468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19822d-4019-4307-aef5-40df68ab2867 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:56.965141 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1320/2656] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:56.970163 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f21f6a-e5dc-4c77-8970-484d1b27859c admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:56.990543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f21f6a-e5dc-4c77-8970-484d1b27859c admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:57.000651 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b6361-b168-483f-8b7e-e51e4c09c3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:57.001641 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b6361-b168-483f-8b7e-e51e4c09c3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:57.002137 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b6361-b168-483f-8b7e-e51e4c09c3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:57.002838 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b6361-b168-483f-8b7e-e51e4c09c3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:57.004974 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b6361-b168-483f-8b7e-e51e4c09c3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:57.008746 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b6361-b168-483f-8b7e-e51e4c09c3b2 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:57.047999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1337/2657] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:14:57.053966 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19822d-4019-4307-aef5-40df68ab2867 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:57.069297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19822d-4019-4307-aef5-40df68ab2867 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:57.082182 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40296bfb-4854-46dc-9eb7-65930437b1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:57.083462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40296bfb-4854-46dc-9eb7-65930437b1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:57.084012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40296bfb-4854-46dc-9eb7-65930437b1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:57.084519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40296bfb-4854-46dc-9eb7-65930437b1ca admin admin] PATH_INFO: `/v3/projects/66cca1d999c643aa8db355d7a3d98070/users/f9201e76ffb045d099f765f4105354fb/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:57.125064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40296bfb-4854-46dc-9eb7-65930437b1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=66cca1d999c643aa8db355d7a3d98070, user_id=f9201e76ffb045d099f765f4105354fb, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:57.131509 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40296bfb-4854-46dc-9eb7-65930437b1ca admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:57.168222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1321/2658] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:14:57 2022] PUT /identity/v3/projects/66cca1d999c643aa8db355d7a3d98070/users/f9201e76ffb045d099f765f4105354fb/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:57.176208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2d242-8b2c-4b87-b5b2-ae14d4cd44f8 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:57.177259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2d242-8b2c-4b87-b5b2-ae14d4cd44f8 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:57.177975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2d242-8b2c-4b87-b5b2-ae14d4cd44f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:57.214359 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-23a2d242-8b2c-4b87-b5b2-ae14d4cd44f8 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:57.217007 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-23a2d242-8b2c-4b87-b5b2-ae14d4cd44f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:57.333797 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1338/2659] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:14:57.348991 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40296bfb-4854-46dc-9eb7-65930437b1ca admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:57.351884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-40296bfb-4854-46dc-9eb7-65930437b1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:57.439336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40296bfb-4854-46dc-9eb7-65930437b1ca admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:57.444293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c94f53-9ad5-4b33-ac98-f2a73ae3ea3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:57.444964 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c94f53-9ad5-4b33-ac98-f2a73ae3ea3a service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:57.445243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c94f53-9ad5-4b33-ac98-f2a73ae3ea3a service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:57.445512 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c94f53-9ad5-4b33-ac98-f2a73ae3ea3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:57.456891 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c94f53-9ad5-4b33-ac98-f2a73ae3ea3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:57.458370 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c94f53-9ad5-4b33-ac98-f2a73ae3ea3a service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:57.471524 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1322/2660] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:15:05.444466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9742e2-0738-4720-b394-da96a6f86071 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:05.445441 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9742e2-0738-4720-b394-da96a6f86071 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:05.445441 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9742e2-0738-4720-b394-da96a6f86071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:05.506719 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-cc9742e2-0738-4720-b394-da96a6f86071 None None] MFA Rules not processed for user `f9201e76ffb045d099f765f4105354fb`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:05.508627 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-cc9742e2-0738-4720-b394-da96a6f86071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:05.549061 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:05.651627 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1339/2661] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:15:05.656976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c94f53-9ad5-4b33-ac98-f2a73ae3ea3a service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:05.668832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c94f53-9ad5-4b33-ac98-f2a73ae3ea3a service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:05.675672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b29816-404c-4379-85b6-5b089e910c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:05.676531 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b29816-404c-4379-85b6-5b089e910c8a admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:05.676987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b29816-404c-4379-85b6-5b089e910c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:05.677367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b29816-404c-4379-85b6-5b089e910c8a admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:05.678128 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b29816-404c-4379-85b6-5b089e910c8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:05.680203 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b29816-404c-4379-85b6-5b089e910c8a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:05.686053 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:05.722311 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1323/2662] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:15:05 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:05.729739 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9742e2-0738-4720-b394-da96a6f86071 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:05.751422 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9742e2-0738-4720-b394-da96a6f86071 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:05.877087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0402a-fea5-48aa-a7fa-0932fa487d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:05.879382 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0402a-fea5-48aa-a7fa-0932fa487d43 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:05.879382 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0402a-fea5-48aa-a7fa-0932fa487d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:05.879382 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0402a-fea5-48aa-a7fa-0932fa487d43 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:05.880178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0402a-fea5-48aa-a7fa-0932fa487d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:05.883537 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0402a-fea5-48aa-a7fa-0932fa487d43 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:05.927674 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1340/2663] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:15:05 2022] POST /identity/v3/users => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:05.933090 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b29816-404c-4379-85b6-5b089e910c8a admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:05.954917 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b29816-404c-4379-85b6-5b089e910c8a admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:05.965447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb5b50-dce8-4c89-93b7-8b837c2efef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:05.967026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb5b50-dce8-4c89-93b7-8b837c2efef3 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:05.967710 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb5b50-dce8-4c89-93b7-8b837c2efef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:05.968289 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb5b50-dce8-4c89-93b7-8b837c2efef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:05.969794 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb5b50-dce8-4c89-93b7-8b837c2efef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:05.973535 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb5b50-dce8-4c89-93b7-8b837c2efef3 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:05.997085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1324/2664] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:15:06.006114 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0402a-fea5-48aa-a7fa-0932fa487d43 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:06.044782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0402a-fea5-48aa-a7fa-0932fa487d43 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:06.051753 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877d46b-d779-4ea1-bb52-f426d611b46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:06.052801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877d46b-d779-4ea1-bb52-f426d611b46e admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:06.057638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877d46b-d779-4ea1-bb52-f426d611b46e admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:06.059074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877d46b-d779-4ea1-bb52-f426d611b46e admin admin] PATH_INFO: `/v3/projects/814b51a09e7149869108b03a94538d51/users/cb2a1efc43f140b283863411e6ea5fa9/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:06.095649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877d46b-d779-4ea1-bb52-f426d611b46e admin admin] RBAC: Authorizing `identity:create_grant(project_id=814b51a09e7149869108b03a94538d51, user_id=cb2a1efc43f140b283863411e6ea5fa9, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:06.103146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877d46b-d779-4ea1-bb52-f426d611b46e admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:06.130751 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1341/2665] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:15:06 2022] PUT /identity/v3/projects/814b51a09e7149869108b03a94538d51/users/cb2a1efc43f140b283863411e6ea5fa9/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:06.137333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb5b50-dce8-4c89-93b7-8b837c2efef3 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:06.178509 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb5b50-dce8-4c89-93b7-8b837c2efef3 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:06.304188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10815b6b-43f3-45cc-9f26-b1f6dc113beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:06.305235 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10815b6b-43f3-45cc-9f26-b1f6dc113beb admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:06.305741 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10815b6b-43f3-45cc-9f26-b1f6dc113beb admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:06.306233 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10815b6b-43f3-45cc-9f26-b1f6dc113beb admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:06.306982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10815b6b-43f3-45cc-9f26-b1f6dc113beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:06.308744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10815b6b-43f3-45cc-9f26-b1f6dc113beb admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:06.341109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1325/2666] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:15:06.348841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877d46b-d779-4ea1-bb52-f426d611b46e admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:06.371658 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877d46b-d779-4ea1-bb52-f426d611b46e admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:06.385499 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9913d0a-5f1e-45de-959e-4835366438d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:06.386677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9913d0a-5f1e-45de-959e-4835366438d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:06.387267 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9913d0a-5f1e-45de-959e-4835366438d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:06.387845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9913d0a-5f1e-45de-959e-4835366438d4 admin admin] PATH_INFO: `/v3/projects/814b51a09e7149869108b03a94538d51/users/cb2a1efc43f140b283863411e6ea5fa9/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:06.392080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9913d0a-5f1e-45de-959e-4835366438d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814b51a09e7149869108b03a94538d51, user_id=cb2a1efc43f140b283863411e6ea5fa9, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:06.397643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9913d0a-5f1e-45de-959e-4835366438d4 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:06.428482 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1342/2667] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:15:06 2022] PUT /identity/v3/projects/814b51a09e7149869108b03a94538d51/users/cb2a1efc43f140b283863411e6ea5fa9/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:16.325377 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:16.412440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=63,keystone:INSERT=5 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:20.473921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da7d35-3ff3-4d3f-8226-a46bf25c5a1e None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:20.475861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da7d35-3ff3-4d3f-8226-a46bf25c5a1e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:20.475861 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da7d35-3ff3-4d3f-8226-a46bf25c5a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:20.539270 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-e0da7d35-3ff3-4d3f-8226-a46bf25c5a1e None None] MFA Rules not processed for user `cb2a1efc43f140b283863411e6ea5fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:20.541431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-e0da7d35-3ff3-4d3f-8226-a46bf25c5a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:20.755535 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1326/2668] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:20.775770 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9913d0a-5f1e-45de-959e-4835366438d4 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:20.778944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a9913d0a-5f1e-45de-959e-4835366438d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:20.949630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9913d0a-5f1e-45de-959e-4835366438d4 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:20.953956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bd3c0-516e-41c6-b61e-8a3349b47547 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f332ac2346f0444a8d336ed2b3121be2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:20.954644 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bd3c0-516e-41c6-b61e-8a3349b47547 service glance] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:20.954949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bd3c0-516e-41c6-b61e-8a3349b47547 service glance] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:20.955383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bd3c0-516e-41c6-b61e-8a3349b47547 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:21.105550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bd3c0-516e-41c6-b61e-8a3349b47547 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:21.109388 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bd3c0-516e-41c6-b61e-8a3349b47547 service glance] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:21.134518 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1343/2669] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:15:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:15:21.470481 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154be80-2128-45aa-b686-b36be1dccd44 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:21.471199 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154be80-2128-45aa-b686-b36be1dccd44 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:21.471465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154be80-2128-45aa-b686-b36be1dccd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:21.519724 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-f154be80-2128-45aa-b686-b36be1dccd44 None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:21.521221 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f154be80-2128-45aa-b686-b36be1dccd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:21.665500 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1327/2670] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Sep 7 13:15:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:21.715493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bd3c0-516e-41c6-b61e-8a3349b47547 service glance] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:21.717509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-567bd3c0-516e-41c6-b61e-8a3349b47547 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:21.882790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bd3c0-516e-41c6-b61e-8a3349b47547 service glance] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:21.905087 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87932d22-3c50-4598-8009-74282ff64950 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:21.906112 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87932d22-3c50-4598-8009-74282ff64950 service swift] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:21.906539 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87932d22-3c50-4598-8009-74282ff64950 service swift] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:21.906961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87932d22-3c50-4598-8009-74282ff64950 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:21.945172 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87932d22-3c50-4598-8009-74282ff64950 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:21.947319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87932d22-3c50-4598-8009-74282ff64950 service swift] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:21.969754 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1344/2671] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:15:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:15:23.261508 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154be80-2128-45aa-b686-b36be1dccd44 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:23.264885 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f154be80-2128-45aa-b686-b36be1dccd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:23.478183 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154be80-2128-45aa-b686-b36be1dccd44 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:23.492911 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36e39b-e246-48ea-be1d-70baf74809cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:23.494283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36e39b-e246-48ea-be1d-70baf74809cc service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:23.494951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36e39b-e246-48ea-be1d-70baf74809cc service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:23.495637 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36e39b-e246-48ea-be1d-70baf74809cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:23.500912 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-aa36e39b-e246-48ea-be1d-70baf74809cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:23.674561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:23.763879 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36e39b-e246-48ea-be1d-70baf74809cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:23.775729 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36e39b-e246-48ea-be1d-70baf74809cc service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:23.802681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1328/2672] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:15:24.643095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87932d22-3c50-4598-8009-74282ff64950 service swift] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:24.696997 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87932d22-3c50-4598-8009-74282ff64950 service swift] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:24.716404 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edbda7-2894-419c-9cfd-fd43d55e5d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:24.717755 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edbda7-2894-419c-9cfd-fd43d55e5d59 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:24.719680 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edbda7-2894-419c-9cfd-fd43d55e5d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:24.721502 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edbda7-2894-419c-9cfd-fd43d55e5d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:24.731466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b4edbda7-2894-419c-9cfd-fd43d55e5d59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:24.771594 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edbda7-2894-419c-9cfd-fd43d55e5d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:24.781395 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edbda7-2894-419c-9cfd-fd43d55e5d59 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:24.831412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1345/2673] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:15:32.497883 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36e39b-e246-48ea-be1d-70baf74809cc service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:32.499521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-aa36e39b-e246-48ea-be1d-70baf74809cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:32.544432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edbda7-2894-419c-9cfd-fd43d55e5d59 service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:32.546709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b4edbda7-2894-419c-9cfd-fd43d55e5d59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:32.586131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edbda7-2894-419c-9cfd-fd43d55e5d59 service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:32.599985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f02493-f824-4185-87b9-acba93d92eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:32.602213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f02493-f824-4185-87b9-acba93d92eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:32.603216 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f02493-f824-4185-87b9-acba93d92eab admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:32.604001 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f02493-f824-4185-87b9-acba93d92eab admin admin] PATH_INFO: `/v3/users/2b1ed674b846444e9239d42e7ea03b53` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:32.608428 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f02493-f824-4185-87b9-acba93d92eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1ed674b846444e9239d42e7ea03b53)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:32.615795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f02493-f824-4185-87b9-acba93d92eab admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:32.750846 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:32.802232 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e2f02493-f824-4185-87b9-acba93d92eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1ed674b846444e9239d42e7ea03b53'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:32.804032 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e2f02493-f824-4185-87b9-acba93d92eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1ed674b846444e9239d42e7ea03b53'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:32.829684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e2f02493-f824-4185-87b9-acba93d92eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1ed674b846444e9239d42e7ea03b53'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:32.833483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36e39b-e246-48ea-be1d-70baf74809cc service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:32.863120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e2f02493-f824-4185-87b9-acba93d92eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1ed674b846444e9239d42e7ea03b53'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:32.876263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f515212-731b-40e9-87a0-6eee331f2d13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2420def47ee4a5b8cf4373252583d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:32.876263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f515212-731b-40e9-87a0-6eee331f2d13 service placement] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:32.876263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f515212-731b-40e9-87a0-6eee331f2d13 service placement] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:32.876263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f515212-731b-40e9-87a0-6eee331f2d13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:32.881934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2f515212-731b-40e9-87a0-6eee331f2d13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:32.886195 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e2f02493-f824-4185-87b9-acba93d92eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1ed674b846444e9239d42e7ea03b53'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:32.913901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1346/2674] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:15:32 2022] DELETE /identity/v3/users/2b1ed674b846444e9239d42e7ea03b53 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:32.939327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f515212-731b-40e9-87a0-6eee331f2d13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:32.942757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f515212-731b-40e9-87a0-6eee331f2d13 service placement] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:32.976364 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1329/2675] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:15:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:15:33.279902 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f02493-f824-4185-87b9-acba93d92eab admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:33.282746 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e2f02493-f824-4185-87b9-acba93d92eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:33.415499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f515212-731b-40e9-87a0-6eee331f2d13 service placement] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:33.417093 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2f515212-731b-40e9-87a0-6eee331f2d13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:33.437971 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f515212-731b-40e9-87a0-6eee331f2d13 service placement] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:33.533965 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f02493-f824-4185-87b9-acba93d92eab admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:33.548253 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00467368-76b5-4151-aa41-630358c2af9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2420def47ee4a5b8cf4373252583d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:33.550725 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00467368-76b5-4151-aa41-630358c2af9e service placement] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:33.551586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00467368-76b5-4151-aa41-630358c2af9e service placement] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:33.552321 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00467368-76b5-4151-aa41-630358c2af9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:33.556175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-00467368-76b5-4151-aa41-630358c2af9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:33.571945 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e413eb-0406-493f-a287-bb083b8e63ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:33.573040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e413eb-0406-493f-a287-bb083b8e63ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:33.573326 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e413eb-0406-493f-a287-bb083b8e63ab admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:33.573639 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e413eb-0406-493f-a287-bb083b8e63ab admin admin] PATH_INFO: `/v3/users/e4a0c3740593402c955abe8ce23640c4` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:33.575633 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e413eb-0406-493f-a287-bb083b8e63ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a0c3740593402c955abe8ce23640c4)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:33.579512 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e413eb-0406-493f-a287-bb083b8e63ab admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:33.586820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00467368-76b5-4151-aa41-630358c2af9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:33.590372 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00467368-76b5-4151-aa41-630358c2af9e service placement] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:33.607541 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1347/2676] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:15:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:15:33.609082 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00467368-76b5-4151-aa41-630358c2af9e service placement] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:33.612356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-00467368-76b5-4151-aa41-630358c2af9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:33.642110 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00467368-76b5-4151-aa41-630358c2af9e service placement] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:33.650363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d971d6-79ed-4adb-8441-14b3768dfaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:33.655746 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d971d6-79ed-4adb-8441-14b3768dfaa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:33.658160 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d971d6-79ed-4adb-8441-14b3768dfaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:33.658547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d971d6-79ed-4adb-8441-14b3768dfaa6 admin admin] PATH_INFO: `/v3/projects/2cfa5138d43a4bd6bfcd6ff3563cce3f` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:33.661244 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d971d6-79ed-4adb-8441-14b3768dfaa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cfa5138d43a4bd6bfcd6ff3563cce3f)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:33.665390 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d971d6-79ed-4adb-8441-14b3768dfaa6 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:33.699135 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f6e413eb-0406-493f-a287-bb083b8e63ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a0c3740593402c955abe8ce23640c4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:33.700276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f6e413eb-0406-493f-a287-bb083b8e63ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a0c3740593402c955abe8ce23640c4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:33.718561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f6e413eb-0406-493f-a287-bb083b8e63ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a0c3740593402c955abe8ce23640c4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:33.720876 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f6e413eb-0406-493f-a287-bb083b8e63ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a0c3740593402c955abe8ce23640c4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:33.746260 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f6e413eb-0406-493f-a287-bb083b8e63ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a0c3740593402c955abe8ce23640c4'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:33.766906 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:33.779947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-76d971d6-79ed-4adb-8441-14b3768dfaa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cfa5138d43a4bd6bfcd6ff3563cce3f', 'request_id': 'req-76d971d6-79ed-4adb-8441-14b3768dfaa6'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:33.792599 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-76d971d6-79ed-4adb-8441-14b3768dfaa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cfa5138d43a4bd6bfcd6ff3563cce3f', 'request_id': 'req-76d971d6-79ed-4adb-8441-14b3768dfaa6'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:33.805832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1330/2677] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:15:33 2022] DELETE /identity/v3/users/e4a0c3740593402c955abe8ce23640c4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:33.807717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-76d971d6-79ed-4adb-8441-14b3768dfaa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cfa5138d43a4bd6bfcd6ff3563cce3f', 'request_id': 'req-76d971d6-79ed-4adb-8441-14b3768dfaa6'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:33.830312 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-76d971d6-79ed-4adb-8441-14b3768dfaa6 admin admin] The token cache is being invalidate because project 2cfa5138d43a4bd6bfcd6ff3563cce3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:15:33.830705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-76d971d6-79ed-4adb-8441-14b3768dfaa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:33.831684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-76d971d6-79ed-4adb-8441-14b3768dfaa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:33.835279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1348/2678] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:15:33 2022] DELETE /identity/v3/projects/2cfa5138d43a4bd6bfcd6ff3563cce3f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:33.842186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1a68a-ebf2-4907-a917-f4215918c3a9 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:33.842186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1a68a-ebf2-4907-a917-f4215918c3a9 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:33.842685 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1a68a-ebf2-4907-a917-f4215918c3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:33.886526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-62a1a68a-ebf2-4907-a917-f4215918c3a9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:33.889040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-62a1a68a-ebf2-4907-a917-f4215918c3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:34.018417 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579535d-f5c0-47ff-93d9-bbf8993942ec None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:34.018692 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1331/2679] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:34.018890 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579535d-f5c0-47ff-93d9-bbf8993942ec None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:34.019028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579535d-f5c0-47ff-93d9-bbf8993942ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:34.065762 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-8579535d-f5c0-47ff-93d9-bbf8993942ec None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:34.069005 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8579535d-f5c0-47ff-93d9-bbf8993942ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:34.082618 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1349/2680] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:34.088982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1a68a-ebf2-4907-a917-f4215918c3a9 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:34.105916 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1a68a-ebf2-4907-a917-f4215918c3a9 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:34.115612 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4405f51-68b8-403c-b3cf-2b2ac4f2f931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:34.117441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4405f51-68b8-403c-b3cf-2b2ac4f2f931 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:34.122138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4405f51-68b8-403c-b3cf-2b2ac4f2f931 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:34.122138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4405f51-68b8-403c-b3cf-2b2ac4f2f931 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:34.122138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4405f51-68b8-403c-b3cf-2b2ac4f2f931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:15:34.122138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4405f51-68b8-403c-b3cf-2b2ac4f2f931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:34.124219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4405f51-68b8-403c-b3cf-2b2ac4f2f931 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:34.148607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579535d-f5c0-47ff-93d9-bbf8993942ec None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:34.150785 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8579535d-f5c0-47ff-93d9-bbf8993942ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:34.193182 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1332/2681] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:15:34.195647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579535d-f5c0-47ff-93d9-bbf8993942ec None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:34.198673 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4405f51-68b8-403c-b3cf-2b2ac4f2f931 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:34.210141 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd2e70-04d2-4987-826b-53e72cb3dc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:34.211353 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd2e70-04d2-4987-826b-53e72cb3dc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:34.211962 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd2e70-04d2-4987-826b-53e72cb3dc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:34.212338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd2e70-04d2-4987-826b-53e72cb3dc0f admin admin] PATH_INFO: `/v3/projects/3e5908d5dcbd423784262d5fddaf00f0` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:34.214601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd2e70-04d2-4987-826b-53e72cb3dc0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e5908d5dcbd423784262d5fddaf00f0)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:34.217714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd2e70-04d2-4987-826b-53e72cb3dc0f admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:34.224187 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:34.245158 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4405f51-68b8-403c-b3cf-2b2ac4f2f931 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:34.259204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d818d-fe4e-406a-a97d-c19bf3cade42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:34.260349 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d818d-fe4e-406a-a97d-c19bf3cade42 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:34.261275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d818d-fe4e-406a-a97d-c19bf3cade42 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:34.261761 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d818d-fe4e-406a-a97d-c19bf3cade42 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:34.263078 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d818d-fe4e-406a-a97d-c19bf3cade42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:34.265544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d818d-fe4e-406a-a97d-c19bf3cade42 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:34.341564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1333/2682] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:15:34 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:34.343059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d818d-fe4e-406a-a97d-c19bf3cade42 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:34.375722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-95cd2e70-04d2-4987-826b-53e72cb3dc0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e5908d5dcbd423784262d5fddaf00f0', 'request_id': 'req-95cd2e70-04d2-4987-826b-53e72cb3dc0f'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:34.394547 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-95cd2e70-04d2-4987-826b-53e72cb3dc0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e5908d5dcbd423784262d5fddaf00f0', 'request_id': 'req-95cd2e70-04d2-4987-826b-53e72cb3dc0f'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:34.408799 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-95cd2e70-04d2-4987-826b-53e72cb3dc0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e5908d5dcbd423784262d5fddaf00f0', 'request_id': 'req-95cd2e70-04d2-4987-826b-53e72cb3dc0f'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:34.459867 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-95cd2e70-04d2-4987-826b-53e72cb3dc0f admin admin] The token cache is being invalidate because project 3e5908d5dcbd423784262d5fddaf00f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:15:34.460581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-95cd2e70-04d2-4987-826b-53e72cb3dc0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:34.466516 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-95cd2e70-04d2-4987-826b-53e72cb3dc0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:34.470754 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1350/2683] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:15:34 2022] DELETE /identity/v3/projects/3e5908d5dcbd423784262d5fddaf00f0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:15:34.478801 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a1ea2-edaf-4a2a-8630-85220202135d None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:34.479438 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a1ea2-edaf-4a2a-8630-85220202135d None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:34.480032 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a1ea2-edaf-4a2a-8630-85220202135d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:34.521953 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d818d-fe4e-406a-a97d-c19bf3cade42 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:34.523541 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-7f6a1ea2-edaf-4a2a-8630-85220202135d None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:34.527811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7f6a1ea2-edaf-4a2a-8630-85220202135d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:34.531132 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42df6bf-e6b3-475e-af21-4f1852684e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:34.533726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42df6bf-e6b3-475e-af21-4f1852684e78 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:34.534611 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42df6bf-e6b3-475e-af21-4f1852684e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:34.535134 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42df6bf-e6b3-475e-af21-4f1852684e78 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:34.537384 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42df6bf-e6b3-475e-af21-4f1852684e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:34.541355 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42df6bf-e6b3-475e-af21-4f1852684e78 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:34.545071 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1351/2684] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:34.572195 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a65a6-2bce-4019-a399-a66a06ec7f94 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:34.574172 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a65a6-2bce-4019-a399-a66a06ec7f94 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:34.574894 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a65a6-2bce-4019-a399-a66a06ec7f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:34.599592 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1334/2685] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:15:34 2022] POST /identity/v3/users => generated 286 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:34.601922 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42df6bf-e6b3-475e-af21-4f1852684e78 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:34.612024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-845a65a6-2bce-4019-a399-a66a06ec7f94 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:34.612024 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-845a65a6-2bce-4019-a399-a66a06ec7f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:34.617475 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c42df6bf-e6b3-475e-af21-4f1852684e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:34.639694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1352/2686] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:34.656867 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42df6bf-e6b3-475e-af21-4f1852684e78 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:34.661947 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a65a6-2bce-4019-a399-a66a06ec7f94 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:34.667307 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee9ed6-a7bc-458f-b386-e0a902213a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:34.668220 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee9ed6-a7bc-458f-b386-e0a902213a12 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:34.668846 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee9ed6-a7bc-458f-b386-e0a902213a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:34.670069 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee9ed6-a7bc-458f-b386-e0a902213a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:34.671263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee9ed6-a7bc-458f-b386-e0a902213a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:34.674188 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee9ed6-a7bc-458f-b386-e0a902213a12 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:34.699951 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a65a6-2bce-4019-a399-a66a06ec7f94 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:34.708617 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1335/2687] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:15:34.710988 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee9ed6-a7bc-458f-b386-e0a902213a12 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:34.711395 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0cb6b-1239-43d7-98bd-99e976ccff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:34.712509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0cb6b-1239-43d7-98bd-99e976ccff19 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:34.712980 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0cb6b-1239-43d7-98bd-99e976ccff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:34.714421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0cb6b-1239-43d7-98bd-99e976ccff19 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:34.715805 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0cb6b-1239-43d7-98bd-99e976ccff19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:15:34.716319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0cb6b-1239-43d7-98bd-99e976ccff19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:34.719688 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0cb6b-1239-43d7-98bd-99e976ccff19 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:34.741387 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee9ed6-a7bc-458f-b386-e0a902213a12 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:34.759220 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1353/2688] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:15:34.759549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a1554-d619-4830-9cdc-ca28bd4a3f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:34.759549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a1554-d619-4830-9cdc-ca28bd4a3f3e admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:34.759549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a1554-d619-4830-9cdc-ca28bd4a3f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:34.759549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a1554-d619-4830-9cdc-ca28bd4a3f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:34.761428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a1554-d619-4830-9cdc-ca28bd4a3f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:34.761932 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0cb6b-1239-43d7-98bd-99e976ccff19 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:34.765052 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a1554-d619-4830-9cdc-ca28bd4a3f3e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:34.782931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0cb6b-1239-43d7-98bd-99e976ccff19 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:34.791391 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1336/2689] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:15:34.795856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e37f6f-662a-4bb2-b7c6-2cb4aa291063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:34.796348 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a1554-d619-4830-9cdc-ca28bd4a3f3e admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:34.797013 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e37f6f-662a-4bb2-b7c6-2cb4aa291063 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:34.797559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e37f6f-662a-4bb2-b7c6-2cb4aa291063 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:34.798033 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e37f6f-662a-4bb2-b7c6-2cb4aa291063 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:34.799260 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e37f6f-662a-4bb2-b7c6-2cb4aa291063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:34.804819 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e37f6f-662a-4bb2-b7c6-2cb4aa291063 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:34.812333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a1554-d619-4830-9cdc-ca28bd4a3f3e admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:34.820108 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4ac93-4f16-4da4-9aac-2f575bd6acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:34.821167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4ac93-4f16-4da4-9aac-2f575bd6acf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:34.821695 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4ac93-4f16-4da4-9aac-2f575bd6acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:34.822136 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4ac93-4f16-4da4-9aac-2f575bd6acf1 admin admin] PATH_INFO: `/v3/projects/14437a1940564b7fb9c98f4c5b0e37f3/users/dd23ac3fec89458d8dc4830ea09f17f6/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:34.852631 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4ac93-4f16-4da4-9aac-2f575bd6acf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14437a1940564b7fb9c98f4c5b0e37f3, user_id=dd23ac3fec89458d8dc4830ea09f17f6, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:34.863841 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4ac93-4f16-4da4-9aac-2f575bd6acf1 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:34.886280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:34.886632 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1354/2690] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:15:34 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:34.892696 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e37f6f-662a-4bb2-b7c6-2cb4aa291063 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:34.903948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1337/2691] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:15:34 2022] PUT /identity/v3/projects/14437a1940564b7fb9c98f4c5b0e37f3/users/dd23ac3fec89458d8dc4830ea09f17f6/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:34.924731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7d275-66b8-4b85-b78f-25c8d0c84b19 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:34.925157 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7d275-66b8-4b85-b78f-25c8d0c84b19 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:34.925577 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7d275-66b8-4b85-b78f-25c8d0c84b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:34.979156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-a7b7d275-66b8-4b85-b78f-25c8d0c84b19 None None] MFA Rules not processed for user `dd23ac3fec89458d8dc4830ea09f17f6`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:34.980501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a7b7d275-66b8-4b85-b78f-25c8d0c84b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:35.048725 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e37f6f-662a-4bb2-b7c6-2cb4aa291063 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:35.130062 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1338/2692] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:15:35.131999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7d275-66b8-4b85-b78f-25c8d0c84b19 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:35.156678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:35.185283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bcc2d-43db-4b97-941a-e2b624c11a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:35.185901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bcc2d-43db-4b97-941a-e2b624c11a9d admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:35.186179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bcc2d-43db-4b97-941a-e2b624c11a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:35.186449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bcc2d-43db-4b97-941a-e2b624c11a9d admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:35.187234 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bcc2d-43db-4b97-941a-e2b624c11a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:35.189835 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bcc2d-43db-4b97-941a-e2b624c11a9d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:35.236439 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1355/2693] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:15:34 2022] POST /identity/v3/users => generated 293 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:15:35.241435 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bcc2d-43db-4b97-941a-e2b624c11a9d admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:35.263147 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7d275-66b8-4b85-b78f-25c8d0c84b19 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:35.265546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bcc2d-43db-4b97-941a-e2b624c11a9d admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:35.274793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b91a1-5013-4bb5-b378-3b00019c8c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:35.276222 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b91a1-5013-4bb5-b378-3b00019c8c42 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:35.276970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b91a1-5013-4bb5-b378-3b00019c8c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:35.277642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b91a1-5013-4bb5-b378-3b00019c8c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:35.279549 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b91a1-5013-4bb5-b378-3b00019c8c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:35.282341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b91a1-5013-4bb5-b378-3b00019c8c42 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:35.286789 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0c0b4-9d56-4cb8-b56b-e47fbffeba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:35.288279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0c0b4-9d56-4cb8-b56b-e47fbffeba0c admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:35.288802 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0c0b4-9d56-4cb8-b56b-e47fbffeba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:35.289293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0c0b4-9d56-4cb8-b56b-e47fbffeba0c admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:35.290434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0c0b4-9d56-4cb8-b56b-e47fbffeba0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:35.294344 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0c0b4-9d56-4cb8-b56b-e47fbffeba0c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:35.299003 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1356/2694] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:15:35.303984 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b91a1-5013-4bb5-b378-3b00019c8c42 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:35.333224 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b91a1-5013-4bb5-b378-3b00019c8c42 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:35.362608 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433014e2-bc59-4fca-a677-b69b5644dc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:35.368181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1339/2695] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:15:35 2022] POST /identity/v3/projects => generated 371 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:35.376663 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0c0b4-9d56-4cb8-b56b-e47fbffeba0c admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:35.380412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433014e2-bc59-4fca-a677-b69b5644dc88 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:35.381876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433014e2-bc59-4fca-a677-b69b5644dc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:35.384493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433014e2-bc59-4fca-a677-b69b5644dc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:35.385808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433014e2-bc59-4fca-a677-b69b5644dc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:35.402066 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433014e2-bc59-4fca-a677-b69b5644dc88 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:35.429967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1357/2696] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:15:35.435385 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433014e2-bc59-4fca-a677-b69b5644dc88 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:35.449268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433014e2-bc59-4fca-a677-b69b5644dc88 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:35.538119 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0c0b4-9d56-4cb8-b56b-e47fbffeba0c admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:35.539848 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8857445-fd0f-4b4f-af3a-1d322a9f848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:35.540673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8857445-fd0f-4b4f-af3a-1d322a9f848e admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:35.541044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8857445-fd0f-4b4f-af3a-1d322a9f848e admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:35.541469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8857445-fd0f-4b4f-af3a-1d322a9f848e admin admin] PATH_INFO: `/v3/projects/48e8b95f284642fe991a302d01b23546/users/4aed49c244944762bf8f3c972591962c/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:35.545848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ab0d2-5c67-4cb1-a732-b699cbeb8bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:35.547380 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ab0d2-5c67-4cb1-a732-b699cbeb8bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:35.547380 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ab0d2-5c67-4cb1-a732-b699cbeb8bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:35.547772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ab0d2-5c67-4cb1-a732-b699cbeb8bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:35.548432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ab0d2-5c67-4cb1-a732-b699cbeb8bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:35.551530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ab0d2-5c67-4cb1-a732-b699cbeb8bb7 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:35.564122 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8857445-fd0f-4b4f-af3a-1d322a9f848e admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e8b95f284642fe991a302d01b23546, user_id=4aed49c244944762bf8f3c972591962c, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:35.567583 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8857445-fd0f-4b4f-af3a-1d322a9f848e admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:35.587309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1358/2698] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:15:35 2022] PUT /identity/v3/projects/48e8b95f284642fe991a302d01b23546/users/4aed49c244944762bf8f3c972591962c/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:15:35.588477 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1340/2698] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:15:35 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:35.589793 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ab0d2-5c67-4cb1-a732-b699cbeb8bb7 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:35.593662 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0a6b-7220-4a2a-b323-7ca4a9f76ada None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:35.594465 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0a6b-7220-4a2a-b323-7ca4a9f76ada None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:35.594828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0a6b-7220-4a2a-b323-7ca4a9f76ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:35.596466 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:35.604236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ab0d2-5c67-4cb1-a732-b699cbeb8bb7 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:35.634995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-734d0a6b-7220-4a2a-b323-7ca4a9f76ada None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:35.636278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-734d0a6b-7220-4a2a-b323-7ca4a9f76ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:35.731010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692f084-b41d-423b-b4a9-5d513f74f1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:35.731782 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692f084-b41d-423b-b4a9-5d513f74f1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:35.732072 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692f084-b41d-423b-b4a9-5d513f74f1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:35.732348 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692f084-b41d-423b-b4a9-5d513f74f1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:35.733095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692f084-b41d-423b-b4a9-5d513f74f1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:35.734799 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692f084-b41d-423b-b4a9-5d513f74f1a4 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:35.751505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1341/2699] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:15:35.757858 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692f084-b41d-423b-b4a9-5d513f74f1a4 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:35.772261 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1359/2700] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:35.777010 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692f084-b41d-423b-b4a9-5d513f74f1a4 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:35.786156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16936a0-00e2-4194-bd93-c820baca70aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:35.786645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d0a6b-7220-4a2a-b323-7ca4a9f76ada None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:35.787427 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16936a0-00e2-4194-bd93-c820baca70aa admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:35.788027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16936a0-00e2-4194-bd93-c820baca70aa admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:35.788665 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-734d0a6b-7220-4a2a-b323-7ca4a9f76ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:35.788847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16936a0-00e2-4194-bd93-c820baca70aa admin admin] PATH_INFO: `/v3/projects/5f41db4c7b86402c8c0206e3ad3f499f/users/2415f875231a4e82a516fbc8ab13bb53/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:35.820000 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16936a0-00e2-4194-bd93-c820baca70aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f41db4c7b86402c8c0206e3ad3f499f, user_id=2415f875231a4e82a516fbc8ab13bb53, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:35.824937 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16936a0-00e2-4194-bd93-c820baca70aa admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:35.871808 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1342/2701] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:15:35 2022] PUT /identity/v3/projects/5f41db4c7b86402c8c0206e3ad3f499f/users/2415f875231a4e82a516fbc8ab13bb53/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:15:35.877926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16936a0-00e2-4194-bd93-c820baca70aa admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:35.883672 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:35.915703 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d0a6b-7220-4a2a-b323-7ca4a9f76ada None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:36.031449 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16936a0-00e2-4194-bd93-c820baca70aa admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:36.038932 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9cc3d-8b36-44c7-9bd2-0ebf37f64d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:36.040411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a07ac6-ae09-451a-8c96-2825bcc2ea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:36.041417 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9cc3d-8b36-44c7-9bd2-0ebf37f64d2a service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:36.041623 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a07ac6-ae09-451a-8c96-2825bcc2ea0d admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:36.042106 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a07ac6-ae09-451a-8c96-2825bcc2ea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:36.042574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a07ac6-ae09-451a-8c96-2825bcc2ea0d admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:36.043012 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9cc3d-8b36-44c7-9bd2-0ebf37f64d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:36.043577 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a07ac6-ae09-451a-8c96-2825bcc2ea0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:36.044089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9cc3d-8b36-44c7-9bd2-0ebf37f64d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:36.047011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a07ac6-ae09-451a-8c96-2825bcc2ea0d admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:36.067506 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9cc3d-8b36-44c7-9bd2-0ebf37f64d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:36.069642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9cc3d-8b36-44c7-9bd2-0ebf37f64d2a service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:36.085592 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1360/2702] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:15:36.093382 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1343/2703] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:15:36.099115 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9cc3d-8b36-44c7-9bd2-0ebf37f64d2a service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:36.115705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9cc3d-8b36-44c7-9bd2-0ebf37f64d2a service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:36.124355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc472df-307f-4d7d-91ce-6149a7de03ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:36.125713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc472df-307f-4d7d-91ce-6149a7de03ab admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:36.126349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc472df-307f-4d7d-91ce-6149a7de03ab admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:36.127659 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc472df-307f-4d7d-91ce-6149a7de03ab admin admin] PATH_INFO: `/v3/projects/5f41db4c7b86402c8c0206e3ad3f499f/users/2415f875231a4e82a516fbc8ab13bb53/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:36.132977 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc472df-307f-4d7d-91ce-6149a7de03ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f41db4c7b86402c8c0206e3ad3f499f, user_id=2415f875231a4e82a516fbc8ab13bb53, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:36.138983 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc472df-307f-4d7d-91ce-6149a7de03ab admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:36.168510 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1361/2704] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:15:36 2022] PUT /identity/v3/projects/5f41db4c7b86402c8c0206e3ad3f499f/users/2415f875231a4e82a516fbc8ab13bb53/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:36.188835 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882cb21-32f7-42c0-9d8f-bbc5431ac07e None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:36.189348 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882cb21-32f7-42c0-9d8f-bbc5431ac07e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:36.189699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882cb21-32f7-42c0-9d8f-bbc5431ac07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:36.254650 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-c882cb21-32f7-42c0-9d8f-bbc5431ac07e None None] MFA Rules not processed for user `2415f875231a4e82a516fbc8ab13bb53`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:36.257447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c882cb21-32f7-42c0-9d8f-bbc5431ac07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:36.445464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:36.470134 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1344/2705] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:36.495822 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc472df-307f-4d7d-91ce-6149a7de03ab admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:36.499126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-4dc472df-307f-4d7d-91ce-6149a7de03ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:36.665523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc472df-307f-4d7d-91ce-6149a7de03ab admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:36.674710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cb635-8481-4327-8c4f-3eba110d80f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:36.674710 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cb635-8481-4327-8c4f-3eba110d80f1 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:36.675409 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cb635-8481-4327-8c4f-3eba110d80f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:36.675891 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cb635-8481-4327-8c4f-3eba110d80f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:36.701519 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cb635-8481-4327-8c4f-3eba110d80f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:36.703493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cb635-8481-4327-8c4f-3eba110d80f1 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:36.719346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1362/2706] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:15:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:15:37.562836 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882cb21-32f7-42c0-9d8f-bbc5431ac07e None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:37.723189 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882cb21-32f7-42c0-9d8f-bbc5431ac07e None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:37.730555 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae96b7-2c8a-42cd-89eb-512ce8a1af50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:37.732690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae96b7-2c8a-42cd-89eb-512ce8a1af50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:37.733246 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae96b7-2c8a-42cd-89eb-512ce8a1af50 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:37.733718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae96b7-2c8a-42cd-89eb-512ce8a1af50 admin admin] PATH_INFO: `/v3/users/dd23ac3fec89458d8dc4830ea09f17f6` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:37.735790 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae96b7-2c8a-42cd-89eb-512ce8a1af50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd23ac3fec89458d8dc4830ea09f17f6)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:37.738813 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae96b7-2c8a-42cd-89eb-512ce8a1af50 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:37.880464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-54ae96b7-2c8a-42cd-89eb-512ce8a1af50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd23ac3fec89458d8dc4830ea09f17f6'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:37.882868 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-54ae96b7-2c8a-42cd-89eb-512ce8a1af50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd23ac3fec89458d8dc4830ea09f17f6'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:37.893513 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-54ae96b7-2c8a-42cd-89eb-512ce8a1af50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd23ac3fec89458d8dc4830ea09f17f6'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:37.897234 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-54ae96b7-2c8a-42cd-89eb-512ce8a1af50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd23ac3fec89458d8dc4830ea09f17f6'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:37.934979 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-54ae96b7-2c8a-42cd-89eb-512ce8a1af50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd23ac3fec89458d8dc4830ea09f17f6'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:37.970855 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1345/2707] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:15:37 2022] DELETE /identity/v3/users/dd23ac3fec89458d8dc4830ea09f17f6 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:15:37.975678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e269b1-ac16-4172-8dda-f94b12d856c4 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:37.976457 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e269b1-ac16-4172-8dda-f94b12d856c4 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:37.976457 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e269b1-ac16-4172-8dda-f94b12d856c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:38.024357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-62e269b1-ac16-4172-8dda-f94b12d856c4 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:38.026339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-62e269b1-ac16-4172-8dda-f94b12d856c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:38.177440 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1363/2708] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:38.192274 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae96b7-2c8a-42cd-89eb-512ce8a1af50 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:38.194672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-54ae96b7-2c8a-42cd-89eb-512ce8a1af50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:38.354110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae96b7-2c8a-42cd-89eb-512ce8a1af50 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:38.361221 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88838c99-e293-4bf3-a263-27b50cae5eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:38.362292 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88838c99-e293-4bf3-a263-27b50cae5eca service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:38.362908 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88838c99-e293-4bf3-a263-27b50cae5eca service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:38.363384 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88838c99-e293-4bf3-a263-27b50cae5eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:38.381370 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88838c99-e293-4bf3-a263-27b50cae5eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:38.384333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88838c99-e293-4bf3-a263-27b50cae5eca service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:38.414303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1346/2709] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:15:39.040415 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e269b1-ac16-4172-8dda-f94b12d856c4 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:39.042940 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-62e269b1-ac16-4172-8dda-f94b12d856c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:39.083922 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e269b1-ac16-4172-8dda-f94b12d856c4 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:39.101330 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb3e35-0fd9-4dda-8f44-3366a248a25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:39.102533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb3e35-0fd9-4dda-8f44-3366a248a25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:39.113858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb3e35-0fd9-4dda-8f44-3366a248a25c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:39.113858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb3e35-0fd9-4dda-8f44-3366a248a25c admin admin] PATH_INFO: `/v3/projects/14437a1940564b7fb9c98f4c5b0e37f3` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:39.113858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb3e35-0fd9-4dda-8f44-3366a248a25c admin admin] RBAC: Authorizing `identity:delete_project(project_id=14437a1940564b7fb9c98f4c5b0e37f3)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:39.120745 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb3e35-0fd9-4dda-8f44-3366a248a25c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:39.241891 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:39.297626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-92cb3e35-0fd9-4dda-8f44-3366a248a25c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14437a1940564b7fb9c98f4c5b0e37f3', 'request_id': 'req-92cb3e35-0fd9-4dda-8f44-3366a248a25c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:39.318804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-92cb3e35-0fd9-4dda-8f44-3366a248a25c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14437a1940564b7fb9c98f4c5b0e37f3', 'request_id': 'req-92cb3e35-0fd9-4dda-8f44-3366a248a25c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:39.328934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-92cb3e35-0fd9-4dda-8f44-3366a248a25c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14437a1940564b7fb9c98f4c5b0e37f3', 'request_id': 'req-92cb3e35-0fd9-4dda-8f44-3366a248a25c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:39.384316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-92cb3e35-0fd9-4dda-8f44-3366a248a25c admin admin] The token cache is being invalidate because project 14437a1940564b7fb9c98f4c5b0e37f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:15:39.384846 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-92cb3e35-0fd9-4dda-8f44-3366a248a25c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:39.386134 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-92cb3e35-0fd9-4dda-8f44-3366a248a25c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:39.392213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1364/2710] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:15:39 2022] DELETE /identity/v3/projects/14437a1940564b7fb9c98f4c5b0e37f3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:39.399173 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88838c99-e293-4bf3-a263-27b50cae5eca service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:39.419960 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88838c99-e293-4bf3-a263-27b50cae5eca service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:39.455204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:39.620722 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908ee98-990a-4702-a216-470d0b74e08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:39.621832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908ee98-990a-4702-a216-470d0b74e08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:39.622332 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908ee98-990a-4702-a216-470d0b74e08f admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:39.624411 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908ee98-990a-4702-a216-470d0b74e08f admin admin] PATH_INFO: `/v3/users/2415f875231a4e82a516fbc8ab13bb53` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:39.626696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908ee98-990a-4702-a216-470d0b74e08f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2415f875231a4e82a516fbc8ab13bb53)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:39.631227 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908ee98-990a-4702-a216-470d0b74e08f admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:39.745993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8908ee98-990a-4702-a216-470d0b74e08f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2415f875231a4e82a516fbc8ab13bb53'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:39.748833 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8908ee98-990a-4702-a216-470d0b74e08f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2415f875231a4e82a516fbc8ab13bb53'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:39.770508 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8908ee98-990a-4702-a216-470d0b74e08f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2415f875231a4e82a516fbc8ab13bb53'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:39.772701 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8908ee98-990a-4702-a216-470d0b74e08f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2415f875231a4e82a516fbc8ab13bb53'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:39.789335 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8908ee98-990a-4702-a216-470d0b74e08f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2415f875231a4e82a516fbc8ab13bb53'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:39.822226 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1347/2711] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:15:39 2022] DELETE /identity/v3/users/2415f875231a4e82a516fbc8ab13bb53 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:40.571336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb3e35-0fd9-4dda-8f44-3366a248a25c admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:40.573341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-92cb3e35-0fd9-4dda-8f44-3366a248a25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:40.601131 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb3e35-0fd9-4dda-8f44-3366a248a25c admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:40.801874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03eec08-68fa-435f-966b-1ebf90c20831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:40.805363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03eec08-68fa-435f-966b-1ebf90c20831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:40.805363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03eec08-68fa-435f-966b-1ebf90c20831 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:40.805363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03eec08-68fa-435f-966b-1ebf90c20831 admin admin] PATH_INFO: `/v3/projects/5f41db4c7b86402c8c0206e3ad3f499f` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:40.805654 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03eec08-68fa-435f-966b-1ebf90c20831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f41db4c7b86402c8c0206e3ad3f499f)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:40.808175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03eec08-68fa-435f-966b-1ebf90c20831 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:40.918105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e03eec08-68fa-435f-966b-1ebf90c20831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f41db4c7b86402c8c0206e3ad3f499f', 'request_id': 'req-e03eec08-68fa-435f-966b-1ebf90c20831'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:40.930096 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e03eec08-68fa-435f-966b-1ebf90c20831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f41db4c7b86402c8c0206e3ad3f499f', 'request_id': 'req-e03eec08-68fa-435f-966b-1ebf90c20831'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:40.949709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e03eec08-68fa-435f-966b-1ebf90c20831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f41db4c7b86402c8c0206e3ad3f499f', 'request_id': 'req-e03eec08-68fa-435f-966b-1ebf90c20831'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:40.978663 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e03eec08-68fa-435f-966b-1ebf90c20831 admin admin] The token cache is being invalidate because project 5f41db4c7b86402c8c0206e3ad3f499f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:15:40.979263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e03eec08-68fa-435f-966b-1ebf90c20831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:40.980080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e03eec08-68fa-435f-966b-1ebf90c20831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:40.982495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1365/2712] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:15:40 2022] DELETE /identity/v3/projects/5f41db4c7b86402c8c0206e3ad3f499f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:40.990535 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae64b96-8ad0-4fbf-a2b8-902081832c40 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:40.991080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae64b96-8ad0-4fbf-a2b8-902081832c40 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:40.991505 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae64b96-8ad0-4fbf-a2b8-902081832c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:41.044865 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-2ae64b96-8ad0-4fbf-a2b8-902081832c40 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:41.046838 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-2ae64b96-8ad0-4fbf-a2b8-902081832c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:41.200204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1348/2713] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:41.210347 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adabda-c576-470b-8d68-a648bfb9670a None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:41.211074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adabda-c576-470b-8d68-a648bfb9670a None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:41.211693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adabda-c576-470b-8d68-a648bfb9670a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:41.237500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-c4adabda-c576-470b-8d68-a648bfb9670a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:41.240031 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c4adabda-c576-470b-8d68-a648bfb9670a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:41.274010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1366/2714] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:41.276197 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae64b96-8ad0-4fbf-a2b8-902081832c40 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:41.293702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae64b96-8ad0-4fbf-a2b8-902081832c40 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:41.304333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d6b4-a778-49ef-8d2b-c5c4b2363b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:41.304333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d6b4-a778-49ef-8d2b-c5c4b2363b61 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:41.304333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d6b4-a778-49ef-8d2b-c5c4b2363b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:41.304333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d6b4-a778-49ef-8d2b-c5c4b2363b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:41.306815 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978d6b4-a778-49ef-8d2b-c5c4b2363b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:15:41.307416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978d6b4-a778-49ef-8d2b-c5c4b2363b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:41.310936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978d6b4-a778-49ef-8d2b-c5c4b2363b61 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:41.346006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1349/2715] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:15:41.347417 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adabda-c576-470b-8d68-a648bfb9670a None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:41.360875 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adabda-c576-470b-8d68-a648bfb9670a None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:41.367648 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5722c-6776-468f-9eac-ad01726787ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:41.368524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5722c-6776-468f-9eac-ad01726787ad admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:41.368995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5722c-6776-468f-9eac-ad01726787ad admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:41.369622 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5722c-6776-468f-9eac-ad01726787ad admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:41.370839 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5722c-6776-468f-9eac-ad01726787ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:41.373166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5722c-6776-468f-9eac-ad01726787ad admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:41.436781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1367/2716] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:15:41 2022] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:41.438360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d6b4-a778-49ef-8d2b-c5c4b2363b61 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:41.464461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d6b4-a778-49ef-8d2b-c5c4b2363b61 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:41.526348 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:41.674212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15ce0b-a75f-4ff0-a18d-9b0a1248777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:41.675339 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15ce0b-a75f-4ff0-a18d-9b0a1248777a admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:41.676565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15ce0b-a75f-4ff0-a18d-9b0a1248777a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:41.677146 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15ce0b-a75f-4ff0-a18d-9b0a1248777a admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:41.678042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15ce0b-a75f-4ff0-a18d-9b0a1248777a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:41.680611 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15ce0b-a75f-4ff0-a18d-9b0a1248777a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:41.721567 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1350/2717] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:15:41 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:41.722288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5722c-6776-468f-9eac-ad01726787ad admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:41.761651 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5722c-6776-468f-9eac-ad01726787ad admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:41.784348 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f3b18-730f-4c63-8e66-90bd1ddbd77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:41.785457 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f3b18-730f-4c63-8e66-90bd1ddbd77a admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:41.785911 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f3b18-730f-4c63-8e66-90bd1ddbd77a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:41.786336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f3b18-730f-4c63-8e66-90bd1ddbd77a admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:41.787783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f3b18-730f-4c63-8e66-90bd1ddbd77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:41.790487 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f3b18-730f-4c63-8e66-90bd1ddbd77a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:41.839906 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1368/2718] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:15:41.847807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15ce0b-a75f-4ff0-a18d-9b0a1248777a admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:41.868222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15ce0b-a75f-4ff0-a18d-9b0a1248777a admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:41.883050 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a87e26-e30b-4e88-98c7-eb49fd88727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:41.884674 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a87e26-e30b-4e88-98c7-eb49fd88727b admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:41.885522 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a87e26-e30b-4e88-98c7-eb49fd88727b admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:41.887309 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a87e26-e30b-4e88-98c7-eb49fd88727b admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:41.892968 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a87e26-e30b-4e88-98c7-eb49fd88727b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:41.897925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a87e26-e30b-4e88-98c7-eb49fd88727b admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:41.942077 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1351/2719] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:15:41.945645 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f3b18-730f-4c63-8e66-90bd1ddbd77a admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:41.953322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:41.970179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f3b18-730f-4c63-8e66-90bd1ddbd77a admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:41.985561 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f603c-04d2-49dc-b05e-9fe4bb73e438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:41.986530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f603c-04d2-49dc-b05e-9fe4bb73e438 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:41.987016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f603c-04d2-49dc-b05e-9fe4bb73e438 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:41.987496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f603c-04d2-49dc-b05e-9fe4bb73e438 admin admin] PATH_INFO: `/v3/projects/1c8e56eae51f4d489f54c39e13be8d85/users/7678e97a1da24777abc9d61f35107372/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:42.022313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f603c-04d2-49dc-b05e-9fe4bb73e438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8e56eae51f4d489f54c39e13be8d85, user_id=7678e97a1da24777abc9d61f35107372, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:42.028170 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f603c-04d2-49dc-b05e-9fe4bb73e438 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:42.064755 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1369/2720] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:15:41 2022] PUT /identity/v3/projects/1c8e56eae51f4d489f54c39e13be8d85/users/7678e97a1da24777abc9d61f35107372/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:15:42.078054 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac698cf-cc4b-4af6-9098-1ba751378880 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:42.079551 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac698cf-cc4b-4af6-9098-1ba751378880 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:42.080634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac698cf-cc4b-4af6-9098-1ba751378880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:42.152308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-aac698cf-cc4b-4af6-9098-1ba751378880 None None] MFA Rules not processed for user `7678e97a1da24777abc9d61f35107372`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:42.155720 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-aac698cf-cc4b-4af6-9098-1ba751378880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:42.270475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf0675-4e72-4953-839f-ec7eab63ce62 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:42.270878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf0675-4e72-4953-839f-ec7eab63ce62 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:42.271238 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf0675-4e72-4953-839f-ec7eab63ce62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:42.319339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-59bf0675-4e72-4953-839f-ec7eab63ce62 None None] MFA Rules not processed for user `f9201e76ffb045d099f765f4105354fb`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:42.321971 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-59bf0675-4e72-4953-839f-ec7eab63ce62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:42.377604 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1352/2721] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:42.379317 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac698cf-cc4b-4af6-9098-1ba751378880 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:42.475948 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1370/2722] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:42.584999 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac698cf-cc4b-4af6-9098-1ba751378880 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:42.594555 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3f48e-8ef6-4e6c-994a-febd282a696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:42.595589 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3f48e-8ef6-4e6c-994a-febd282a696c admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:42.596057 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3f48e-8ef6-4e6c-994a-febd282a696c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:42.596558 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3f48e-8ef6-4e6c-994a-febd282a696c admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:42.598386 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3f48e-8ef6-4e6c-994a-febd282a696c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:42.602120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3f48e-8ef6-4e6c-994a-febd282a696c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:42.668237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf0675-4e72-4953-839f-ec7eab63ce62 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:42.670457 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1353/2723] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:15:42 2022] POST /identity/v3/projects => generated 381 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:42.700320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf0675-4e72-4953-839f-ec7eab63ce62 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:42.818285 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d730a-21b5-48b4-ad6c-22c11499266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:42.820336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d730a-21b5-48b4-ad6c-22c11499266a admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:42.820336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d730a-21b5-48b4-ad6c-22c11499266a admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:42.820705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d730a-21b5-48b4-ad6c-22c11499266a admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:42.821498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d730a-21b5-48b4-ad6c-22c11499266a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:42.824173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d730a-21b5-48b4-ad6c-22c11499266a admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:42.871562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1371/2724] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:15:42 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:42.873535 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3f48e-8ef6-4e6c-994a-febd282a696c admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:42.897361 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3f48e-8ef6-4e6c-994a-febd282a696c admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:42.906469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38f9e4-5256-4d24-85d4-d55a974fa1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:42.907671 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38f9e4-5256-4d24-85d4-d55a974fa1dd admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:42.908241 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38f9e4-5256-4d24-85d4-d55a974fa1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:42.908841 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38f9e4-5256-4d24-85d4-d55a974fa1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:42.910897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38f9e4-5256-4d24-85d4-d55a974fa1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:42.914708 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38f9e4-5256-4d24-85d4-d55a974fa1dd admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:42.947848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1354/2725] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:15:42.951870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d730a-21b5-48b4-ad6c-22c11499266a admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:42.978505 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d730a-21b5-48b4-ad6c-22c11499266a admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:42.985466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f6ad5-c456-45c1-a9f4-acc0b8c65755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:42.986543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f6ad5-c456-45c1-a9f4-acc0b8c65755 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:42.987174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f6ad5-c456-45c1-a9f4-acc0b8c65755 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:42.987744 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f6ad5-c456-45c1-a9f4-acc0b8c65755 admin admin] PATH_INFO: `/v3/projects/4c8bc58a08fc40188992e9ac8e990d13/users/5f913c3f0fd34100aa15c01e1ce01221/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:43.010279 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f6ad5-c456-45c1-a9f4-acc0b8c65755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8bc58a08fc40188992e9ac8e990d13, user_id=5f913c3f0fd34100aa15c01e1ce01221, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:43.014217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f6ad5-c456-45c1-a9f4-acc0b8c65755 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:43.038197 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1372/2726] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:15:42 2022] PUT /identity/v3/projects/4c8bc58a08fc40188992e9ac8e990d13/users/5f913c3f0fd34100aa15c01e1ce01221/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:43.042458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38f9e4-5256-4d24-85d4-d55a974fa1dd admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:43.057267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38f9e4-5256-4d24-85d4-d55a974fa1dd admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:43.062666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:43.141473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497119c-8f28-4763-bb7a-c7f890f9022c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:43.142164 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497119c-8f28-4763-bb7a-c7f890f9022c admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:43.142896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497119c-8f28-4763-bb7a-c7f890f9022c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:43.142896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497119c-8f28-4763-bb7a-c7f890f9022c admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:43.143655 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497119c-8f28-4763-bb7a-c7f890f9022c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:43.146178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497119c-8f28-4763-bb7a-c7f890f9022c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:43.164295 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1355/2727] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:15:43.165705 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f6ad5-c456-45c1-a9f4-acc0b8c65755 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:43.181938 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f6ad5-c456-45c1-a9f4-acc0b8c65755 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:43.188245 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f0d41-c898-49d0-964a-f542fa41b254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:43.189000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f0d41-c898-49d0-964a-f542fa41b254 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:43.189970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f0d41-c898-49d0-964a-f542fa41b254 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:43.190390 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f0d41-c898-49d0-964a-f542fa41b254 admin admin] PATH_INFO: `/v3/projects/4c8bc58a08fc40188992e9ac8e990d13/users/5f913c3f0fd34100aa15c01e1ce01221/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:43.193144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f0d41-c898-49d0-964a-f542fa41b254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8bc58a08fc40188992e9ac8e990d13, user_id=5f913c3f0fd34100aa15c01e1ce01221, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:43.195935 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f0d41-c898-49d0-964a-f542fa41b254 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:43.214001 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1373/2728] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:15:43 2022] PUT /identity/v3/projects/4c8bc58a08fc40188992e9ac8e990d13/users/5f913c3f0fd34100aa15c01e1ce01221/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:15:43.228602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84ba62-db1f-44f4-a8df-bb1e97286720 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:43.229501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84ba62-db1f-44f4-a8df-bb1e97286720 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:43.230267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84ba62-db1f-44f4-a8df-bb1e97286720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:43.290279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ba84ba62-db1f-44f4-a8df-bb1e97286720 None None] MFA Rules not processed for user `5f913c3f0fd34100aa15c01e1ce01221`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:43.292610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ba84ba62-db1f-44f4-a8df-bb1e97286720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:43.405686 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1356/2729] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:15:43.422043 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f0d41-c898-49d0-964a-f542fa41b254 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:43.425101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b82f0d41-c898-49d0-964a-f542fa41b254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:43.484345 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:43.509338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f0d41-c898-49d0-964a-f542fa41b254 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:43.516475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ff086-77f9-48a9-b2d7-7331435b6ab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:43.517713 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ff086-77f9-48a9-b2d7-7331435b6ab8 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:43.518302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ff086-77f9-48a9-b2d7-7331435b6ab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:43.518302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ff086-77f9-48a9-b2d7-7331435b6ab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:43.531832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ff086-77f9-48a9-b2d7-7331435b6ab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:43.533579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ff086-77f9-48a9-b2d7-7331435b6ab8 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:43.547106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1374/2730] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:15:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:15:44.193229 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84ba62-db1f-44f4-a8df-bb1e97286720 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:44.211199 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84ba62-db1f-44f4-a8df-bb1e97286720 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:44.217527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7df006-6000-4a53-86a6-0032226c2b96 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f913c3f0fd34100aa15c01e1ce01221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c8bc58a08fc40188992e9ac8e990d13', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:44.218193 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7df006-6000-4a53-86a6-0032226c2b96 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:44.218478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7df006-6000-4a53-86a6-0032226c2b96 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:44.219388 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7df006-6000-4a53-86a6-0032226c2b96 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:44.219508 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7df006-6000-4a53-86a6-0032226c2b96 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:15:44.219726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7df006-6000-4a53-86a6-0032226c2b96 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:44.221459 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7df006-6000-4a53-86a6-0032226c2b96 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:44.235993 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1357/2731] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:15:44.242961 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ff086-77f9-48a9-b2d7-7331435b6ab8 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:44.243474 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6060ff-9343-49fb-9616-d7e5b5652541 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:44.243474 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6060ff-9343-49fb-9616-d7e5b5652541 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:44.243474 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6060ff-9343-49fb-9616-d7e5b5652541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:44.261860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ff086-77f9-48a9-b2d7-7331435b6ab8 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:44.270426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56a2c8-a3da-4eac-9598-e4f1e73281f7 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f913c3f0fd34100aa15c01e1ce01221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c8bc58a08fc40188992e9ac8e990d13', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:44.271492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a2c8-a3da-4eac-9598-e4f1e73281f7 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:44.272258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a2c8-a3da-4eac-9598-e4f1e73281f7 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:44.272814 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a2c8-a3da-4eac-9598-e4f1e73281f7 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:44.274027 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56a2c8-a3da-4eac-9598-e4f1e73281f7 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:44.278050 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56a2c8-a3da-4eac-9598-e4f1e73281f7 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:44.287115 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-4f6060ff-9343-49fb-9616-d7e5b5652541 None None] MFA Rules not processed for user `4aed49c244944762bf8f3c972591962c`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:44.288691 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4f6060ff-9343-49fb-9616-d7e5b5652541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:44.315054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1375/2732] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:15:44 2022] POST /identity/v3/projects => generated 354 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:44.320596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56a2c8-a3da-4eac-9598-e4f1e73281f7 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:44.406872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1358/2733] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:15:44.425302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6060ff-9343-49fb-9616-d7e5b5652541 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:44.431276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4f6060ff-9343-49fb-9616-d7e5b5652541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:44.435080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56a2c8-a3da-4eac-9598-e4f1e73281f7 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:44.442755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:44.453150 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a269bdb-539c-4862-b1bc-124102bdb721 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f913c3f0fd34100aa15c01e1ce01221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c8bc58a08fc40188992e9ac8e990d13', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:44.454313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a269bdb-539c-4862-b1bc-124102bdb721 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:44.454539 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a269bdb-539c-4862-b1bc-124102bdb721 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:44.454905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a269bdb-539c-4862-b1bc-124102bdb721 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:44.455712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a269bdb-539c-4862-b1bc-124102bdb721 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:15:44.456346 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a269bdb-539c-4862-b1bc-124102bdb721 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:44.461701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a269bdb-539c-4862-b1bc-124102bdb721 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:44.498113 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1376/2734] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:15:44.547017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a269bdb-539c-4862-b1bc-124102bdb721 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:44.559655 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a269bdb-539c-4862-b1bc-124102bdb721 tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:44.587360 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f913c3f0fd34100aa15c01e1ce01221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c8bc58a08fc40188992e9ac8e990d13', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:44.588657 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:44.592258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:44.592858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] PATH_INFO: `/v3/projects/16ea3f57aebd4502a164f4438993e898` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:44.595254 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] RBAC: Authorizing `identity:delete_project(project_id=16ea3f57aebd4502a164f4438993e898)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:44.599122 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:44.618386 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6060ff-9343-49fb-9616-d7e5b5652541 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:44.726129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ea3f57aebd4502a164f4438993e898', 'request_id': 'req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:44.736954 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ea3f57aebd4502a164f4438993e898', 'request_id': 'req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:44.739226 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29697c83-66c2-4391-a225-31196d15bb89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:44.739977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29697c83-66c2-4391-a225-31196d15bb89 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:44.744521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29697c83-66c2-4391-a225-31196d15bb89 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:44.745042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29697c83-66c2-4391-a225-31196d15bb89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:44.747092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ea3f57aebd4502a164f4438993e898', 'request_id': 'req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:44.771616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] The token cache is being invalidate because project 16ea3f57aebd4502a164f4438993e898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:15:44.772189 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:44.773241 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:44.775624 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1377/2735] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:15:44 2022] DELETE /identity/v3/projects/16ea3f57aebd4502a164f4438993e898 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:44.860357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29697c83-66c2-4391-a225-31196d15bb89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:44.862435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29697c83-66c2-4391-a225-31196d15bb89 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:44.881448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1359/2736] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:15:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:15:45.126570 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:45.129542 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:45.228529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:45.278246 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348e0e5-81e2-4896-ba8a-2a9ac4f0c62f tempest-VolumeQuotaClassesTest-1597788444 tempest-VolumeQuotaClassesTest-1597788444-project-admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:45.290999 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5728a-d44c-40e2-889d-326c937e2b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:45.295558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5728a-d44c-40e2-889d-326c937e2b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:45.295558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5728a-d44c-40e2-889d-326c937e2b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:45.295558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5728a-d44c-40e2-889d-326c937e2b22 admin admin] PATH_INFO: `/v3/users/7678e97a1da24777abc9d61f35107372` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:45.298363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5728a-d44c-40e2-889d-326c937e2b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7678e97a1da24777abc9d61f35107372)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:45.298891 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5728a-d44c-40e2-889d-326c937e2b22 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:45.386079 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7be5728a-d44c-40e2-889d-326c937e2b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7678e97a1da24777abc9d61f35107372'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:45.387309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7be5728a-d44c-40e2-889d-326c937e2b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7678e97a1da24777abc9d61f35107372'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:45.399495 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7be5728a-d44c-40e2-889d-326c937e2b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7678e97a1da24777abc9d61f35107372'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:45.433594 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7be5728a-d44c-40e2-889d-326c937e2b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7678e97a1da24777abc9d61f35107372'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:45.453513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-7be5728a-d44c-40e2-889d-326c937e2b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7678e97a1da24777abc9d61f35107372'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:45.467317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1378/2737] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:15:45 2022] DELETE /identity/v3/users/7678e97a1da24777abc9d61f35107372 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:15:45.472129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70132168-70e9-430f-b538-07ac50d97274 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:45.472129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70132168-70e9-430f-b538-07ac50d97274 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:45.473553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70132168-70e9-430f-b538-07ac50d97274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:45.512469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-70132168-70e9-430f-b538-07ac50d97274 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:45.515152 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-70132168-70e9-430f-b538-07ac50d97274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:45.599555 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:45.666854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1360/2738] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:45.682276 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5728a-d44c-40e2-889d-326c937e2b22 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:45.684701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-7be5728a-d44c-40e2-889d-326c937e2b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:45.837108 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5728a-d44c-40e2-889d-326c937e2b22 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:45.847038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940c3ba-025e-4163-a382-97cb93653197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:45.849843 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940c3ba-025e-4163-a382-97cb93653197 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:45.850457 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940c3ba-025e-4163-a382-97cb93653197 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:45.850986 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940c3ba-025e-4163-a382-97cb93653197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:45.870764 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940c3ba-025e-4163-a382-97cb93653197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:45.874980 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940c3ba-025e-4163-a382-97cb93653197 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:45.917100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1379/2739] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:15:46.091713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f7c7f-5c44-4d64-97b3-737fc9a921fb None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:46.092476 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f7c7f-5c44-4d64-97b3-737fc9a921fb None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:46.092984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f7c7f-5c44-4d64-97b3-737fc9a921fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:46.125191 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-509f7c7f-5c44-4d64-97b3-737fc9a921fb None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:46.126690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-509f7c7f-5c44-4d64-97b3-737fc9a921fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:46.351434 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1361/2740] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Sep 7 13:15:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:46.377709 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940c3ba-025e-4163-a382-97cb93653197 service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:46.381369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6940c3ba-025e-4163-a382-97cb93653197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:46.518551 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:46.565955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940c3ba-025e-4163-a382-97cb93653197 service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:46.578558 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139a077-ee60-4965-9a98-bb0d7a885548 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:46.580808 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a077-ee60-4965-9a98-bb0d7a885548 service swift] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:46.581810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a077-ee60-4965-9a98-bb0d7a885548 service swift] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:46.582529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a077-ee60-4965-9a98-bb0d7a885548 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:46.597463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139a077-ee60-4965-9a98-bb0d7a885548 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:46.600204 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139a077-ee60-4965-9a98-bb0d7a885548 service swift] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:46.620867 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1380/2741] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:15:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 13:15:47.730353 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f7c7f-5c44-4d64-97b3-737fc9a921fb None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:47.731884 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-509f7c7f-5c44-4d64-97b3-737fc9a921fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:47.774573 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f7c7f-5c44-4d64-97b3-737fc9a921fb None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:47.807166 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4847ea9-de31-4db4-af9e-8e3033ac32d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:47.809121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4847ea9-de31-4db4-af9e-8e3033ac32d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:47.809840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4847ea9-de31-4db4-af9e-8e3033ac32d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:47.810329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4847ea9-de31-4db4-af9e-8e3033ac32d3 admin admin] PATH_INFO: `/v3/projects/1c8e56eae51f4d489f54c39e13be8d85` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:47.814955 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4847ea9-de31-4db4-af9e-8e3033ac32d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8e56eae51f4d489f54c39e13be8d85)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:47.827684 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4847ea9-de31-4db4-af9e-8e3033ac32d3 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:48.096787 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b4847ea9-de31-4db4-af9e-8e3033ac32d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8e56eae51f4d489f54c39e13be8d85', 'request_id': 'req-b4847ea9-de31-4db4-af9e-8e3033ac32d3'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:48.122725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b4847ea9-de31-4db4-af9e-8e3033ac32d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8e56eae51f4d489f54c39e13be8d85', 'request_id': 'req-b4847ea9-de31-4db4-af9e-8e3033ac32d3'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:48.135865 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b4847ea9-de31-4db4-af9e-8e3033ac32d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8e56eae51f4d489f54c39e13be8d85', 'request_id': 'req-b4847ea9-de31-4db4-af9e-8e3033ac32d3'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:48.154622 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b4847ea9-de31-4db4-af9e-8e3033ac32d3 admin admin] The token cache is being invalidate because project 1c8e56eae51f4d489f54c39e13be8d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:15:48.154962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b4847ea9-de31-4db4-af9e-8e3033ac32d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:48.155699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-b4847ea9-de31-4db4-af9e-8e3033ac32d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:48.158630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1362/2742] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:15:47 2022] DELETE /identity/v3/projects/1c8e56eae51f4d489f54c39e13be8d85 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:48.163453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139a077-ee60-4965-9a98-bb0d7a885548 service swift] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:48.192499 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139a077-ee60-4965-9a98-bb0d7a885548 service swift] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:48.529647 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306a443-46ca-44a5-b7e1-1f45b31255a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:48.530881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306a443-46ca-44a5-b7e1-1f45b31255a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:48.534878 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306a443-46ca-44a5-b7e1-1f45b31255a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:48.535431 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306a443-46ca-44a5-b7e1-1f45b31255a8 admin admin] PATH_INFO: `/v3/users/5f913c3f0fd34100aa15c01e1ce01221` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:48.541741 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306a443-46ca-44a5-b7e1-1f45b31255a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f913c3f0fd34100aa15c01e1ce01221)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:48.545844 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306a443-46ca-44a5-b7e1-1f45b31255a8 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:48.708220 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6306a443-46ca-44a5-b7e1-1f45b31255a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f913c3f0fd34100aa15c01e1ce01221'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:48.709046 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6306a443-46ca-44a5-b7e1-1f45b31255a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f913c3f0fd34100aa15c01e1ce01221'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:48.729155 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6306a443-46ca-44a5-b7e1-1f45b31255a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f913c3f0fd34100aa15c01e1ce01221'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:48.762272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6306a443-46ca-44a5-b7e1-1f45b31255a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f913c3f0fd34100aa15c01e1ce01221'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:48.783322 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6306a443-46ca-44a5-b7e1-1f45b31255a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f913c3f0fd34100aa15c01e1ce01221'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:48.794136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1381/2743] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:15:48 2022] DELETE /identity/v3/users/5f913c3f0fd34100aa15c01e1ce01221 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:49.578548 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9bc5d-7424-4ebf-bdcc-b386ba77a000 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:49.579097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9bc5d-7424-4ebf-bdcc-b386ba77a000 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:49.579097 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9bc5d-7424-4ebf-bdcc-b386ba77a000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:49.657688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-5eb9bc5d-7424-4ebf-bdcc-b386ba77a000 None None] MFA Rules not processed for user `4aed49c244944762bf8f3c972591962c`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:49.662867 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-5eb9bc5d-7424-4ebf-bdcc-b386ba77a000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:49.853155 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1363/2744] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:51.311106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306a443-46ca-44a5-b7e1-1f45b31255a8 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:51.314643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6306a443-46ca-44a5-b7e1-1f45b31255a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:51.509332 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306a443-46ca-44a5-b7e1-1f45b31255a8 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:51.521257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925620c-388b-4189-bff8-2c84482e2e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:51.522178 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925620c-388b-4189-bff8-2c84482e2e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:51.522546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925620c-388b-4189-bff8-2c84482e2e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:51.522944 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925620c-388b-4189-bff8-2c84482e2e9e admin admin] PATH_INFO: `/v3/projects/4c8bc58a08fc40188992e9ac8e990d13` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:51.525492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925620c-388b-4189-bff8-2c84482e2e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c8bc58a08fc40188992e9ac8e990d13)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:51.531643 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925620c-388b-4189-bff8-2c84482e2e9e admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:51.551058 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:51.654285 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1925620c-388b-4189-bff8-2c84482e2e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c8bc58a08fc40188992e9ac8e990d13', 'request_id': 'req-1925620c-388b-4189-bff8-2c84482e2e9e'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:51.669769 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1925620c-388b-4189-bff8-2c84482e2e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c8bc58a08fc40188992e9ac8e990d13', 'request_id': 'req-1925620c-388b-4189-bff8-2c84482e2e9e'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:51.682196 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1925620c-388b-4189-bff8-2c84482e2e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c8bc58a08fc40188992e9ac8e990d13', 'request_id': 'req-1925620c-388b-4189-bff8-2c84482e2e9e'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:51.713357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1925620c-388b-4189-bff8-2c84482e2e9e admin admin] The token cache is being invalidate because project 4c8bc58a08fc40188992e9ac8e990d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:15:51.713767 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1925620c-388b-4189-bff8-2c84482e2e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:51.714994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1925620c-388b-4189-bff8-2c84482e2e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:51.718681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1382/2745] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:15:51 2022] DELETE /identity/v3/projects/4c8bc58a08fc40188992e9ac8e990d13 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:51.725677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a02c6-b01c-4fab-9ce9-6244524f88c2 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:51.726305 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a02c6-b01c-4fab-9ce9-6244524f88c2 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:51.726305 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a02c6-b01c-4fab-9ce9-6244524f88c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:51.757507 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ca0a02c6-b01c-4fab-9ce9-6244524f88c2 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:51.759566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ca0a02c6-b01c-4fab-9ce9-6244524f88c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:51.773016 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:51.905342 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1364/2746] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:51.914789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3ad29-6227-4247-b207-4770efbb650c None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:51.916259 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3ad29-6227-4247-b207-4770efbb650c None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:51.916879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3ad29-6227-4247-b207-4770efbb650c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:51.980497 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-b4e3ad29-6227-4247-b207-4770efbb650c None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:51.986001 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b4e3ad29-6227-4247-b207-4770efbb650c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:52.021933 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1383/2747] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:52.026256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a02c6-b01c-4fab-9ce9-6244524f88c2 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:52.059273 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a02c6-b01c-4fab-9ce9-6244524f88c2 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:52.068249 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dad6f3-809a-42e7-8bca-81c6935f1461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:52.069624 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dad6f3-809a-42e7-8bca-81c6935f1461 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:52.070555 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dad6f3-809a-42e7-8bca-81c6935f1461 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:52.071610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dad6f3-809a-42e7-8bca-81c6935f1461 admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:52.072769 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dad6f3-809a-42e7-8bca-81c6935f1461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:15:52.073398 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dad6f3-809a-42e7-8bca-81c6935f1461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:52.077386 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dad6f3-809a-42e7-8bca-81c6935f1461 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:52.096200 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1365/2748] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:15:52.100432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3ad29-6227-4247-b207-4770efbb650c None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:52.123125 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3ad29-6227-4247-b207-4770efbb650c None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:52.128693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b30869-b06b-4bc3-b7b6-8bfd21a6f008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:52.129389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b30869-b06b-4bc3-b7b6-8bfd21a6f008 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:52.129618 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b30869-b06b-4bc3-b7b6-8bfd21a6f008 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:52.129894 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b30869-b06b-4bc3-b7b6-8bfd21a6f008 admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:52.140853 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b30869-b06b-4bc3-b7b6-8bfd21a6f008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:52.143448 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b30869-b06b-4bc3-b7b6-8bfd21a6f008 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:52.205665 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1384/2749] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:15:52 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:52.213596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dad6f3-809a-42e7-8bca-81c6935f1461 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:52.236914 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dad6f3-809a-42e7-8bca-81c6935f1461 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:52.424801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee84a64-dcb8-47dd-b725-20e9c43e18d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:52.432435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee84a64-dcb8-47dd-b725-20e9c43e18d1 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:52.433919 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee84a64-dcb8-47dd-b725-20e9c43e18d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:52.435079 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee84a64-dcb8-47dd-b725-20e9c43e18d1 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:52.439095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee84a64-dcb8-47dd-b725-20e9c43e18d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:52.452158 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee84a64-dcb8-47dd-b725-20e9c43e18d1 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:52.520441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1366/2750] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:15:52 2022] POST /identity/v3/users => generated 289 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:52.526299 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b30869-b06b-4bc3-b7b6-8bfd21a6f008 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:52.553412 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b30869-b06b-4bc3-b7b6-8bfd21a6f008 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:52.576914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671b93c-9b57-4587-bc9d-60cb50d85fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:52.579876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671b93c-9b57-4587-bc9d-60cb50d85fea admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:52.581379 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671b93c-9b57-4587-bc9d-60cb50d85fea admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:52.583914 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671b93c-9b57-4587-bc9d-60cb50d85fea admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:52.586476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671b93c-9b57-4587-bc9d-60cb50d85fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:52.593085 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671b93c-9b57-4587-bc9d-60cb50d85fea admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:52.651667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1385/2751] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:15:52.659195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee84a64-dcb8-47dd-b725-20e9c43e18d1 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:52.700882 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee84a64-dcb8-47dd-b725-20e9c43e18d1 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:52.718452 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31049446-34ec-4bc4-bb98-6bbb524fedba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:52.721396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31049446-34ec-4bc4-bb98-6bbb524fedba admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:52.721747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31049446-34ec-4bc4-bb98-6bbb524fedba admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:52.724458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31049446-34ec-4bc4-bb98-6bbb524fedba admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:52.725255 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31049446-34ec-4bc4-bb98-6bbb524fedba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:52.729962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31049446-34ec-4bc4-bb98-6bbb524fedba admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:52.749261 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1367/2752] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:15:52.755257 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671b93c-9b57-4587-bc9d-60cb50d85fea admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:52.771665 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671b93c-9b57-4587-bc9d-60cb50d85fea admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:52.783749 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06cc17-22da-402d-9158-d97b22095a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:52.784694 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06cc17-22da-402d-9158-d97b22095a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:52.785055 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06cc17-22da-402d-9158-d97b22095a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:52.786716 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06cc17-22da-402d-9158-d97b22095a90 admin admin] PATH_INFO: `/v3/projects/32ba6066ad1e426789d0d6b5cf696213/users/46010b32d91d451e9ca9afe35fa9f6c4/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:53.092838 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06cc17-22da-402d-9158-d97b22095a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ba6066ad1e426789d0d6b5cf696213, user_id=46010b32d91d451e9ca9afe35fa9f6c4, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:53.098959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06cc17-22da-402d-9158-d97b22095a90 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:53.131869 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1386/2753] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:15:52 2022] PUT /identity/v3/projects/32ba6066ad1e426789d0d6b5cf696213/users/46010b32d91d451e9ca9afe35fa9f6c4/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:53.143966 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1d6a8-c05d-45b6-9bbd-eeba3f11a636 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:53.144616 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1d6a8-c05d-45b6-9bbd-eeba3f11a636 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:53.145133 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1d6a8-c05d-45b6-9bbd-eeba3f11a636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:53.231882 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-c1f1d6a8-c05d-45b6-9bbd-eeba3f11a636 None None] MFA Rules not processed for user `46010b32d91d451e9ca9afe35fa9f6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:53.234668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c1f1d6a8-c05d-45b6-9bbd-eeba3f11a636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:53.436576 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1368/2754] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:15:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:15:53.451005 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06cc17-22da-402d-9158-d97b22095a90 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:53.452928 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-fb06cc17-22da-402d-9158-d97b22095a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:53.559357 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06cc17-22da-402d-9158-d97b22095a90 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:53.566267 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36776a-5a16-4889-9cf7-a604847121fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f332ac2346f0444a8d336ed2b3121be2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:53.567696 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36776a-5a16-4889-9cf7-a604847121fc service glance] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:53.568219 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36776a-5a16-4889-9cf7-a604847121fc service glance] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:53.568686 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36776a-5a16-4889-9cf7-a604847121fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:53.589554 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36776a-5a16-4889-9cf7-a604847121fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:53.592568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36776a-5a16-4889-9cf7-a604847121fc service glance] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:53.605038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1387/2755] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:15:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:16:03.430722 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:03.599477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:10.291792 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1d6a8-c05d-45b6-9bbd-eeba3f11a636 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:10.293346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c1f1d6a8-c05d-45b6-9bbd-eeba3f11a636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:10.414873 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36776a-5a16-4889-9cf7-a604847121fc service glance] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:10.541395 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1d6a8-c05d-45b6-9bbd-eeba3f11a636 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:10.548617 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dac4c2-1f31-4fec-a29d-9a092e949080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:10.549511 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dac4c2-1f31-4fec-a29d-9a092e949080 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:10.549898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dac4c2-1f31-4fec-a29d-9a092e949080 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:10.550181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dac4c2-1f31-4fec-a29d-9a092e949080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:10.552455 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-b2dac4c2-1f31-4fec-a29d-9a092e949080 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:10.570518 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dac4c2-1f31-4fec-a29d-9a092e949080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:10.573130 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dac4c2-1f31-4fec-a29d-9a092e949080 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:10.593849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1369/2756] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:16:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:16:10.602714 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36776a-5a16-4889-9cf7-a604847121fc service glance] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:10.610388 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1107f80-1e71-401d-9c48-10e34c97b8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:10.611138 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1107f80-1e71-401d-9c48-10e34c97b8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:10.611591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1107f80-1e71-401d-9c48-10e34c97b8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:10.611941 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1107f80-1e71-401d-9c48-10e34c97b8c5 admin admin] PATH_INFO: `/v3/users/46010b32d91d451e9ca9afe35fa9f6c4` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:10.613340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1107f80-1e71-401d-9c48-10e34c97b8c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46010b32d91d451e9ca9afe35fa9f6c4)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:10.616149 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1107f80-1e71-401d-9c48-10e34c97b8c5 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:10.706934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a1107f80-1e71-401d-9c48-10e34c97b8c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46010b32d91d451e9ca9afe35fa9f6c4'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:10.708676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a1107f80-1e71-401d-9c48-10e34c97b8c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46010b32d91d451e9ca9afe35fa9f6c4'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:10.721151 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a1107f80-1e71-401d-9c48-10e34c97b8c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46010b32d91d451e9ca9afe35fa9f6c4'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:10.746816 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a1107f80-1e71-401d-9c48-10e34c97b8c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46010b32d91d451e9ca9afe35fa9f6c4'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:10.757275 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-a1107f80-1e71-401d-9c48-10e34c97b8c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46010b32d91d451e9ca9afe35fa9f6c4'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:10.766845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1388/2757] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:16:10 2022] DELETE /identity/v3/users/46010b32d91d451e9ca9afe35fa9f6c4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:16:10.776099 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4281ee-4d2f-4f9f-8d6c-20824e0541cd None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:10.777784 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4281ee-4d2f-4f9f-8d6c-20824e0541cd None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:10.778375 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4281ee-4d2f-4f9f-8d6c-20824e0541cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:10.837927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-7c4281ee-4d2f-4f9f-8d6c-20824e0541cd None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:16:10.840174 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7c4281ee-4d2f-4f9f-8d6c-20824e0541cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:10.921267 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=100 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:10.952906 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1370/2758] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:16:10.967864 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1107f80-1e71-401d-9c48-10e34c97b8c5 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:10.970708 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a1107f80-1e71-401d-9c48-10e34c97b8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:11.076679 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:11.121433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1107f80-1e71-401d-9c48-10e34c97b8c5 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:11.129342 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad1428-cdc5-4ada-9307-85953f20865c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:11.130676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad1428-cdc5-4ada-9307-85953f20865c service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:11.131231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad1428-cdc5-4ada-9307-85953f20865c service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:11.131793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad1428-cdc5-4ada-9307-85953f20865c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:11.151417 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad1428-cdc5-4ada-9307-85953f20865c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:11.154831 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad1428-cdc5-4ada-9307-85953f20865c service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:11.183593 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1389/2759] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:16:11.689980 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4281ee-4d2f-4f9f-8d6c-20824e0541cd None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:11.692247 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7c4281ee-4d2f-4f9f-8d6c-20824e0541cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:11.711576 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4281ee-4d2f-4f9f-8d6c-20824e0541cd None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:11.727903 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2dd38-bfc7-4602-a3aa-851f7f1e724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:11.729221 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2dd38-bfc7-4602-a3aa-851f7f1e724f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:11.729718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2dd38-bfc7-4602-a3aa-851f7f1e724f admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:11.730204 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2dd38-bfc7-4602-a3aa-851f7f1e724f admin admin] PATH_INFO: `/v3/projects/32ba6066ad1e426789d0d6b5cf696213` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:11.735124 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2dd38-bfc7-4602-a3aa-851f7f1e724f admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ba6066ad1e426789d0d6b5cf696213)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:11.740347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2dd38-bfc7-4602-a3aa-851f7f1e724f admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:11.832582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-9de2dd38-bfc7-4602-a3aa-851f7f1e724f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ba6066ad1e426789d0d6b5cf696213', 'request_id': 'req-9de2dd38-bfc7-4602-a3aa-851f7f1e724f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:11.847359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-9de2dd38-bfc7-4602-a3aa-851f7f1e724f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ba6066ad1e426789d0d6b5cf696213', 'request_id': 'req-9de2dd38-bfc7-4602-a3aa-851f7f1e724f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:11.862613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-9de2dd38-bfc7-4602-a3aa-851f7f1e724f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ba6066ad1e426789d0d6b5cf696213', 'request_id': 'req-9de2dd38-bfc7-4602-a3aa-851f7f1e724f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:11.889229 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-9de2dd38-bfc7-4602-a3aa-851f7f1e724f admin admin] The token cache is being invalidate because project 32ba6066ad1e426789d0d6b5cf696213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:16:11.889585 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-9de2dd38-bfc7-4602-a3aa-851f7f1e724f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:11.890519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-9de2dd38-bfc7-4602-a3aa-851f7f1e724f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:11.893115 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1371/2760] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:16:11 2022] DELETE /identity/v3/projects/32ba6066ad1e426789d0d6b5cf696213 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:16:11.906016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016c2f5-7de8-440e-b98b-25eb2bd72683 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:11.906879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016c2f5-7de8-440e-b98b-25eb2bd72683 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:11.907056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016c2f5-7de8-440e-b98b-25eb2bd72683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:12.001731 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-3016c2f5-7de8-440e-b98b-25eb2bd72683 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:16:12.003794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-3016c2f5-7de8-440e-b98b-25eb2bd72683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:12.133247 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1390/2761] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:16:12.147119 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafc374-4629-4532-a889-f510756f4c56 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:12.147570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafc374-4629-4532-a889-f510756f4c56 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:12.147987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafc374-4629-4532-a889-f510756f4c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:12.178115 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-4aafc374-4629-4532-a889-f510756f4c56 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:16:12.180630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4aafc374-4629-4532-a889-f510756f4c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:12.198085 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1372/2762] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:16:12.204082 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016c2f5-7de8-440e-b98b-25eb2bd72683 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:12.219460 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016c2f5-7de8-440e-b98b-25eb2bd72683 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:12.227954 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2ee61-4e77-41ce-aebd-c243be772254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:12.228328 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2ee61-4e77-41ce-aebd-c243be772254 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:12.228853 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2ee61-4e77-41ce-aebd-c243be772254 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:12.229314 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2ee61-4e77-41ce-aebd-c243be772254 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:12.230321 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2ee61-4e77-41ce-aebd-c243be772254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:16:12.230981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2ee61-4e77-41ce-aebd-c243be772254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:12.234089 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2ee61-4e77-41ce-aebd-c243be772254 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:12.260313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1391/2763] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:16:12.265184 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafc374-4629-4532-a889-f510756f4c56 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:12.281299 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafc374-4629-4532-a889-f510756f4c56 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:12.294827 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7db8c-93d1-4a63-b0ea-d22f90c7d6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:12.295852 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7db8c-93d1-4a63-b0ea-d22f90c7d6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:12.296329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7db8c-93d1-4a63-b0ea-d22f90c7d6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:12.296840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7db8c-93d1-4a63-b0ea-d22f90c7d6e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:12.297998 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7db8c-93d1-4a63-b0ea-d22f90c7d6e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:12.301915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7db8c-93d1-4a63-b0ea-d22f90c7d6e5 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:12.322268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2ee61-4e77-41ce-aebd-c243be772254 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:12.326074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-a2f2ee61-4e77-41ce-aebd-c243be772254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:12.385518 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1373/2764] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:16:12 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:16:12.392235 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7db8c-93d1-4a63-b0ea-d22f90c7d6e5 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:12.468496 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2ee61-4e77-41ce-aebd-c243be772254 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:12.520248 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7db8c-93d1-4a63-b0ea-d22f90c7d6e5 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:12.528796 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff325b2-060d-4b87-ac17-b9b2cc921fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:12.529874 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff325b2-060d-4b87-ac17-b9b2cc921fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:12.530647 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff325b2-060d-4b87-ac17-b9b2cc921fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:12.531290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff325b2-060d-4b87-ac17-b9b2cc921fe9 admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:12.532502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff325b2-060d-4b87-ac17-b9b2cc921fe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:12.536519 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff325b2-060d-4b87-ac17-b9b2cc921fe9 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:12.560407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290c114-da85-4ddf-a4e4-d43fbc32010f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:12.561574 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290c114-da85-4ddf-a4e4-d43fbc32010f service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:12.561870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290c114-da85-4ddf-a4e4-d43fbc32010f service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:12.562153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290c114-da85-4ddf-a4e4-d43fbc32010f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:12.565277 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6290c114-da85-4ddf-a4e4-d43fbc32010f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:12.583772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1374/2765] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:16:12 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:16:12.591030 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff325b2-060d-4b87-ac17-b9b2cc921fe9 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:12.601174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=100 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:12.612574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff325b2-060d-4b87-ac17-b9b2cc921fe9 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:12.622424 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cea8a7-d795-432a-979b-15d66860d6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:12.623503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cea8a7-d795-432a-979b-15d66860d6ad admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:12.624003 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cea8a7-d795-432a-979b-15d66860d6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:12.624523 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cea8a7-d795-432a-979b-15d66860d6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:12.625737 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cea8a7-d795-432a-979b-15d66860d6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:12.628907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cea8a7-d795-432a-979b-15d66860d6ad admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:12.649011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1375/2766] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:16:12.655801 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cea8a7-d795-432a-979b-15d66860d6ad admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:12.675127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cea8a7-d795-432a-979b-15d66860d6ad admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:12.684205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80391c8-881f-4b15-933e-23336283b9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:12.685293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80391c8-881f-4b15-933e-23336283b9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:12.685774 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80391c8-881f-4b15-933e-23336283b9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:12.686279 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80391c8-881f-4b15-933e-23336283b9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:12.687564 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80391c8-881f-4b15-933e-23336283b9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:12.690758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80391c8-881f-4b15-933e-23336283b9c0 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:12.709790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290c114-da85-4ddf-a4e4-d43fbc32010f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:12.712654 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290c114-da85-4ddf-a4e4-d43fbc32010f service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:12.714424 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1376/2767] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:16:12.719361 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80391c8-881f-4b15-933e-23336283b9c0 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:12.734741 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80391c8-881f-4b15-933e-23336283b9c0 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:12.737845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1392/2768] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:16:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:16:12.741941 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ce2eb-8d15-4a2b-b376-61d6ddccd0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:12.742808 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ce2eb-8d15-4a2b-b376-61d6ddccd0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:12.743114 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ce2eb-8d15-4a2b-b376-61d6ddccd0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:12.743549 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ce2eb-8d15-4a2b-b376-61d6ddccd0a4 admin admin] PATH_INFO: `/v3/projects/1dba39a332b54ae4ba30157cc2909f7e/users/7a1bb238da044b3584fbee563224a630/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:12.765524 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:12.772093 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ce2eb-8d15-4a2b-b376-61d6ddccd0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dba39a332b54ae4ba30157cc2909f7e, user_id=7a1bb238da044b3584fbee563224a630, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:12.777625 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ce2eb-8d15-4a2b-b376-61d6ddccd0a4 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:12.803346 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1377/2769] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:16:12 2022] PUT /identity/v3/projects/1dba39a332b54ae4ba30157cc2909f7e/users/7a1bb238da044b3584fbee563224a630/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:16:12.821928 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080bd62-3f3a-4119-97ce-ad72b571ac8c None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:12.822403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080bd62-3f3a-4119-97ce-ad72b571ac8c None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:12.822877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080bd62-3f3a-4119-97ce-ad72b571ac8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:12.887693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-5080bd62-3f3a-4119-97ce-ad72b571ac8c None None] MFA Rules not processed for user `7a1bb238da044b3584fbee563224a630`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:16:12.896488 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5080bd62-3f3a-4119-97ce-ad72b571ac8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:13.047120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1393/2770] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:16:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:16:13.068927 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ce2eb-8d15-4a2b-b376-61d6ddccd0a4 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:13.081491 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fb6ce2eb-8d15-4a2b-b376-61d6ddccd0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:13.256078 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ce2eb-8d15-4a2b-b376-61d6ddccd0a4 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:13.263206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6302f7e-f468-4868-9cce-b2e9bee7d4d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:13.264328 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6302f7e-f468-4868-9cce-b2e9bee7d4d0 service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:13.264869 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6302f7e-f468-4868-9cce-b2e9bee7d4d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:13.265360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6302f7e-f468-4868-9cce-b2e9bee7d4d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:13.285809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6302f7e-f468-4868-9cce-b2e9bee7d4d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:13.288137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6302f7e-f468-4868-9cce-b2e9bee7d4d0 service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:13.303737 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1378/2771] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:16:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:16:20.249736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080bd62-3f3a-4119-97ce-ad72b571ac8c None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:20.359453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080bd62-3f3a-4119-97ce-ad72b571ac8c None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:20.377520 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd88647-f89f-467d-9da3-59043123a12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:20.378263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd88647-f89f-467d-9da3-59043123a12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:20.378588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd88647-f89f-467d-9da3-59043123a12d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:20.378956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd88647-f89f-467d-9da3-59043123a12d admin admin] PATH_INFO: `/v3/users/7a1bb238da044b3584fbee563224a630` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:20.381364 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd88647-f89f-467d-9da3-59043123a12d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1bb238da044b3584fbee563224a630)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:20.383628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd88647-f89f-467d-9da3-59043123a12d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:20.468858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1fd88647-f89f-467d-9da3-59043123a12d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1bb238da044b3584fbee563224a630'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:20.469727 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1fd88647-f89f-467d-9da3-59043123a12d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1bb238da044b3584fbee563224a630'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:20.471408 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:20.484173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1fd88647-f89f-467d-9da3-59043123a12d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1bb238da044b3584fbee563224a630'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:20.511264 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1fd88647-f89f-467d-9da3-59043123a12d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1bb238da044b3584fbee563224a630'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:20.522036 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1fd88647-f89f-467d-9da3-59043123a12d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1bb238da044b3584fbee563224a630'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:20.529957 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1394/2772] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:16:20 2022] DELETE /identity/v3/users/7a1bb238da044b3584fbee563224a630 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:16:20.537405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0986a-14a7-4859-81e3-2560d5037911 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:20.538296 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0986a-14a7-4859-81e3-2560d5037911 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:20.538296 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0986a-14a7-4859-81e3-2560d5037911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:20.570882 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-fae0986a-14a7-4859-81e3-2560d5037911 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:16:20.573061 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fae0986a-14a7-4859-81e3-2560d5037911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:20.669476 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1379/2773] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:16:20.681989 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd88647-f89f-467d-9da3-59043123a12d admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:20.683546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1fd88647-f89f-467d-9da3-59043123a12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:20.764536 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd88647-f89f-467d-9da3-59043123a12d admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:20.768978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40654c7d-b1a9-4860-b3db-e57aa9b32605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:20.769811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40654c7d-b1a9-4860-b3db-e57aa9b32605 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:20.770278 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40654c7d-b1a9-4860-b3db-e57aa9b32605 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:20.770745 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40654c7d-b1a9-4860-b3db-e57aa9b32605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:20.785315 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40654c7d-b1a9-4860-b3db-e57aa9b32605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:20.787505 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40654c7d-b1a9-4860-b3db-e57aa9b32605 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:20.799503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1395/2774] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:16:21.263978 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0986a-14a7-4859-81e3-2560d5037911 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:21.266420 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-fae0986a-14a7-4859-81e3-2560d5037911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:21.293074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0986a-14a7-4859-81e3-2560d5037911 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:21.304112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab5cae-ec9b-48f8-9d5e-a3b6d13444f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:21.306266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5cae-ec9b-48f8-9d5e-a3b6d13444f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:21.307571 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5cae-ec9b-48f8-9d5e-a3b6d13444f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:21.308055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5cae-ec9b-48f8-9d5e-a3b6d13444f8 admin admin] PATH_INFO: `/v3/projects/1dba39a332b54ae4ba30157cc2909f7e` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:21.311256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab5cae-ec9b-48f8-9d5e-a3b6d13444f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dba39a332b54ae4ba30157cc2909f7e)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:21.315236 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab5cae-ec9b-48f8-9d5e-a3b6d13444f8 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:21.398634 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0eab5cae-ec9b-48f8-9d5e-a3b6d13444f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dba39a332b54ae4ba30157cc2909f7e', 'request_id': 'req-0eab5cae-ec9b-48f8-9d5e-a3b6d13444f8'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:21.410560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0eab5cae-ec9b-48f8-9d5e-a3b6d13444f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dba39a332b54ae4ba30157cc2909f7e', 'request_id': 'req-0eab5cae-ec9b-48f8-9d5e-a3b6d13444f8'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:21.421413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0eab5cae-ec9b-48f8-9d5e-a3b6d13444f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dba39a332b54ae4ba30157cc2909f7e', 'request_id': 'req-0eab5cae-ec9b-48f8-9d5e-a3b6d13444f8'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:21.442400 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0eab5cae-ec9b-48f8-9d5e-a3b6d13444f8 admin admin] The token cache is being invalidate because project 1dba39a332b54ae4ba30157cc2909f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:16:21.442859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0eab5cae-ec9b-48f8-9d5e-a3b6d13444f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:21.444239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-0eab5cae-ec9b-48f8-9d5e-a3b6d13444f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:16:21.446847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1380/2775] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:16:21 2022] DELETE /identity/v3/projects/1dba39a332b54ae4ba30157cc2909f7e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:16:21.454956 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595173f-df93-4e0f-a32a-e5de26fa8dd7 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:21.455702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595173f-df93-4e0f-a32a-e5de26fa8dd7 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:21.455702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595173f-df93-4e0f-a32a-e5de26fa8dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:21.487306 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-4595173f-df93-4e0f-a32a-e5de26fa8dd7 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:16:21.489708 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-4595173f-df93-4e0f-a32a-e5de26fa8dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:21.600822 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1396/2776] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:16:21.613072 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba3aac-8623-474c-9b65-570d6f872151 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:21.613949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba3aac-8623-474c-9b65-570d6f872151 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:21.613949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba3aac-8623-474c-9b65-570d6f872151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:21.647333 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-83ba3aac-8623-474c-9b65-570d6f872151 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:16:21.649359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-83ba3aac-8623-474c-9b65-570d6f872151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:21.663134 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1381/2777] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:16:21.669704 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595173f-df93-4e0f-a32a-e5de26fa8dd7 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:21.687674 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595173f-df93-4e0f-a32a-e5de26fa8dd7 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:21.695006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab856dfb-291e-40f3-a5bd-b2b94707f84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:21.695988 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab856dfb-291e-40f3-a5bd-b2b94707f84b admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:21.696482 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab856dfb-291e-40f3-a5bd-b2b94707f84b admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:21.696959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab856dfb-291e-40f3-a5bd-b2b94707f84b admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:21.698162 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab856dfb-291e-40f3-a5bd-b2b94707f84b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:16:21.698712 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab856dfb-291e-40f3-a5bd-b2b94707f84b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:21.701887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab856dfb-291e-40f3-a5bd-b2b94707f84b admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:21.723942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1397/2778] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:16:21.730687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba3aac-8623-474c-9b65-570d6f872151 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:21.743926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba3aac-8623-474c-9b65-570d6f872151 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:21.749736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9a313-0dd8-4f4a-8d96-2e8242edcf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:21.750538 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9a313-0dd8-4f4a-8d96-2e8242edcf68 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:21.750860 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9a313-0dd8-4f4a-8d96-2e8242edcf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:21.751175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9a313-0dd8-4f4a-8d96-2e8242edcf68 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:21.751882 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9a313-0dd8-4f4a-8d96-2e8242edcf68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:21.754372 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9a313-0dd8-4f4a-8d96-2e8242edcf68 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:21.766319 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:21.800057 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1382/2779] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:16:21 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:16:21.806630 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab856dfb-291e-40f3-a5bd-b2b94707f84b admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:21.823204 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab856dfb-291e-40f3-a5bd-b2b94707f84b admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:21.897563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:21.908480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eb5f5-69ec-4bd3-a936-a346ef7e3686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:21.909363 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb5f5-69ec-4bd3-a936-a346ef7e3686 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:21.909852 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb5f5-69ec-4bd3-a936-a346ef7e3686 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:21.910082 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb5f5-69ec-4bd3-a936-a346ef7e3686 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:21.911008 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eb5f5-69ec-4bd3-a936-a346ef7e3686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:21.913210 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eb5f5-69ec-4bd3-a936-a346ef7e3686 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:21.974336 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1398/2780] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:16:21 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:16:21.980033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9a313-0dd8-4f4a-8d96-2e8242edcf68 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:21.995156 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9a313-0dd8-4f4a-8d96-2e8242edcf68 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:22.000630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557debc9-fd64-4cbd-929c-4bab1893ccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:22.001532 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557debc9-fd64-4cbd-929c-4bab1893ccb7 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:22.001925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557debc9-fd64-4cbd-929c-4bab1893ccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:22.002291 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557debc9-fd64-4cbd-929c-4bab1893ccb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:22.003048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557debc9-fd64-4cbd-929c-4bab1893ccb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:22.005000 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557debc9-fd64-4cbd-929c-4bab1893ccb7 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:22.021501 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1383/2781] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:16:22.026526 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eb5f5-69ec-4bd3-a936-a346ef7e3686 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:22.038820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eb5f5-69ec-4bd3-a936-a346ef7e3686 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:22.044871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceb556-5dca-49bb-bbbb-2d513c770ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:22.045545 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceb556-5dca-49bb-bbbb-2d513c770ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:22.045832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceb556-5dca-49bb-bbbb-2d513c770ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:22.046107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceb556-5dca-49bb-bbbb-2d513c770ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:22.046810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ceb556-5dca-49bb-bbbb-2d513c770ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:22.048586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ceb556-5dca-49bb-bbbb-2d513c770ca4 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:22.063268 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1399/2782] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:16:22.068845 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557debc9-fd64-4cbd-929c-4bab1893ccb7 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:22.081728 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557debc9-fd64-4cbd-929c-4bab1893ccb7 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:22.089132 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878da86d-b665-408e-b361-b69906ccfea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:22.090277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878da86d-b665-408e-b361-b69906ccfea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:22.090788 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878da86d-b665-408e-b361-b69906ccfea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:22.091275 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878da86d-b665-408e-b361-b69906ccfea0 admin admin] PATH_INFO: `/v3/projects/a436bd6d56934776ade08c24f7889561/users/ce4dc040fed34d6caceeaa1bbcde9e2f/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:22.124444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878da86d-b665-408e-b361-b69906ccfea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a436bd6d56934776ade08c24f7889561, user_id=ce4dc040fed34d6caceeaa1bbcde9e2f, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:22.130556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878da86d-b665-408e-b361-b69906ccfea0 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:22.152654 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1384/2783] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:16:22 2022] PUT /identity/v3/projects/a436bd6d56934776ade08c24f7889561/users/ce4dc040fed34d6caceeaa1bbcde9e2f/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:16:22.160736 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2929d-5b94-4074-966e-c65defe34c26 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:22.161054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2929d-5b94-4074-966e-c65defe34c26 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:22.161353 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2929d-5b94-4074-966e-c65defe34c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:22.189810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-1cc2929d-5b94-4074-966e-c65defe34c26 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:16:22.191497 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1cc2929d-5b94-4074-966e-c65defe34c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:22.291749 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1400/2784] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:16:22.303469 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878da86d-b665-408e-b361-b69906ccfea0 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:22.306336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-878da86d-b665-408e-b361-b69906ccfea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:22.418138 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878da86d-b665-408e-b361-b69906ccfea0 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:22.423386 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96eed52-704a-4813-a639-3a4b5f8b28ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:22.424406 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96eed52-704a-4813-a639-3a4b5f8b28ae service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:22.424907 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96eed52-704a-4813-a639-3a4b5f8b28ae service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:22.425399 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96eed52-704a-4813-a639-3a4b5f8b28ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:22.441990 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96eed52-704a-4813-a639-3a4b5f8b28ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:22.444219 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96eed52-704a-4813-a639-3a4b5f8b28ae service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:22.463095 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1385/2785] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:16:23.475105 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b13f33-459d-49a8-910b-0d405f6198b3 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:23.477596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b13f33-459d-49a8-910b-0d405f6198b3 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:23.477596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b13f33-459d-49a8-910b-0d405f6198b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:23.527139 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-33b13f33-459d-49a8-910b-0d405f6198b3 None None] MFA Rules not processed for user `ce4dc040fed34d6caceeaa1bbcde9e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:16:23.529073 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-33b13f33-459d-49a8-910b-0d405f6198b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:23.654249 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1401/2786] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:16:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:16:23.678425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96eed52-704a-4813-a639-3a4b5f8b28ae service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:23.683992 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c96eed52-704a-4813-a639-3a4b5f8b28ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:23.794447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96eed52-704a-4813-a639-3a4b5f8b28ae service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:23.799759 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39501-9773-44b8-b552-583eca706d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:23.801074 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39501-9773-44b8-b552-583eca706d2d service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:23.801638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39501-9773-44b8-b552-583eca706d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:23.802153 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39501-9773-44b8-b552-583eca706d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:23.817431 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f39501-9773-44b8-b552-583eca706d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:23.819783 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f39501-9773-44b8-b552-583eca706d2d service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:23.837290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1386/2787] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:16:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:16:25.464815 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b295a-3d7b-4588-bc7e-49b2e192975c None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:25.465642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b295a-3d7b-4588-bc7e-49b2e192975c None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:25.465642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b295a-3d7b-4588-bc7e-49b2e192975c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:25.497870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-0c0b295a-3d7b-4588-bc7e-49b2e192975c None None] MFA Rules not processed for user `ce4dc040fed34d6caceeaa1bbcde9e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:16:25.499793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-0c0b295a-3d7b-4588-bc7e-49b2e192975c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:25.513158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1402/2788] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:16:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:16:27.073167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39501-9773-44b8-b552-583eca706d2d service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:27.075284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-74f39501-9773-44b8-b552-583eca706d2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:27.170699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:27.218367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39501-9773-44b8-b552-583eca706d2d service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:27.225913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f2fa9-6d5c-4dce-89b5-00d6542ccc62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2420def47ee4a5b8cf4373252583d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:27.226556 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f2fa9-6d5c-4dce-89b5-00d6542ccc62 service placement] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:27.226841 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f2fa9-6d5c-4dce-89b5-00d6542ccc62 service placement] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:27.227184 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f2fa9-6d5c-4dce-89b5-00d6542ccc62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:27.229863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-8b0f2fa9-6d5c-4dce-89b5-00d6542ccc62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:27.249105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f2fa9-6d5c-4dce-89b5-00d6542ccc62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:27.252159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f2fa9-6d5c-4dce-89b5-00d6542ccc62 service placement] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:27.271230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1387/2789] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:16:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:16:35.488649 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:37.262829 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=14 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:44.449765 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796320c-92ad-4e2a-90dc-99e8cabfa293 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:44.450591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796320c-92ad-4e2a-90dc-99e8cabfa293 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:44.450591 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796320c-92ad-4e2a-90dc-99e8cabfa293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:44.481759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-8796320c-92ad-4e2a-90dc-99e8cabfa293 None None] MFA Rules not processed for user `ce4dc040fed34d6caceeaa1bbcde9e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:16:44.484264 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8796320c-92ad-4e2a-90dc-99e8cabfa293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:44.498676 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1403/2790] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:16:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:16:47.660699 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f2fa9-6d5c-4dce-89b5-00d6542ccc62 service placement] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:47.706954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f2fa9-6d5c-4dce-89b5-00d6542ccc62 service placement] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:47.712606 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405d6e8-15cd-4ee0-9681-c4b2fa302a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:47.714044 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405d6e8-15cd-4ee0-9681-c4b2fa302a75 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:47.715063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405d6e8-15cd-4ee0-9681-c4b2fa302a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:47.715063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405d6e8-15cd-4ee0-9681-c4b2fa302a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:47.734585 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-8405d6e8-15cd-4ee0-9681-c4b2fa302a75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:47.755987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405d6e8-15cd-4ee0-9681-c4b2fa302a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:47.757607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405d6e8-15cd-4ee0-9681-c4b2fa302a75 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:47.776288 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1388/2791] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:16:54.473367 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:55.164179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719316a-f648-48e1-97be-b1e8d1a8bb04 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:55.165070 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719316a-f648-48e1-97be-b1e8d1a8bb04 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:55.165538 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719316a-f648-48e1-97be-b1e8d1a8bb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:55.194653 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-c719316a-f648-48e1-97be-b1e8d1a8bb04 None None] MFA Rules not processed for user `4aed49c244944762bf8f3c972591962c`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:16:55.196414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-c719316a-f648-48e1-97be-b1e8d1a8bb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:55.322158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1404/2792] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:16:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:16:57.766613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=10 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:01.115864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405d6e8-15cd-4ee0-9681-c4b2fa302a75 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:01.118392 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-8405d6e8-15cd-4ee0-9681-c4b2fa302a75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:01.140666 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405d6e8-15cd-4ee0-9681-c4b2fa302a75 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:01.146551 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9b71a-792f-4d45-be3c-84fd40467b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:01.147243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9b71a-792f-4d45-be3c-84fd40467b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:01.147852 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9b71a-792f-4d45-be3c-84fd40467b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:01.147852 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9b71a-792f-4d45-be3c-84fd40467b1a admin admin] PATH_INFO: `/v3/users/44a02c537c0e40ab998a84f1f5c7fa62` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:01.149538 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9b71a-792f-4d45-be3c-84fd40467b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a02c537c0e40ab998a84f1f5c7fa62)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:01.151773 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9b71a-792f-4d45-be3c-84fd40467b1a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:01.231228 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4dd9b71a-792f-4d45-be3c-84fd40467b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a02c537c0e40ab998a84f1f5c7fa62'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:01.232690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4dd9b71a-792f-4d45-be3c-84fd40467b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a02c537c0e40ab998a84f1f5c7fa62'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:01.246251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4dd9b71a-792f-4d45-be3c-84fd40467b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a02c537c0e40ab998a84f1f5c7fa62'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:01.248150 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4dd9b71a-792f-4d45-be3c-84fd40467b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a02c537c0e40ab998a84f1f5c7fa62'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:01.262417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-4dd9b71a-792f-4d45-be3c-84fd40467b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a02c537c0e40ab998a84f1f5c7fa62'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:01.294964 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1389/2793] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:17:01 2022] DELETE /identity/v3/users/44a02c537c0e40ab998a84f1f5c7fa62 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:17:01.598433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719316a-f648-48e1-97be-b1e8d1a8bb04 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:01.624913 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719316a-f648-48e1-97be-b1e8d1a8bb04 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:01.773825 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b52f2-4001-4c44-8bac-1da3f8bebd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:01.775351 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b52f2-4001-4c44-8bac-1da3f8bebd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:01.776060 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b52f2-4001-4c44-8bac-1da3f8bebd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:01.776817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b52f2-4001-4c44-8bac-1da3f8bebd03 admin admin] PATH_INFO: `/v3/projects/fba6dd0f46b44440b518fe3d7d8a2a53` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:01.786656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b52f2-4001-4c44-8bac-1da3f8bebd03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba6dd0f46b44440b518fe3d7d8a2a53)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:01.794199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b52f2-4001-4c44-8bac-1da3f8bebd03 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:01.941399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b69b52f2-4001-4c44-8bac-1da3f8bebd03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba6dd0f46b44440b518fe3d7d8a2a53', 'request_id': 'req-b69b52f2-4001-4c44-8bac-1da3f8bebd03'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:01.957957 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b69b52f2-4001-4c44-8bac-1da3f8bebd03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba6dd0f46b44440b518fe3d7d8a2a53', 'request_id': 'req-b69b52f2-4001-4c44-8bac-1da3f8bebd03'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:01.969575 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b69b52f2-4001-4c44-8bac-1da3f8bebd03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba6dd0f46b44440b518fe3d7d8a2a53', 'request_id': 'req-b69b52f2-4001-4c44-8bac-1da3f8bebd03'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:01.995581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b69b52f2-4001-4c44-8bac-1da3f8bebd03 admin admin] The token cache is being invalidate because project fba6dd0f46b44440b518fe3d7d8a2a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:17:01.996353 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b69b52f2-4001-4c44-8bac-1da3f8bebd03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:01.997469 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b69b52f2-4001-4c44-8bac-1da3f8bebd03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:02.000041 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1405/2794] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:17:01 2022] DELETE /identity/v3/projects/fba6dd0f46b44440b518fe3d7d8a2a53 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:17:02.012245 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9b71a-792f-4d45-be3c-84fd40467b1a admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:02.017866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4dd9b71a-792f-4d45-be3c-84fd40467b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:02.038616 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9b71a-792f-4d45-be3c-84fd40467b1a admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:02.134534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18d2ca-06c2-496a-aa80-92e7f6641392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:02.137163 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18d2ca-06c2-496a-aa80-92e7f6641392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:02.137775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18d2ca-06c2-496a-aa80-92e7f6641392 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:02.138225 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18d2ca-06c2-496a-aa80-92e7f6641392 admin admin] PATH_INFO: `/v3/users/04dca291638941f1a01a84e3f0633c9d` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:02.139896 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18d2ca-06c2-496a-aa80-92e7f6641392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04dca291638941f1a01a84e3f0633c9d)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:02.144985 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18d2ca-06c2-496a-aa80-92e7f6641392 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:02.241743 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-7c18d2ca-06c2-496a-aa80-92e7f6641392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04dca291638941f1a01a84e3f0633c9d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:02.242504 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-7c18d2ca-06c2-496a-aa80-92e7f6641392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04dca291638941f1a01a84e3f0633c9d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:02.255754 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-7c18d2ca-06c2-496a-aa80-92e7f6641392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04dca291638941f1a01a84e3f0633c9d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:02.256906 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-7c18d2ca-06c2-496a-aa80-92e7f6641392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04dca291638941f1a01a84e3f0633c9d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:02.271612 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-7c18d2ca-06c2-496a-aa80-92e7f6641392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04dca291638941f1a01a84e3f0633c9d'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:02.291212 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:02.312258 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1390/2795] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:17:02 2022] DELETE /identity/v3/users/04dca291638941f1a01a84e3f0633c9d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:17:02.574625 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b52f2-4001-4c44-8bac-1da3f8bebd03 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:02.578263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-b69b52f2-4001-4c44-8bac-1da3f8bebd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:02.602528 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b52f2-4001-4c44-8bac-1da3f8bebd03 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:02.648397 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:02.691053 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccb049-6393-4075-af6f-a9040235597d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:02.692879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccb049-6393-4075-af6f-a9040235597d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:02.692879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccb049-6393-4075-af6f-a9040235597d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:02.692879 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccb049-6393-4075-af6f-a9040235597d admin admin] PATH_INFO: `/v3/projects/54fc53687cc14918af6b4a2419a184c3` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:02.694421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccb049-6393-4075-af6f-a9040235597d admin admin] RBAC: Authorizing `identity:delete_project(project_id=54fc53687cc14918af6b4a2419a184c3)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:02.696779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccb049-6393-4075-af6f-a9040235597d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:02.788783 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1fccb049-6393-4075-af6f-a9040235597d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54fc53687cc14918af6b4a2419a184c3', 'request_id': 'req-1fccb049-6393-4075-af6f-a9040235597d'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:02.801981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1fccb049-6393-4075-af6f-a9040235597d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54fc53687cc14918af6b4a2419a184c3', 'request_id': 'req-1fccb049-6393-4075-af6f-a9040235597d'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:02.826910 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1fccb049-6393-4075-af6f-a9040235597d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54fc53687cc14918af6b4a2419a184c3', 'request_id': 'req-1fccb049-6393-4075-af6f-a9040235597d'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:02.854718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1fccb049-6393-4075-af6f-a9040235597d admin admin] The token cache is being invalidate because project 54fc53687cc14918af6b4a2419a184c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:17:02.855455 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1fccb049-6393-4075-af6f-a9040235597d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:02.856866 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-1fccb049-6393-4075-af6f-a9040235597d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:02.859612 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1406/2796] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:17:02 2022] DELETE /identity/v3/projects/54fc53687cc14918af6b4a2419a184c3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:17:06.848251 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ef8e9-6314-4df8-b460-0a66e3f29405 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:06.849678 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ef8e9-6314-4df8-b460-0a66e3f29405 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:06.849954 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ef8e9-6314-4df8-b460-0a66e3f29405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:06.894832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-eb9ef8e9-6314-4df8-b460-0a66e3f29405 None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:06.896733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-eb9ef8e9-6314-4df8-b460-0a66e3f29405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:06.994969 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1391/2797] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Sep 7 13:17:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:17:07.057004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccb049-6393-4075-af6f-a9040235597d admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:07.059452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-1fccb049-6393-4075-af6f-a9040235597d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:07.176129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccb049-6393-4075-af6f-a9040235597d admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:07.184824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c859a9c-c3ef-4cf1-af1a-ff149bf39ca9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:07.185858 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c859a9c-c3ef-4cf1-af1a-ff149bf39ca9 service swift] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:07.186308 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c859a9c-c3ef-4cf1-af1a-ff149bf39ca9 service swift] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:07.186616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c859a9c-c3ef-4cf1-af1a-ff149bf39ca9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:07.201185 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c859a9c-c3ef-4cf1-af1a-ff149bf39ca9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:07.204501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c859a9c-c3ef-4cf1-af1a-ff149bf39ca9 service swift] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:07.219458 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1407/2798] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:17:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:17:16.984419 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=32,keystone:DELETE=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:17.213931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=67,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:25.858060 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c8fdd-2eb6-47ab-a599-34487cc029ce None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:25.859054 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c8fdd-2eb6-47ab-a599-34487cc029ce None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:25.859054 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c8fdd-2eb6-47ab-a599-34487cc029ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:25.883672 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-bc4c8fdd-2eb6-47ab-a599-34487cc029ce None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:25.884974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-bc4c8fdd-2eb6-47ab-a599-34487cc029ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:25.893035 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1392/2799] 10.222.0.30 () {58 vars in 967 bytes} [Wed Sep 7 13:17:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:17:25.907320 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c859a9c-c3ef-4cf1-af1a-ff149bf39ca9 service swift] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:25.919407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c859a9c-c3ef-4cf1-af1a-ff149bf39ca9 service swift] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:25.925848 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722516e-fc32-4356-9868-842749188797 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:25.926481 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722516e-fc32-4356-9868-842749188797 service swift] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:25.926759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722516e-fc32-4356-9868-842749188797 service swift] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:25.927037 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722516e-fc32-4356-9868-842749188797 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:25.936319 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722516e-fc32-4356-9868-842749188797 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:25.937955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722516e-fc32-4356-9868-842749188797 service swift] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:25.949190 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1408/2800] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:17:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:17:28.110755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c8fdd-2eb6-47ab-a599-34487cc029ce None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:28.113596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-bc4c8fdd-2eb6-47ab-a599-34487cc029ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:28.224239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c8fdd-2eb6-47ab-a599-34487cc029ce None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:28.230757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ac478-1052-41d3-9559-4ee445f78e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:28.231499 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ac478-1052-41d3-9559-4ee445f78e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:28.231782 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ac478-1052-41d3-9559-4ee445f78e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:28.232047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ac478-1052-41d3-9559-4ee445f78e88 admin admin] PATH_INFO: `/v3/users/ce4dc040fed34d6caceeaa1bbcde9e2f` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:28.233331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ac478-1052-41d3-9559-4ee445f78e88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce4dc040fed34d6caceeaa1bbcde9e2f)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:28.235766 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ac478-1052-41d3-9559-4ee445f78e88 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:28.312217 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e30ac478-1052-41d3-9559-4ee445f78e88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce4dc040fed34d6caceeaa1bbcde9e2f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:28.313710 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e30ac478-1052-41d3-9559-4ee445f78e88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce4dc040fed34d6caceeaa1bbcde9e2f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:28.325242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e30ac478-1052-41d3-9559-4ee445f78e88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce4dc040fed34d6caceeaa1bbcde9e2f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:28.325958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e30ac478-1052-41d3-9559-4ee445f78e88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce4dc040fed34d6caceeaa1bbcde9e2f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:28.336057 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-e30ac478-1052-41d3-9559-4ee445f78e88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce4dc040fed34d6caceeaa1bbcde9e2f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:28.360938 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1393/2801] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:17:28 2022] DELETE /identity/v3/users/ce4dc040fed34d6caceeaa1bbcde9e2f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:17:28.609996 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722516e-fc32-4356-9868-842749188797 service swift] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:28.626807 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722516e-fc32-4356-9868-842749188797 service swift] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:28.713433 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f47ed9-e0c4-4720-a95d-db8fadc17ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:28.715265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f47ed9-e0c4-4720-a95d-db8fadc17ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:28.715265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f47ed9-e0c4-4720-a95d-db8fadc17ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:28.715638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f47ed9-e0c4-4720-a95d-db8fadc17ae5 admin admin] PATH_INFO: `/v3/projects/a436bd6d56934776ade08c24f7889561` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:28.717756 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f47ed9-e0c4-4720-a95d-db8fadc17ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a436bd6d56934776ade08c24f7889561)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:28.720549 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f47ed9-e0c4-4720-a95d-db8fadc17ae5 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:28.791029 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c7f47ed9-e0c4-4720-a95d-db8fadc17ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a436bd6d56934776ade08c24f7889561', 'request_id': 'req-c7f47ed9-e0c4-4720-a95d-db8fadc17ae5'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:28.803573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c7f47ed9-e0c4-4720-a95d-db8fadc17ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a436bd6d56934776ade08c24f7889561', 'request_id': 'req-c7f47ed9-e0c4-4720-a95d-db8fadc17ae5'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:28.814340 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c7f47ed9-e0c4-4720-a95d-db8fadc17ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a436bd6d56934776ade08c24f7889561', 'request_id': 'req-c7f47ed9-e0c4-4720-a95d-db8fadc17ae5'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:28.834743 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c7f47ed9-e0c4-4720-a95d-db8fadc17ae5 admin admin] The token cache is being invalidate because project a436bd6d56934776ade08c24f7889561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:17:28.835084 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c7f47ed9-e0c4-4720-a95d-db8fadc17ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:28.836167 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c7f47ed9-e0c4-4720-a95d-db8fadc17ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:28.837681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1409/2802] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:17:28 2022] DELETE /identity/v3/projects/a436bd6d56934776ade08c24f7889561 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:17:28.844389 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b5d60-e540-4626-b404-b21d22e4e62e None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:28.844880 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b5d60-e540-4626-b404-b21d22e4e62e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:28.845362 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b5d60-e540-4626-b404-b21d22e4e62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:28.872713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-9d3b5d60-e540-4626-b404-b21d22e4e62e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:28.873978 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-9d3b5d60-e540-4626-b404-b21d22e4e62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:28.954863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1394/2803] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:17:28.962443 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1d6bf-54d5-4e23-b534-d34d8fcc85f9 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:28.962717 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1d6bf-54d5-4e23-b534-d34d8fcc85f9 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:28.962979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1d6bf-54d5-4e23-b534-d34d8fcc85f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:28.984945 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-aab1d6bf-54d5-4e23-b534-d34d8fcc85f9 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:28.987476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-aab1d6bf-54d5-4e23-b534-d34d8fcc85f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:28.996602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1410/2804] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:17:29.001164 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b5d60-e540-4626-b404-b21d22e4e62e None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:29.013019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b5d60-e540-4626-b404-b21d22e4e62e None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:29.019026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9d3af-9e56-4141-9020-2818bde0b3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:29.019693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d3af-9e56-4141-9020-2818bde0b3dc admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:29.019966 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d3af-9e56-4141-9020-2818bde0b3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:29.020232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d3af-9e56-4141-9020-2818bde0b3dc admin admin] PATH_INFO: `/v3/domains` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:29.020933 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9d3af-9e56-4141-9020-2818bde0b3dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:17:29.021232 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9d3af-9e56-4141-9020-2818bde0b3dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:29.022872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9d3af-9e56-4141-9020-2818bde0b3dc admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:29.035142 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:29.039055 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1395/2805] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:17:29.045265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1d6bf-54d5-4e23-b534-d34d8fcc85f9 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:29.057758 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1d6bf-54d5-4e23-b534-d34d8fcc85f9 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:29.065288 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab639dac-5958-4b88-901e-48c8ccc85fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:29.066272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab639dac-5958-4b88-901e-48c8ccc85fcb admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:29.066715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab639dac-5958-4b88-901e-48c8ccc85fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:29.067138 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab639dac-5958-4b88-901e-48c8ccc85fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:29.067800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab639dac-5958-4b88-901e-48c8ccc85fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:29.069982 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab639dac-5958-4b88-901e-48c8ccc85fcb admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:29.105658 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1411/2806] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:17:29 2022] POST /identity/v3/projects => generated 389 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:17:29.110586 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9d3af-9e56-4141-9020-2818bde0b3dc admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:29.123947 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9d3af-9e56-4141-9020-2818bde0b3dc admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:29.201949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd3b91-7377-4c4f-9d63-67b87b210dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:29.202572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd3b91-7377-4c4f-9d63-67b87b210dee admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:29.202850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd3b91-7377-4c4f-9d63-67b87b210dee admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:29.203123 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd3b91-7377-4c4f-9d63-67b87b210dee admin admin] PATH_INFO: `/v3/users` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:29.203778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd3b91-7377-4c4f-9d63-67b87b210dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:29.205798 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd3b91-7377-4c4f-9d63-67b87b210dee admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:29.238172 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1396/2807] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:17:29 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:17:29.243477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab639dac-5958-4b88-901e-48c8ccc85fcb admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:29.255779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab639dac-5958-4b88-901e-48c8ccc85fcb admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:29.263272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976a289-6d1c-4743-a0f0-ad0f9e051abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:29.264333 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976a289-6d1c-4743-a0f0-ad0f9e051abe admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:29.264828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976a289-6d1c-4743-a0f0-ad0f9e051abe admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:29.265305 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976a289-6d1c-4743-a0f0-ad0f9e051abe admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:29.266487 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976a289-6d1c-4743-a0f0-ad0f9e051abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:29.269543 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976a289-6d1c-4743-a0f0-ad0f9e051abe admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:29.284617 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1412/2808] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:17:29.290206 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd3b91-7377-4c4f-9d63-67b87b210dee admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:29.305447 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd3b91-7377-4c4f-9d63-67b87b210dee admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:29.311459 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e55a14-8829-4821-938e-271cd42d5ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:29.312583 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e55a14-8829-4821-938e-271cd42d5ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:29.313119 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e55a14-8829-4821-938e-271cd42d5ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:29.313465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e55a14-8829-4821-938e-271cd42d5ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:29.314533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e55a14-8829-4821-938e-271cd42d5ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:29.317056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e55a14-8829-4821-938e-271cd42d5ea6 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:29.334068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1397/2809] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:17:29.338803 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976a289-6d1c-4743-a0f0-ad0f9e051abe admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:29.350044 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976a289-6d1c-4743-a0f0-ad0f9e051abe admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:29.358269 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd806d5-7640-457f-9c73-23de3588e271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:29.359324 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd806d5-7640-457f-9c73-23de3588e271 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:29.359766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd806d5-7640-457f-9c73-23de3588e271 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:29.360109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd806d5-7640-457f-9c73-23de3588e271 admin admin] PATH_INFO: `/v3/projects/8cc079d998ed46ec80f06cc71c643725/users/92046b4e4ee644c59671e840777287b7/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:29.382784 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd806d5-7640-457f-9c73-23de3588e271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc079d998ed46ec80f06cc71c643725, user_id=92046b4e4ee644c59671e840777287b7, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:29.386109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd806d5-7640-457f-9c73-23de3588e271 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:29.406754 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1413/2810] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:17:29 2022] PUT /identity/v3/projects/8cc079d998ed46ec80f06cc71c643725/users/92046b4e4ee644c59671e840777287b7/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:17:29.417435 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c0a17-e452-4262-996b-5e35ad8f4656 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:29.417718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c0a17-e452-4262-996b-5e35ad8f4656 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:29.417976 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c0a17-e452-4262-996b-5e35ad8f4656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:29.451336 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-eb5c0a17-e452-4262-996b-5e35ad8f4656 None None] MFA Rules not processed for user `92046b4e4ee644c59671e840777287b7`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:29.452613 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-eb5c0a17-e452-4262-996b-5e35ad8f4656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:29.526365 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1398/2811] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:17:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:17:29.538146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd806d5-7640-457f-9c73-23de3588e271 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:29.540345 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-dfd806d5-7640-457f-9c73-23de3588e271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:29.562360 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:29.647160 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd806d5-7640-457f-9c73-23de3588e271 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:29.651960 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc9366-ab71-406d-8f84-04cb9bde7378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:29.652626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc9366-ab71-406d-8f84-04cb9bde7378 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:29.652901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc9366-ab71-406d-8f84-04cb9bde7378 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:29.653161 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc9366-ab71-406d-8f84-04cb9bde7378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:29.666112 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc9366-ab71-406d-8f84-04cb9bde7378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:29.667633 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc9366-ab71-406d-8f84-04cb9bde7378 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:29.678139 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1414/2812] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:17:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:17:39.523297 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:39.673225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=29 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:40.346462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c0a17-e452-4262-996b-5e35ad8f4656 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:40.428561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c0a17-e452-4262-996b-5e35ad8f4656 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:40.433511 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa45681-7239-470f-8665-0ac760d8fd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:40.434165 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa45681-7239-470f-8665-0ac760d8fd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:40.434441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa45681-7239-470f-8665-0ac760d8fd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:40.434715 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa45681-7239-470f-8665-0ac760d8fd63 admin admin] PATH_INFO: `/v3/users/92046b4e4ee644c59671e840777287b7` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:40.437843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa45681-7239-470f-8665-0ac760d8fd63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92046b4e4ee644c59671e840777287b7)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:40.440184 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa45681-7239-470f-8665-0ac760d8fd63 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:40.505041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-faa45681-7239-470f-8665-0ac760d8fd63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92046b4e4ee644c59671e840777287b7'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:40.505612 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-faa45681-7239-470f-8665-0ac760d8fd63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92046b4e4ee644c59671e840777287b7'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:40.514765 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-faa45681-7239-470f-8665-0ac760d8fd63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92046b4e4ee644c59671e840777287b7'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:40.516210 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-faa45681-7239-470f-8665-0ac760d8fd63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92046b4e4ee644c59671e840777287b7'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:40.525597 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-faa45681-7239-470f-8665-0ac760d8fd63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92046b4e4ee644c59671e840777287b7'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:40.548027 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1399/2813] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:17:40 2022] DELETE /identity/v3/users/92046b4e4ee644c59671e840777287b7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:17:40.553158 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923f724-e472-4003-92b3-c1f015b452bf None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:40.553454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923f724-e472-4003-92b3-c1f015b452bf None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:40.553730 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923f724-e472-4003-92b3-c1f015b452bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:40.578208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-8923f724-e472-4003-92b3-c1f015b452bf None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:40.579446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8923f724-e472-4003-92b3-c1f015b452bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:40.649596 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1415/2814] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:17:40.662833 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa45681-7239-470f-8665-0ac760d8fd63 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:40.665984 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-faa45681-7239-470f-8665-0ac760d8fd63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:40.753222 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa45681-7239-470f-8665-0ac760d8fd63 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:40.758390 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4e90e-af05-4e71-8cda-178e98cce60f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:40.759071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4e90e-af05-4e71-8cda-178e98cce60f service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:40.759578 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4e90e-af05-4e71-8cda-178e98cce60f service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:40.760026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4e90e-af05-4e71-8cda-178e98cce60f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:40.772935 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4e90e-af05-4e71-8cda-178e98cce60f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:40.774550 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4e90e-af05-4e71-8cda-178e98cce60f service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:40.786780 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1400/2815] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:17:41.108236 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923f724-e472-4003-92b3-c1f015b452bf None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:41.110048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8923f724-e472-4003-92b3-c1f015b452bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:41.140112 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923f724-e472-4003-92b3-c1f015b452bf None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:41.157416 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e09c8b-177e-4937-985f-794bcd9e3948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:41.158497 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e09c8b-177e-4937-985f-794bcd9e3948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:41.159936 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e09c8b-177e-4937-985f-794bcd9e3948 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:41.160795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e09c8b-177e-4937-985f-794bcd9e3948 admin admin] PATH_INFO: `/v3/projects/8cc079d998ed46ec80f06cc71c643725` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:41.164182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e09c8b-177e-4937-985f-794bcd9e3948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc079d998ed46ec80f06cc71c643725)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:41.167006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e09c8b-177e-4937-985f-794bcd9e3948 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:41.240795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d1e09c8b-177e-4937-985f-794bcd9e3948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc079d998ed46ec80f06cc71c643725', 'request_id': 'req-d1e09c8b-177e-4937-985f-794bcd9e3948'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:41.247530 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d1e09c8b-177e-4937-985f-794bcd9e3948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc079d998ed46ec80f06cc71c643725', 'request_id': 'req-d1e09c8b-177e-4937-985f-794bcd9e3948'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:41.254560 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d1e09c8b-177e-4937-985f-794bcd9e3948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc079d998ed46ec80f06cc71c643725', 'request_id': 'req-d1e09c8b-177e-4937-985f-794bcd9e3948'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:41.273005 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d1e09c8b-177e-4937-985f-794bcd9e3948 admin admin] The token cache is being invalidate because project 8cc079d998ed46ec80f06cc71c643725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:17:41.273223 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d1e09c8b-177e-4937-985f-794bcd9e3948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:41.274170 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d1e09c8b-177e-4937-985f-794bcd9e3948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:41.276327 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1416/2816] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:17:41 2022] DELETE /identity/v3/projects/8cc079d998ed46ec80f06cc71c643725 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:17:43.755911 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e2e60-692c-4259-aaea-25d45e952abe None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:43.756590 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e2e60-692c-4259-aaea-25d45e952abe None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:43.756864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e2e60-692c-4259-aaea-25d45e952abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:43.789105 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-df5e2e60-692c-4259-aaea-25d45e952abe None None] MFA Rules not processed for user `beb2724f88054621a78b2aaa502f6538`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:43.790374 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-df5e2e60-692c-4259-aaea-25d45e952abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:43.797865 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:43.877678 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1401/2817] 10.222.0.30 () {58 vars in 967 bytes} [Wed Sep 7 13:17:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:17:43.901419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e09c8b-177e-4937-985f-794bcd9e3948 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:43.904051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d1e09c8b-177e-4937-985f-794bcd9e3948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:43.995107 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e09c8b-177e-4937-985f-794bcd9e3948 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:44.002164 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10290250-2dd3-40cc-aa4c-2d4b6784b90a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3796ca94b914fd18946551fa2bff331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:44.003003 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10290250-2dd3-40cc-aa4c-2d4b6784b90a service swift] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:44.003473 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10290250-2dd3-40cc-aa4c-2d4b6784b90a service swift] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:44.003924 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10290250-2dd3-40cc-aa4c-2d4b6784b90a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:44.022177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10290250-2dd3-40cc-aa4c-2d4b6784b90a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:44.024993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10290250-2dd3-40cc-aa4c-2d4b6784b90a service swift] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:44.039613 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1417/2818] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Sep 7 13:17:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:17:51.712235 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e2e60-692c-4259-aaea-25d45e952abe None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:51.714096 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-df5e2e60-692c-4259-aaea-25d45e952abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:51.831612 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e2e60-692c-4259-aaea-25d45e952abe None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:51.839195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1029702-13b0-45aa-9de8-07a0cad9b5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:51.840171 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1029702-13b0-45aa-9de8-07a0cad9b5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:51.840629 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1029702-13b0-45aa-9de8-07a0cad9b5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:51.841110 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1029702-13b0-45aa-9de8-07a0cad9b5d6 admin admin] PATH_INFO: `/v3/users/f9201e76ffb045d099f765f4105354fb` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:51.842949 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1029702-13b0-45aa-9de8-07a0cad9b5d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9201e76ffb045d099f765f4105354fb)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:51.845405 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1029702-13b0-45aa-9de8-07a0cad9b5d6 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:51.921849 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c1029702-13b0-45aa-9de8-07a0cad9b5d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9201e76ffb045d099f765f4105354fb'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:51.922785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c1029702-13b0-45aa-9de8-07a0cad9b5d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9201e76ffb045d099f765f4105354fb'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:51.939503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c1029702-13b0-45aa-9de8-07a0cad9b5d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9201e76ffb045d099f765f4105354fb'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:51.940648 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c1029702-13b0-45aa-9de8-07a0cad9b5d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9201e76ffb045d099f765f4105354fb'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:51.955527 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c1029702-13b0-45aa-9de8-07a0cad9b5d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9201e76ffb045d099f765f4105354fb'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:52.000403 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1402/2819] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:17:51 2022] DELETE /identity/v3/users/f9201e76ffb045d099f765f4105354fb => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:17:52.225356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10290250-2dd3-40cc-aa4c-2d4b6784b90a service swift] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:52.237926 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10290250-2dd3-40cc-aa4c-2d4b6784b90a service swift] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:52.255162 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:52.354963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:52.355963 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:52.356893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:52.357553 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252 admin admin] PATH_INFO: `/v3/projects/66cca1d999c643aa8db355d7a3d98070` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:52.359190 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66cca1d999c643aa8db355d7a3d98070)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:52.364182 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:52.452533 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66cca1d999c643aa8db355d7a3d98070', 'request_id': 'req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:52.468234 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66cca1d999c643aa8db355d7a3d98070', 'request_id': 'req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:52.475903 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66cca1d999c643aa8db355d7a3d98070', 'request_id': 'req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:52.491875 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252 admin admin] The token cache is being invalidate because project 66cca1d999c643aa8db355d7a3d98070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:17:52.492237 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:52.492890 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:52.494426 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1418/2820] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:17:52 2022] DELETE /identity/v3/projects/66cca1d999c643aa8db355d7a3d98070 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:17:52.500131 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1029702-13b0-45aa-9de8-07a0cad9b5d6 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:52.502240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c1029702-13b0-45aa-9de8-07a0cad9b5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:52.523589 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1029702-13b0-45aa-9de8-07a0cad9b5d6 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:52.580948 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:52.614614 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ea7fe-8806-4a5b-95fb-d7469de7f444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:52.615657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ea7fe-8806-4a5b-95fb-d7469de7f444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:52.616130 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ea7fe-8806-4a5b-95fb-d7469de7f444 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:52.616793 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ea7fe-8806-4a5b-95fb-d7469de7f444 admin admin] PATH_INFO: `/v3/users/cb2a1efc43f140b283863411e6ea5fa9` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:52.619049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ea7fe-8806-4a5b-95fb-d7469de7f444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb2a1efc43f140b283863411e6ea5fa9)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:52.623404 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ea7fe-8806-4a5b-95fb-d7469de7f444 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:52.707416 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c60ea7fe-8806-4a5b-95fb-d7469de7f444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb2a1efc43f140b283863411e6ea5fa9'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:52.708012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c60ea7fe-8806-4a5b-95fb-d7469de7f444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb2a1efc43f140b283863411e6ea5fa9'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:52.724783 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c60ea7fe-8806-4a5b-95fb-d7469de7f444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb2a1efc43f140b283863411e6ea5fa9'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:52.726047 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c60ea7fe-8806-4a5b-95fb-d7469de7f444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb2a1efc43f140b283863411e6ea5fa9'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:52.743281 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c60ea7fe-8806-4a5b-95fb-d7469de7f444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb2a1efc43f140b283863411e6ea5fa9'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:52.768665 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1403/2821] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:17:52 2022] DELETE /identity/v3/users/cb2a1efc43f140b283863411e6ea5fa9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:17:53.064195 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:53.066932 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:53.118384 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0509e08-8bb7-4b65-a1e6-ae45bb3a9252 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:53.240889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96320d-933a-46b8-9d82-cc16c2d49c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:53.241617 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96320d-933a-46b8-9d82-cc16c2d49c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:53.241734 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96320d-933a-46b8-9d82-cc16c2d49c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:53.241970 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96320d-933a-46b8-9d82-cc16c2d49c90 admin admin] PATH_INFO: `/v3/projects/814b51a09e7149869108b03a94538d51` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:53.243657 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96320d-933a-46b8-9d82-cc16c2d49c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=814b51a09e7149869108b03a94538d51)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:53.246056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96320d-933a-46b8-9d82-cc16c2d49c90 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:53.329817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:53.340006 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6a96320d-933a-46b8-9d82-cc16c2d49c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '814b51a09e7149869108b03a94538d51', 'request_id': 'req-6a96320d-933a-46b8-9d82-cc16c2d49c90'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:53.361128 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6a96320d-933a-46b8-9d82-cc16c2d49c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '814b51a09e7149869108b03a94538d51', 'request_id': 'req-6a96320d-933a-46b8-9d82-cc16c2d49c90'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:53.374066 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6a96320d-933a-46b8-9d82-cc16c2d49c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '814b51a09e7149869108b03a94538d51', 'request_id': 'req-6a96320d-933a-46b8-9d82-cc16c2d49c90'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:53.396564 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6a96320d-933a-46b8-9d82-cc16c2d49c90 admin admin] The token cache is being invalidate because project 814b51a09e7149869108b03a94538d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:17:53.397059 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6a96320d-933a-46b8-9d82-cc16c2d49c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:53.398581 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6a96320d-933a-46b8-9d82-cc16c2d49c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:17:53.401975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1419/2822] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:17:53 2022] DELETE /identity/v3/projects/814b51a09e7149869108b03a94538d51 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:18:02.761979 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=37,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:02.852552 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b40a10-411b-44dc-9627-64ea68166b2c None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:18:02.852951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b40a10-411b-44dc-9627-64ea68166b2c None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:18:02.853290 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b40a10-411b-44dc-9627-64ea68166b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:18:02.879773 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-93b40a10-411b-44dc-9627-64ea68166b2c None None] MFA Rules not processed for user `4aed49c244944762bf8f3c972591962c`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:18:02.881598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-93b40a10-411b-44dc-9627-64ea68166b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:18:02.954771 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1404/2823] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:18:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:18:03.389628 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:12.946463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=25 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:52.710372 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96320d-933a-46b8-9d82-cc16c2d49c90 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:18:52.713702 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6a96320d-933a-46b8-9d82-cc16c2d49c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:18:52.798839 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96320d-933a-46b8-9d82-cc16c2d49c90 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:18:52.804506 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3ff06-2fc9-4b2a-8851-be00e169611d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:18:52.805313 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3ff06-2fc9-4b2a-8851-be00e169611d service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:18:52.805954 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3ff06-2fc9-4b2a-8851-be00e169611d service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:18:52.806307 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3ff06-2fc9-4b2a-8851-be00e169611d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:18:52.810861 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e7e3ff06-2fc9-4b2a-8851-be00e169611d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:18:52.928361 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3ff06-2fc9-4b2a-8851-be00e169611d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:18:52.930125 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3ff06-2fc9-4b2a-8851-be00e169611d service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:18:52.942567 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1420/2824] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:18:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:18:54.498806 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b40a10-411b-44dc-9627-64ea68166b2c None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:18:54.500655 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-93b40a10-411b-44dc-9627-64ea68166b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:18:54.514738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b40a10-411b-44dc-9627-64ea68166b2c None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:18:54.519854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77697346-07c5-4afc-a526-8c6796b248ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:18:54.520538 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697346-07c5-4afc-a526-8c6796b248ec service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:18:54.520814 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697346-07c5-4afc-a526-8c6796b248ec service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:18:54.521068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697346-07c5-4afc-a526-8c6796b248ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:18:54.523313 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-77697346-07c5-4afc-a526-8c6796b248ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:18:54.539473 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77697346-07c5-4afc-a526-8c6796b248ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:18:54.541979 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77697346-07c5-4afc-a526-8c6796b248ec service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:18:54.558159 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1405/2825] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:18:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:02.936860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=54 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:04.297173 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9b37f-e1f1-45e2-980a-88e0398f1292 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:04.298043 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9b37f-e1f1-45e2-980a-88e0398f1292 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:04.299041 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9b37f-e1f1-45e2-980a-88e0398f1292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:04.328452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-59a9b37f-e1f1-45e2-980a-88e0398f1292 None None] MFA Rules not processed for user `4aed49c244944762bf8f3c972591962c`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:04.332081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-59a9b37f-e1f1-45e2-980a-88e0398f1292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:04.352298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1421/2826] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:19:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:04.551850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=6 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:04.836035 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77697346-07c5-4afc-a526-8c6796b248ec service cinder] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:04.838066 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-77697346-07c5-4afc-a526-8c6796b248ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:04.951482 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77697346-07c5-4afc-a526-8c6796b248ec service cinder] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:04.958030 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103beec-b52f-45ed-8bbc-b923d11bc998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:04.959107 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103beec-b52f-45ed-8bbc-b923d11bc998 service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:04.959601 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103beec-b52f-45ed-8bbc-b923d11bc998 service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:04.960081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103beec-b52f-45ed-8bbc-b923d11bc998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:04.963888 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7103beec-b52f-45ed-8bbc-b923d11bc998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:04.983019 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103beec-b52f-45ed-8bbc-b923d11bc998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:04.985775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103beec-b52f-45ed-8bbc-b923d11bc998 service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:04.996266 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1406/2827] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:05.445881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9b37f-e1f1-45e2-980a-88e0398f1292 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:05.448311 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-59a9b37f-e1f1-45e2-980a-88e0398f1292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:05.560617 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9b37f-e1f1-45e2-980a-88e0398f1292 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:05.566775 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e469e-c98b-497f-9b79-4c6fee54ba2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2420def47ee4a5b8cf4373252583d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:05.567509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e469e-c98b-497f-9b79-4c6fee54ba2e service placement] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:05.567795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e469e-c98b-497f-9b79-4c6fee54ba2e service placement] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:05.568200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e469e-c98b-497f-9b79-4c6fee54ba2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:05.570833 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-dc5e469e-c98b-497f-9b79-4c6fee54ba2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:05.585211 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e469e-c98b-497f-9b79-4c6fee54ba2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:05.586967 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e469e-c98b-497f-9b79-4c6fee54ba2e service placement] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:05.598272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1422/2828] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:07.979701 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103beec-b52f-45ed-8bbc-b923d11bc998 service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:07.999835 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103beec-b52f-45ed-8bbc-b923d11bc998 service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:08.006450 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8381d3c-a4b6-44d0-8916-d9dbaf87a4af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:08.007718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8381d3c-a4b6-44d0-8916-d9dbaf87a4af service neutron] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:08.008265 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8381d3c-a4b6-44d0-8916-d9dbaf87a4af service neutron] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:08.009022 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8381d3c-a4b6-44d0-8916-d9dbaf87a4af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:08.012599 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f8381d3c-a4b6-44d0-8916-d9dbaf87a4af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:08.032919 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8381d3c-a4b6-44d0-8916-d9dbaf87a4af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:08.034765 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8381d3c-a4b6-44d0-8916-d9dbaf87a4af service neutron] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:08.045899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1407/2829] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:15.050916 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e469e-c98b-497f-9b79-4c6fee54ba2e service placement] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.052646 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-dc5e469e-c98b-497f-9b79-4c6fee54ba2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:15.088399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e469e-c98b-497f-9b79-4c6fee54ba2e service placement] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.097930 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741014c1-2cc0-4307-abb2-8fe5b6114bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.098951 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741014c1-2cc0-4307-abb2-8fe5b6114bf9 service nova] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.099417 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741014c1-2cc0-4307-abb2-8fe5b6114bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.099988 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741014c1-2cc0-4307-abb2-8fe5b6114bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.103196 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-741014c1-2cc0-4307-abb2-8fe5b6114bf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:15.122722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741014c1-2cc0-4307-abb2-8fe5b6114bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.124900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741014c1-2cc0-4307-abb2-8fe5b6114bf9 service nova] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.141934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1423/2830] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:18.040645 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=32 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:25.135476 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=41 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:04.016304 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8381d3c-a4b6-44d0-8916-d9dbaf87a4af service neutron] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:04.040816 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8381d3c-a4b6-44d0-8916-d9dbaf87a4af service neutron] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:04.054957 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873faf32-6eb5-484a-98c9-6308d899633f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:04.055936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873faf32-6eb5-484a-98c9-6308d899633f service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:04.056413 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873faf32-6eb5-484a-98c9-6308d899633f service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:04.056915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873faf32-6eb5-484a-98c9-6308d899633f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:04.060292 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-873faf32-6eb5-484a-98c9-6308d899633f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:04.081588 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873faf32-6eb5-484a-98c9-6308d899633f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:04.084572 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873faf32-6eb5-484a-98c9-6308d899633f service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:04.103028 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1408/2831] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:14.095696 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=6 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:15.002244 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741014c1-2cc0-4307-abb2-8fe5b6114bf9 service nova] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:15.004070 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-741014c1-2cc0-4307-abb2-8fe5b6114bf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:15.142017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741014c1-2cc0-4307-abb2-8fe5b6114bf9 service nova] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:15.150385 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5a24f-7691-4575-a803-50d24d7bb795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:15.151434 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5a24f-7691-4575-a803-50d24d7bb795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:15.151766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5a24f-7691-4575-a803-50d24d7bb795 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:15.152153 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5a24f-7691-4575-a803-50d24d7bb795 admin admin] PATH_INFO: `/v3/users/4aed49c244944762bf8f3c972591962c` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:15.154372 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5a24f-7691-4575-a803-50d24d7bb795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aed49c244944762bf8f3c972591962c)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:15.158450 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5a24f-7691-4575-a803-50d24d7bb795 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:15.237054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-33e5a24f-7691-4575-a803-50d24d7bb795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aed49c244944762bf8f3c972591962c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.238117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-33e5a24f-7691-4575-a803-50d24d7bb795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aed49c244944762bf8f3c972591962c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.251293 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-33e5a24f-7691-4575-a803-50d24d7bb795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aed49c244944762bf8f3c972591962c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.272086 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-33e5a24f-7691-4575-a803-50d24d7bb795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aed49c244944762bf8f3c972591962c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.285338 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-33e5a24f-7691-4575-a803-50d24d7bb795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aed49c244944762bf8f3c972591962c'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.296701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1424/2832] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:15 2022] DELETE /identity/v3/users/4aed49c244944762bf8f3c972591962c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:15.631915 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873faf32-6eb5-484a-98c9-6308d899633f service nova] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:15.650382 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873faf32-6eb5-484a-98c9-6308d899633f service nova] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:15.749560 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dde20-1624-40f6-ba64-820fe41a4ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:15.750329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dde20-1624-40f6-ba64-820fe41a4ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:15.750792 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dde20-1624-40f6-ba64-820fe41a4ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:15.751283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dde20-1624-40f6-ba64-820fe41a4ceb admin admin] PATH_INFO: `/v3/projects/48e8b95f284642fe991a302d01b23546` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:15.753579 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dde20-1624-40f6-ba64-820fe41a4ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e8b95f284642fe991a302d01b23546)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:15.756524 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dde20-1624-40f6-ba64-820fe41a4ceb admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:15.840116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-582dde20-1624-40f6-ba64-820fe41a4ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e8b95f284642fe991a302d01b23546', 'request_id': 'req-582dde20-1624-40f6-ba64-820fe41a4ceb'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.855609 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-582dde20-1624-40f6-ba64-820fe41a4ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e8b95f284642fe991a302d01b23546', 'request_id': 'req-582dde20-1624-40f6-ba64-820fe41a4ceb'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.868425 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-582dde20-1624-40f6-ba64-820fe41a4ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e8b95f284642fe991a302d01b23546', 'request_id': 'req-582dde20-1624-40f6-ba64-820fe41a4ceb'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.892038 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-582dde20-1624-40f6-ba64-820fe41a4ceb admin admin] The token cache is being invalidate because project 48e8b95f284642fe991a302d01b23546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:15.892468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-582dde20-1624-40f6-ba64-820fe41a4ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.893544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-582dde20-1624-40f6-ba64-820fe41a4ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.895946 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1409/2833] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:15 2022] DELETE /identity/v3/projects/48e8b95f284642fe991a302d01b23546 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:15.904877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc1ec-538c-473e-ac9f-1eff69acf819 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:15.905392 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc1ec-538c-473e-ac9f-1eff69acf819 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:15.905868 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc1ec-538c-473e-ac9f-1eff69acf819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:15.942048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-8b0fc1ec-538c-473e-ac9f-1eff69acf819 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:15.944423 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8b0fc1ec-538c-473e-ac9f-1eff69acf819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:16.053144 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1425/2834] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:16.063922 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875b7f-c3f6-433b-b5c7-c80cfcf398d6 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:16.064303 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875b7f-c3f6-433b-b5c7-c80cfcf398d6 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:16.064580 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875b7f-c3f6-433b-b5c7-c80cfcf398d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:16.091244 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-f0875b7f-c3f6-433b-b5c7-c80cfcf398d6 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:16.092788 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f0875b7f-c3f6-433b-b5c7-c80cfcf398d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:16.105620 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1410/2835] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:16.112554 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fc1ec-538c-473e-ac9f-1eff69acf819 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:16.129860 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fc1ec-538c-473e-ac9f-1eff69acf819 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:16.138147 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cbce7-a205-4a1a-b6fa-415233284d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:16.139359 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cbce7-a205-4a1a-b6fa-415233284d68 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:16.139359 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cbce7-a205-4a1a-b6fa-415233284d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:16.139752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cbce7-a205-4a1a-b6fa-415233284d68 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:16.140537 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cbce7-a205-4a1a-b6fa-415233284d68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:16.141052 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cbce7-a205-4a1a-b6fa-415233284d68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:16.144252 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cbce7-a205-4a1a-b6fa-415233284d68 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:16.167568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1426/2836] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:16.172966 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0875b7f-c3f6-433b-b5c7-c80cfcf398d6 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:16.187104 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0875b7f-c3f6-433b-b5c7-c80cfcf398d6 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:16.195277 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e074a02-379f-463c-b6d7-5c72b32409df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:16.196322 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e074a02-379f-463c-b6d7-5c72b32409df admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:16.196940 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e074a02-379f-463c-b6d7-5c72b32409df admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:16.197933 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e074a02-379f-463c-b6d7-5c72b32409df admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:16.199468 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e074a02-379f-463c-b6d7-5c72b32409df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:16.203250 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e074a02-379f-463c-b6d7-5c72b32409df admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:16.274539 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1411/2837] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:16 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:16.281314 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cbce7-a205-4a1a-b6fa-415233284d68 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:16.307586 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cbce7-a205-4a1a-b6fa-415233284d68 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:16.314040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:16.403019 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af880f1e-771c-4dd7-9d7b-8e6190cee082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:16.403810 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af880f1e-771c-4dd7-9d7b-8e6190cee082 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:16.404136 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af880f1e-771c-4dd7-9d7b-8e6190cee082 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:16.404483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af880f1e-771c-4dd7-9d7b-8e6190cee082 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:16.405255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af880f1e-771c-4dd7-9d7b-8e6190cee082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:16.407339 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af880f1e-771c-4dd7-9d7b-8e6190cee082 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:16.443432 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1427/2838] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:16 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:16.450195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e074a02-379f-463c-b6d7-5c72b32409df admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:16.468347 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e074a02-379f-463c-b6d7-5c72b32409df admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:16.474230 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167890c1-de35-4e6b-95fc-26cdfda00ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:16.474889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167890c1-de35-4e6b-95fc-26cdfda00ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:16.475181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167890c1-de35-4e6b-95fc-26cdfda00ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:16.475457 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167890c1-de35-4e6b-95fc-26cdfda00ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:16.476176 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167890c1-de35-4e6b-95fc-26cdfda00ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:16.477920 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167890c1-de35-4e6b-95fc-26cdfda00ed3 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:16.490276 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1412/2839] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:16.495841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af880f1e-771c-4dd7-9d7b-8e6190cee082 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:16.515111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af880f1e-771c-4dd7-9d7b-8e6190cee082 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:16.523565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba480bb-5c56-4ee5-91a5-fda1f4ed11b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:16.524638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba480bb-5c56-4ee5-91a5-fda1f4ed11b5 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:16.525166 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba480bb-5c56-4ee5-91a5-fda1f4ed11b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:16.525635 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba480bb-5c56-4ee5-91a5-fda1f4ed11b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:16.526981 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba480bb-5c56-4ee5-91a5-fda1f4ed11b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:16.530028 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba480bb-5c56-4ee5-91a5-fda1f4ed11b5 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:16.552446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1428/2840] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:16.558009 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167890c1-de35-4e6b-95fc-26cdfda00ed3 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:16.572870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167890c1-de35-4e6b-95fc-26cdfda00ed3 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:16.580530 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bd3ac-7ea6-4a03-bf4f-e36a02d3365c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:16.581677 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bd3ac-7ea6-4a03-bf4f-e36a02d3365c admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:16.582252 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bd3ac-7ea6-4a03-bf4f-e36a02d3365c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:16.583026 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bd3ac-7ea6-4a03-bf4f-e36a02d3365c admin admin] PATH_INFO: `/v3/projects/832c7b7d9e3e43f68206675e20f6c1a0/users/1929703c39404c87976bcc8a614d87ef/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:16.612607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bd3ac-7ea6-4a03-bf4f-e36a02d3365c admin admin] RBAC: Authorizing `identity:create_grant(project_id=832c7b7d9e3e43f68206675e20f6c1a0, user_id=1929703c39404c87976bcc8a614d87ef, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:16.618006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bd3ac-7ea6-4a03-bf4f-e36a02d3365c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:16.642585 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1413/2841] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:16 2022] PUT /identity/v3/projects/832c7b7d9e3e43f68206675e20f6c1a0/users/1929703c39404c87976bcc8a614d87ef/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:16.661382 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1d26c-eefc-4ff2-81d2-0a5cfbbbdb58 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:16.661667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1d26c-eefc-4ff2-81d2-0a5cfbbbdb58 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:16.661894 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1d26c-eefc-4ff2-81d2-0a5cfbbbdb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:16.708559 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-06c1d26c-eefc-4ff2-81d2-0a5cfbbbdb58 None None] MFA Rules not processed for user `1929703c39404c87976bcc8a614d87ef`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:16.710196 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-06c1d26c-eefc-4ff2-81d2-0a5cfbbbdb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:16.822301 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1429/2842] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:16.834738 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bd3ac-7ea6-4a03-bf4f-e36a02d3365c admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:16.836963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-a06bd3ac-7ea6-4a03-bf4f-e36a02d3365c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:16.871815 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:16.949284 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bd3ac-7ea6-4a03-bf4f-e36a02d3365c admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:16.958605 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9a2c3-1575-478d-aec1-c7f2967628e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe8fa8ab8094aa69933398280810692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:16.959533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9a2c3-1575-478d-aec1-c7f2967628e8 service nova] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:16.960285 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9a2c3-1575-478d-aec1-c7f2967628e8 service nova] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:16.960561 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9a2c3-1575-478d-aec1-c7f2967628e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:16.980323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9a2c3-1575-478d-aec1-c7f2967628e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:16.983514 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9a2c3-1575-478d-aec1-c7f2967628e8 service nova] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:17.000994 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1414/2843] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:22.784463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1d26c-eefc-4ff2-81d2-0a5cfbbbdb58 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:22.907405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1d26c-eefc-4ff2-81d2-0a5cfbbbdb58 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:22.914762 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fba73d-c7cc-4422-a091-424b144b170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:22.915850 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fba73d-c7cc-4422-a091-424b144b170f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:22.915850 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fba73d-c7cc-4422-a091-424b144b170f admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:22.916228 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fba73d-c7cc-4422-a091-424b144b170f admin admin] PATH_INFO: `/v3/users/1929703c39404c87976bcc8a614d87ef` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:22.917777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fba73d-c7cc-4422-a091-424b144b170f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1929703c39404c87976bcc8a614d87ef)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:22.920157 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fba73d-c7cc-4422-a091-424b144b170f admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:22.946251 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:23.000323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-03fba73d-c7cc-4422-a091-424b144b170f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1929703c39404c87976bcc8a614d87ef'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:23.001909 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-03fba73d-c7cc-4422-a091-424b144b170f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1929703c39404c87976bcc8a614d87ef'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:23.012881 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-03fba73d-c7cc-4422-a091-424b144b170f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1929703c39404c87976bcc8a614d87ef'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:23.033580 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-03fba73d-c7cc-4422-a091-424b144b170f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1929703c39404c87976bcc8a614d87ef'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:23.052032 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-03fba73d-c7cc-4422-a091-424b144b170f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1929703c39404c87976bcc8a614d87ef'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:23.061515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1430/2844] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:22 2022] DELETE /identity/v3/users/1929703c39404c87976bcc8a614d87ef => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:23.066610 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5a67d-5e45-4f18-9fe6-e47cb59d71f5 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:23.067311 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5a67d-5e45-4f18-9fe6-e47cb59d71f5 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:23.067693 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5a67d-5e45-4f18-9fe6-e47cb59d71f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:23.106478 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-9fb5a67d-5e45-4f18-9fe6-e47cb59d71f5 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:23.110934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-9fb5a67d-5e45-4f18-9fe6-e47cb59d71f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:23.203310 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1415/2845] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:23.214590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fba73d-c7cc-4422-a091-424b144b170f admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:23.217252 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-03fba73d-c7cc-4422-a091-424b144b170f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:23.318129 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fba73d-c7cc-4422-a091-424b144b170f admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:23.324548 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62264ce7-9d03-40c9-b652-35eec532fe44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:23.325524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62264ce7-9d03-40c9-b652-35eec532fe44 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:23.325994 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62264ce7-9d03-40c9-b652-35eec532fe44 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:23.326407 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62264ce7-9d03-40c9-b652-35eec532fe44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:23.341341 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62264ce7-9d03-40c9-b652-35eec532fe44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:23.342851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62264ce7-9d03-40c9-b652-35eec532fe44 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:23.353405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1431/2846] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:23.766603 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5a67d-5e45-4f18-9fe6-e47cb59d71f5 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:23.769370 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-9fb5a67d-5e45-4f18-9fe6-e47cb59d71f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:23.792023 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5a67d-5e45-4f18-9fe6-e47cb59d71f5 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:23.799917 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a1930-8e31-41f7-a70c-1ab00921b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:23.801298 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a1930-8e31-41f7-a70c-1ab00921b38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:23.801809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a1930-8e31-41f7-a70c-1ab00921b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:23.802331 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a1930-8e31-41f7-a70c-1ab00921b38a admin admin] PATH_INFO: `/v3/projects/832c7b7d9e3e43f68206675e20f6c1a0` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:23.805041 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a1930-8e31-41f7-a70c-1ab00921b38a admin admin] RBAC: Authorizing `identity:delete_project(project_id=832c7b7d9e3e43f68206675e20f6c1a0)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:23.808071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a1930-8e31-41f7-a70c-1ab00921b38a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:23.880112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-807a1930-8e31-41f7-a70c-1ab00921b38a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832c7b7d9e3e43f68206675e20f6c1a0', 'request_id': 'req-807a1930-8e31-41f7-a70c-1ab00921b38a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:23.897897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-807a1930-8e31-41f7-a70c-1ab00921b38a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832c7b7d9e3e43f68206675e20f6c1a0', 'request_id': 'req-807a1930-8e31-41f7-a70c-1ab00921b38a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:23.908033 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-807a1930-8e31-41f7-a70c-1ab00921b38a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832c7b7d9e3e43f68206675e20f6c1a0', 'request_id': 'req-807a1930-8e31-41f7-a70c-1ab00921b38a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:23.929936 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-807a1930-8e31-41f7-a70c-1ab00921b38a admin admin] The token cache is being invalidate because project 832c7b7d9e3e43f68206675e20f6c1a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:23.930448 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-807a1930-8e31-41f7-a70c-1ab00921b38a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:23.931612 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-807a1930-8e31-41f7-a70c-1ab00921b38a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:23.934343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1416/2847] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:23 2022] DELETE /identity/v3/projects/832c7b7d9e3e43f68206675e20f6c1a0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:23.941216 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6570c1-dea2-47de-879b-79e2bef49567 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:23.942054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6570c1-dea2-47de-879b-79e2bef49567 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:23.942205 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6570c1-dea2-47de-879b-79e2bef49567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:23.970677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-5c6570c1-dea2-47de-879b-79e2bef49567 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:23.972036 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-5c6570c1-dea2-47de-879b-79e2bef49567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:24.051995 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1432/2848] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:24.061702 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdc949-745d-4a95-909a-043267134252 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.061982 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdc949-745d-4a95-909a-043267134252 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.062257 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdc949-745d-4a95-909a-043267134252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.085432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-c7fdc949-745d-4a95-909a-043267134252 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:24.086750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-c7fdc949-745d-4a95-909a-043267134252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:24.097294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1417/2849] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:24.103540 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6570c1-dea2-47de-879b-79e2bef49567 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:24.120265 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6570c1-dea2-47de-879b-79e2bef49567 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:24.127535 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792f46f-55b4-4090-a47d-89f46f4a66c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:24.128198 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792f46f-55b4-4090-a47d-89f46f4a66c7 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.128487 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792f46f-55b4-4090-a47d-89f46f4a66c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.128782 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792f46f-55b4-4090-a47d-89f46f4a66c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.129693 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792f46f-55b4-4090-a47d-89f46f4a66c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:24.130002 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792f46f-55b4-4090-a47d-89f46f4a66c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:24.131646 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792f46f-55b4-4090-a47d-89f46f4a66c7 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:24.145950 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1433/2850] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:24.152213 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdc949-745d-4a95-909a-043267134252 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:24.166996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdc949-745d-4a95-909a-043267134252 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:24.172739 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4257e-58bc-4759-a6e8-998abf20a2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:24.173464 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4257e-58bc-4759-a6e8-998abf20a2dc admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.173810 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4257e-58bc-4759-a6e8-998abf20a2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.174098 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4257e-58bc-4759-a6e8-998abf20a2dc admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.174874 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4257e-58bc-4759-a6e8-998abf20a2dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:24.177058 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4257e-58bc-4759-a6e8-998abf20a2dc admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:24.203953 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:24.214576 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1418/2851] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:24 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:24.219595 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792f46f-55b4-4090-a47d-89f46f4a66c7 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:24.231651 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792f46f-55b4-4090-a47d-89f46f4a66c7 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:24.257573 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:24.314638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b7c6e-12eb-4359-bc4c-057875d68c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:24.315272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b7c6e-12eb-4359-bc4c-057875d68c1c admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.315553 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b7c6e-12eb-4359-bc4c-057875d68c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.315829 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b7c6e-12eb-4359-bc4c-057875d68c1c admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.316521 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b7c6e-12eb-4359-bc4c-057875d68c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:24.318524 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b7c6e-12eb-4359-bc4c-057875d68c1c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:24.352715 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1434/2852] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:24 2022] POST /identity/v3/users => generated 282 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:24.357068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4257e-58bc-4759-a6e8-998abf20a2dc admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:24.369191 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4257e-58bc-4759-a6e8-998abf20a2dc admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:24.375075 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0ee2a-6e34-4bfd-ba4b-4ace99a4f502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:24.375655 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0ee2a-6e34-4bfd-ba4b-4ace99a4f502 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.375932 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0ee2a-6e34-4bfd-ba4b-4ace99a4f502 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.376239 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0ee2a-6e34-4bfd-ba4b-4ace99a4f502 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.376906 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0ee2a-6e34-4bfd-ba4b-4ace99a4f502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:24.378612 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0ee2a-6e34-4bfd-ba4b-4ace99a4f502 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:24.392611 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1419/2853] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:24.397920 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b7c6e-12eb-4359-bc4c-057875d68c1c admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:24.409454 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b7c6e-12eb-4359-bc4c-057875d68c1c admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:24.416607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d694b-40ab-418e-94ac-871896b83ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:24.416607 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d694b-40ab-418e-94ac-871896b83ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.417777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d694b-40ab-418e-94ac-871896b83ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.417777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d694b-40ab-418e-94ac-871896b83ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.417777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d694b-40ab-418e-94ac-871896b83ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:24.420199 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d694b-40ab-418e-94ac-871896b83ce0 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:24.433579 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1435/2854] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:24.439191 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0ee2a-6e34-4bfd-ba4b-4ace99a4f502 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:24.451414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0ee2a-6e34-4bfd-ba4b-4ace99a4f502 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:24.457630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aca2c-707e-4e35-8555-240ba9c31993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:24.458324 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aca2c-707e-4e35-8555-240ba9c31993 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.458597 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aca2c-707e-4e35-8555-240ba9c31993 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.458847 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aca2c-707e-4e35-8555-240ba9c31993 admin admin] PATH_INFO: `/v3/projects/0b1e0426bf0a4db2a61be7f70061760f/users/1b9f3226eae340f0ac75ef8e9dad5cc8/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.476260 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273aca2c-707e-4e35-8555-240ba9c31993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1e0426bf0a4db2a61be7f70061760f, user_id=1b9f3226eae340f0ac75ef8e9dad5cc8, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:24.479870 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273aca2c-707e-4e35-8555-240ba9c31993 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:24.504923 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1420/2855] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:24 2022] PUT /identity/v3/projects/0b1e0426bf0a4db2a61be7f70061760f/users/1b9f3226eae340f0ac75ef8e9dad5cc8/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:24.518631 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84769ae4-ad75-417d-ace4-fd781268f00f None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.519056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84769ae4-ad75-417d-ace4-fd781268f00f None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.519283 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84769ae4-ad75-417d-ace4-fd781268f00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.553375 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-84769ae4-ad75-417d-ace4-fd781268f00f None None] MFA Rules not processed for user `1b9f3226eae340f0ac75ef8e9dad5cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:24.554597 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-84769ae4-ad75-417d-ace4-fd781268f00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:24.633590 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1436/2856] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:24.638793 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aca2c-707e-4e35-8555-240ba9c31993 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:24.719746 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aca2c-707e-4e35-8555-240ba9c31993 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:24.724947 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996cc28-3fd2-4303-abb4-7d74c8f57ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:24.725566 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996cc28-3fd2-4303-abb4-7d74c8f57ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.725848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996cc28-3fd2-4303-abb4-7d74c8f57ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.726121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996cc28-3fd2-4303-abb4-7d74c8f57ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.726772 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996cc28-3fd2-4303-abb4-7d74c8f57ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:24.728967 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996cc28-3fd2-4303-abb4-7d74c8f57ba1 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:24.761630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1421/2857] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:24 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:24.767004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84769ae4-ad75-417d-ace4-fd781268f00f None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:24.781400 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84769ae4-ad75-417d-ace4-fd781268f00f None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:24.860577 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d58985-6bf3-4114-8dea-2cc3978e0b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:24.861202 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d58985-6bf3-4114-8dea-2cc3978e0b84 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.861483 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d58985-6bf3-4114-8dea-2cc3978e0b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.861749 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d58985-6bf3-4114-8dea-2cc3978e0b84 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.862398 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d58985-6bf3-4114-8dea-2cc3978e0b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:24.864498 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d58985-6bf3-4114-8dea-2cc3978e0b84 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:24.891572 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1437/2858] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:24 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:24.896350 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996cc28-3fd2-4303-abb4-7d74c8f57ba1 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:24.909042 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996cc28-3fd2-4303-abb4-7d74c8f57ba1 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:24.916045 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c7caa-3e7e-423e-8684-8025e06e2662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:24.916785 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c7caa-3e7e-423e-8684-8025e06e2662 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.917059 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c7caa-3e7e-423e-8684-8025e06e2662 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.917367 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c7caa-3e7e-423e-8684-8025e06e2662 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.918025 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c7caa-3e7e-423e-8684-8025e06e2662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:24.919619 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c7caa-3e7e-423e-8684-8025e06e2662 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:24.933539 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1422/2859] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:24.941912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d58985-6bf3-4114-8dea-2cc3978e0b84 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:24.962040 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d58985-6bf3-4114-8dea-2cc3978e0b84 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:24.971563 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c7932-39a4-4382-a023-cc1d3582370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:24.977701 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c7932-39a4-4382-a023-cc1d3582370f admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.978171 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c7932-39a4-4382-a023-cc1d3582370f admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.979323 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c7932-39a4-4382-a023-cc1d3582370f admin admin] PATH_INFO: `/v3/projects/88cc87f2d30747c5879c8787dc8eb546/users/65e99a1b02304c16ac99019fe90d54cd/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.010077 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c7932-39a4-4382-a023-cc1d3582370f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88cc87f2d30747c5879c8787dc8eb546, user_id=65e99a1b02304c16ac99019fe90d54cd, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:25.013007 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c7932-39a4-4382-a023-cc1d3582370f admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:25.028245 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:25.040120 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1438/2860] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:24 2022] PUT /identity/v3/projects/88cc87f2d30747c5879c8787dc8eb546/users/65e99a1b02304c16ac99019fe90d54cd/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:25.044809 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c7caa-3e7e-423e-8684-8025e06e2662 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:25.059974 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c7caa-3e7e-423e-8684-8025e06e2662 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:25.157740 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3581e5f-ddfe-4c07-b7cc-72c9adb2d15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:25.158750 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3581e5f-ddfe-4c07-b7cc-72c9adb2d15e admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.159253 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3581e5f-ddfe-4c07-b7cc-72c9adb2d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.159713 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3581e5f-ddfe-4c07-b7cc-72c9adb2d15e admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.161264 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3581e5f-ddfe-4c07-b7cc-72c9adb2d15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:25.163848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3581e5f-ddfe-4c07-b7cc-72c9adb2d15e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:25.182090 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1423/2861] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:25.186470 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c7932-39a4-4382-a023-cc1d3582370f admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:25.197665 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c7932-39a4-4382-a023-cc1d3582370f admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:25.204901 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48017a2b-b310-49b3-a1d3-25a426b89bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:25.205565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48017a2b-b310-49b3-a1d3-25a426b89bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.205840 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48017a2b-b310-49b3-a1d3-25a426b89bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.206114 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48017a2b-b310-49b3-a1d3-25a426b89bb3 admin admin] PATH_INFO: `/v3/projects/88cc87f2d30747c5879c8787dc8eb546/users/65e99a1b02304c16ac99019fe90d54cd/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.208064 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48017a2b-b310-49b3-a1d3-25a426b89bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88cc87f2d30747c5879c8787dc8eb546, user_id=65e99a1b02304c16ac99019fe90d54cd, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:25.210853 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48017a2b-b310-49b3-a1d3-25a426b89bb3 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:25.223307 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1439/2862] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:25 2022] PUT /identity/v3/projects/88cc87f2d30747c5879c8787dc8eb546/users/65e99a1b02304c16ac99019fe90d54cd/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:25.239968 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caf9ed-c15c-4c3d-8eef-596ba633b1b5 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.240272 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caf9ed-c15c-4c3d-8eef-596ba633b1b5 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.240578 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caf9ed-c15c-4c3d-8eef-596ba633b1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.274281 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-05caf9ed-c15c-4c3d-8eef-596ba633b1b5 None None] MFA Rules not processed for user `65e99a1b02304c16ac99019fe90d54cd`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:25.275484 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-05caf9ed-c15c-4c3d-8eef-596ba633b1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:25.305409 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:25.413670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1424/2863] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:25.428815 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48017a2b-b310-49b3-a1d3-25a426b89bb3 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:25.432799 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-48017a2b-b310-49b3-a1d3-25a426b89bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:25.514355 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48017a2b-b310-49b3-a1d3-25a426b89bb3 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:25.518298 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c19717-a422-4abb-804c-93c85f2186e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:25.519074 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c19717-a422-4abb-804c-93c85f2186e1 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.519445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c19717-a422-4abb-804c-93c85f2186e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.519445 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c19717-a422-4abb-804c-93c85f2186e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.534836 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c19717-a422-4abb-804c-93c85f2186e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:25.537600 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c19717-a422-4abb-804c-93c85f2186e1 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:25.554316 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1440/2864] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:25.652401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05caf9ed-c15c-4c3d-8eef-596ba633b1b5 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:25.677854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05caf9ed-c15c-4c3d-8eef-596ba633b1b5 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:25.686926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cfe72-2afb-41f8-b31a-d375c31e2975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:25.688396 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cfe72-2afb-41f8-b31a-d375c31e2975 service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.688795 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cfe72-2afb-41f8-b31a-d375c31e2975 service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.689068 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cfe72-2afb-41f8-b31a-d375c31e2975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.791681 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cfe72-2afb-41f8-b31a-d375c31e2975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:25.794180 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cfe72-2afb-41f8-b31a-d375c31e2975 service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:25.809012 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1425/2865] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:28.786993 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c19717-a422-4abb-804c-93c85f2186e1 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:28.866734 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c19717-a422-4abb-804c-93c85f2186e1 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:28.871856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e2213-29ed-4182-921c-7dd438e1bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:28.872544 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e2213-29ed-4182-921c-7dd438e1bae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:28.872824 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e2213-29ed-4182-921c-7dd438e1bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:28.873097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e2213-29ed-4182-921c-7dd438e1bae3 admin admin] PATH_INFO: `/v3/users/1b9f3226eae340f0ac75ef8e9dad5cc8` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:28.874255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e2213-29ed-4182-921c-7dd438e1bae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9f3226eae340f0ac75ef8e9dad5cc8)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:28.876204 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e2213-29ed-4182-921c-7dd438e1bae3 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:28.942280 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6d5e2213-29ed-4182-921c-7dd438e1bae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9f3226eae340f0ac75ef8e9dad5cc8'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:28.943030 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6d5e2213-29ed-4182-921c-7dd438e1bae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9f3226eae340f0ac75ef8e9dad5cc8'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:28.950827 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6d5e2213-29ed-4182-921c-7dd438e1bae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9f3226eae340f0ac75ef8e9dad5cc8'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:28.965728 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6d5e2213-29ed-4182-921c-7dd438e1bae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9f3226eae340f0ac75ef8e9dad5cc8'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:28.979832 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-6d5e2213-29ed-4182-921c-7dd438e1bae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9f3226eae340f0ac75ef8e9dad5cc8'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:28.990488 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1441/2866] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:28 2022] DELETE /identity/v3/users/1b9f3226eae340f0ac75ef8e9dad5cc8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:28.996520 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c57eec-263f-4032-b25a-5908d1a46a2b None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:28.997456 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c57eec-263f-4032-b25a-5908d1a46a2b None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:28.997641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c57eec-263f-4032-b25a-5908d1a46a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:29.020811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-07c57eec-263f-4032-b25a-5908d1a46a2b None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:29.022070 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-07c57eec-263f-4032-b25a-5908d1a46a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:29.086893 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1426/2867] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:29.098545 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e2213-29ed-4182-921c-7dd438e1bae3 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:29.100809 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-6d5e2213-29ed-4182-921c-7dd438e1bae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:29.112787 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:29.177479 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e2213-29ed-4182-921c-7dd438e1bae3 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:29.185048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f037bf-9266-40f1-a099-0d3b33f7788c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:29.186124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f037bf-9266-40f1-a099-0d3b33f7788c service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:29.186629 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f037bf-9266-40f1-a099-0d3b33f7788c service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:29.187069 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f037bf-9266-40f1-a099-0d3b33f7788c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:29.198642 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f037bf-9266-40f1-a099-0d3b33f7788c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:29.200114 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f037bf-9266-40f1-a099-0d3b33f7788c service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:29.214138 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1442/2868] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:29.531673 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c57eec-263f-4032-b25a-5908d1a46a2b None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:29.533387 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-07c57eec-263f-4032-b25a-5908d1a46a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:29.547864 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c57eec-263f-4032-b25a-5908d1a46a2b None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:29.553641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:29.554308 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:29.554596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:29.555147 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7 admin admin] PATH_INFO: `/v3/projects/0b1e0426bf0a4db2a61be7f70061760f` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:29.557063 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1e0426bf0a4db2a61be7f70061760f)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:29.559181 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:29.612977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1e0426bf0a4db2a61be7f70061760f', 'request_id': 'req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:29.615652 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:29.624479 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1e0426bf0a4db2a61be7f70061760f', 'request_id': 'req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:29.631787 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1e0426bf0a4db2a61be7f70061760f', 'request_id': 'req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:29.644562 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7 admin admin] The token cache is being invalidate because project 0b1e0426bf0a4db2a61be7f70061760f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:29.644874 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:29.645500 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:29.647007 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1427/2869] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:29 2022] DELETE /identity/v3/projects/0b1e0426bf0a4db2a61be7f70061760f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:29.651700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f037bf-9266-40f1-a099-0d3b33f7788c service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:29.661828 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f037bf-9266-40f1-a099-0d3b33f7788c service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:29.724776 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa658c4-73b1-4c3e-a8a0-809c3e48df83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:29.725414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa658c4-73b1-4c3e-a8a0-809c3e48df83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:29.725800 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa658c4-73b1-4c3e-a8a0-809c3e48df83 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:29.725966 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa658c4-73b1-4c3e-a8a0-809c3e48df83 admin admin] PATH_INFO: `/v3/users/65e99a1b02304c16ac99019fe90d54cd` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:29.727263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa658c4-73b1-4c3e-a8a0-809c3e48df83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e99a1b02304c16ac99019fe90d54cd)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:29.729411 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa658c4-73b1-4c3e-a8a0-809c3e48df83 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:29.785213 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cfa658c4-73b1-4c3e-a8a0-809c3e48df83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e99a1b02304c16ac99019fe90d54cd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:29.785893 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cfa658c4-73b1-4c3e-a8a0-809c3e48df83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e99a1b02304c16ac99019fe90d54cd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:29.793750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cfa658c4-73b1-4c3e-a8a0-809c3e48df83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e99a1b02304c16ac99019fe90d54cd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:29.807436 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cfa658c4-73b1-4c3e-a8a0-809c3e48df83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e99a1b02304c16ac99019fe90d54cd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:29.815523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-cfa658c4-73b1-4c3e-a8a0-809c3e48df83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e99a1b02304c16ac99019fe90d54cd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:29.822472 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1443/2870] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:29 2022] DELETE /identity/v3/users/65e99a1b02304c16ac99019fe90d54cd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:30.208184 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:30.210898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:30.236011 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef0c88-2969-4db2-b2f4-6fc2308ec6a7 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:30.334873 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d97c82-7218-4f31-9ca7-88cf7b191898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:30.335897 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d97c82-7218-4f31-9ca7-88cf7b191898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:30.336483 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d97c82-7218-4f31-9ca7-88cf7b191898 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:30.336958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d97c82-7218-4f31-9ca7-88cf7b191898 admin admin] PATH_INFO: `/v3/projects/88cc87f2d30747c5879c8787dc8eb546` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:30.339036 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d97c82-7218-4f31-9ca7-88cf7b191898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88cc87f2d30747c5879c8787dc8eb546)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:30.341918 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d97c82-7218-4f31-9ca7-88cf7b191898 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:30.428300 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-40d97c82-7218-4f31-9ca7-88cf7b191898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88cc87f2d30747c5879c8787dc8eb546', 'request_id': 'req-40d97c82-7218-4f31-9ca7-88cf7b191898'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:30.443380 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-40d97c82-7218-4f31-9ca7-88cf7b191898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88cc87f2d30747c5879c8787dc8eb546', 'request_id': 'req-40d97c82-7218-4f31-9ca7-88cf7b191898'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:30.455749 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-40d97c82-7218-4f31-9ca7-88cf7b191898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88cc87f2d30747c5879c8787dc8eb546', 'request_id': 'req-40d97c82-7218-4f31-9ca7-88cf7b191898'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:30.473164 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-40d97c82-7218-4f31-9ca7-88cf7b191898 admin admin] The token cache is being invalidate because project 88cc87f2d30747c5879c8787dc8eb546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:30.473470 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-40d97c82-7218-4f31-9ca7-88cf7b191898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:30.474120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-40d97c82-7218-4f31-9ca7-88cf7b191898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:30.475731 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1428/2871] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:30 2022] DELETE /identity/v3/projects/88cc87f2d30747c5879c8787dc8eb546 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:30.484112 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5c94e-c621-49fc-9d69-632cc0d00c91 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:30.484700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5c94e-c621-49fc-9d69-632cc0d00c91 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:30.485217 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5c94e-c621-49fc-9d69-632cc0d00c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:30.512310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-41d5c94e-c621-49fc-9d69-632cc0d00c91 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:30.513887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-41d5c94e-c621-49fc-9d69-632cc0d00c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:30.560083 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:30.624255 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1444/2872] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:30.637238 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675302a-c013-4508-957b-b9c295ef1d89 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:30.637553 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675302a-c013-4508-957b-b9c295ef1d89 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:30.637857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675302a-c013-4508-957b-b9c295ef1d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:30.662158 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-1675302a-c013-4508-957b-b9c295ef1d89 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:30.663723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-1675302a-c013-4508-957b-b9c295ef1d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:30.673741 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1429/2873] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:30.678864 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5c94e-c621-49fc-9d69-632cc0d00c91 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:30.692429 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5c94e-c621-49fc-9d69-632cc0d00c91 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:30.700660 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ad5ba-a8b3-4574-9f19-02ed72c47c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:30.701748 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ad5ba-a8b3-4574-9f19-02ed72c47c91 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:30.702289 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ad5ba-a8b3-4574-9f19-02ed72c47c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:30.702773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ad5ba-a8b3-4574-9f19-02ed72c47c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:30.703959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ad5ba-a8b3-4574-9f19-02ed72c47c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:30.704515 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ad5ba-a8b3-4574-9f19-02ed72c47c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:30.707601 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ad5ba-a8b3-4574-9f19-02ed72c47c91 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:30.729163 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1445/2874] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:20:30.735389 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675302a-c013-4508-957b-b9c295ef1d89 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:30.751815 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675302a-c013-4508-957b-b9c295ef1d89 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:30.758401 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6c5be-a5c7-455c-bc4e-dfc349f61528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:30.759723 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6c5be-a5c7-455c-bc4e-dfc349f61528 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:30.760006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6c5be-a5c7-455c-bc4e-dfc349f61528 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:30.760280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6c5be-a5c7-455c-bc4e-dfc349f61528 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:30.761004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6c5be-a5c7-455c-bc4e-dfc349f61528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:30.763516 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6c5be-a5c7-455c-bc4e-dfc349f61528 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:30.814177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1430/2875] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:30 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:30.820126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ad5ba-a8b3-4574-9f19-02ed72c47c91 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:30.839680 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ad5ba-a8b3-4574-9f19-02ed72c47c91 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:30.945099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44996581-02af-44fd-ac33-50ce9635ce4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:30.946124 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44996581-02af-44fd-ac33-50ce9635ce4e admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:30.946603 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44996581-02af-44fd-ac33-50ce9635ce4e admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:30.946895 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44996581-02af-44fd-ac33-50ce9635ce4e admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:30.948000 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44996581-02af-44fd-ac33-50ce9635ce4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:30.950912 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44996581-02af-44fd-ac33-50ce9635ce4e admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:30.988626 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1446/2876] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:30 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:30.994220 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6c5be-a5c7-455c-bc4e-dfc349f61528 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.010690 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6c5be-a5c7-455c-bc4e-dfc349f61528 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.018523 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ac1e5-9654-43b8-8ffd-3dae68b15164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.019458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ac1e5-9654-43b8-8ffd-3dae68b15164 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.019848 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ac1e5-9654-43b8-8ffd-3dae68b15164 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.020129 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ac1e5-9654-43b8-8ffd-3dae68b15164 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.021555 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ac1e5-9654-43b8-8ffd-3dae68b15164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.023592 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ac1e5-9654-43b8-8ffd-3dae68b15164 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.039753 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1431/2877] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:31.044638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44996581-02af-44fd-ac33-50ce9635ce4e admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.057196 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44996581-02af-44fd-ac33-50ce9635ce4e admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.071859 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb2ef8-6adf-43fe-9433-c088ac0795de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.073095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb2ef8-6adf-43fe-9433-c088ac0795de admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.073602 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb2ef8-6adf-43fe-9433-c088ac0795de admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.074065 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb2ef8-6adf-43fe-9433-c088ac0795de admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.075667 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb2ef8-6adf-43fe-9433-c088ac0795de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.078492 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb2ef8-6adf-43fe-9433-c088ac0795de admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.102837 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1447/2878] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:31.110048 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ac1e5-9654-43b8-8ffd-3dae68b15164 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.129000 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ac1e5-9654-43b8-8ffd-3dae68b15164 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.136843 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829e65a-44e2-4188-abe5-a48e41006db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.138043 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829e65a-44e2-4188-abe5-a48e41006db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.138500 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829e65a-44e2-4188-abe5-a48e41006db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.138957 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829e65a-44e2-4188-abe5-a48e41006db9 admin admin] PATH_INFO: `/v3/projects/f8a38b7319f44cbbbac0f5bbce1e4963/users/7d42107670c24dbc90ae5827c7305dee/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.165461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829e65a-44e2-4188-abe5-a48e41006db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a38b7319f44cbbbac0f5bbce1e4963, user_id=7d42107670c24dbc90ae5827c7305dee, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.170983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829e65a-44e2-4188-abe5-a48e41006db9 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.196605 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1432/2879] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:31 2022] PUT /identity/v3/projects/f8a38b7319f44cbbbac0f5bbce1e4963/users/7d42107670c24dbc90ae5827c7305dee/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:31.213742 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c73bb9-3d1a-496c-8542-26ffa001ab81 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.214088 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c73bb9-3d1a-496c-8542-26ffa001ab81 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.214337 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c73bb9-3d1a-496c-8542-26ffa001ab81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.265349 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-e1c73bb9-3d1a-496c-8542-26ffa001ab81 None None] MFA Rules not processed for user `7d42107670c24dbc90ae5827c7305dee`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:31.266777 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e1c73bb9-3d1a-496c-8542-26ffa001ab81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:31.398063 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1448/2880] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:31.404446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829e65a-44e2-4188-abe5-a48e41006db9 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.416031 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:31.490214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829e65a-44e2-4188-abe5-a48e41006db9 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.497329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f682ed7-1890-41ab-9507-ded436fb7018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.497978 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f682ed7-1890-41ab-9507-ded436fb7018 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.498255 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f682ed7-1890-41ab-9507-ded436fb7018 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.498525 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f682ed7-1890-41ab-9507-ded436fb7018 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.499194 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f682ed7-1890-41ab-9507-ded436fb7018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.501186 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f682ed7-1890-41ab-9507-ded436fb7018 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.549458 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1433/2881] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:31 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:31.553822 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c73bb9-3d1a-496c-8542-26ffa001ab81 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.567146 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c73bb9-3d1a-496c-8542-26ffa001ab81 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.606210 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:31.661354 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aa90d-c28a-427f-b722-c32df412b4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.661984 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aa90d-c28a-427f-b722-c32df412b4dd admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.662263 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aa90d-c28a-427f-b722-c32df412b4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.662539 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aa90d-c28a-427f-b722-c32df412b4dd admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.663227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4aa90d-c28a-427f-b722-c32df412b4dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.665527 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4aa90d-c28a-427f-b722-c32df412b4dd admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.695027 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1449/2882] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:31 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:31.700701 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f682ed7-1890-41ab-9507-ded436fb7018 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.718160 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f682ed7-1890-41ab-9507-ded436fb7018 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.724853 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99228d-243c-43c4-a8b8-4c19cf3a973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.725535 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99228d-243c-43c4-a8b8-4c19cf3a973c admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.725805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99228d-243c-43c4-a8b8-4c19cf3a973c admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.726081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99228d-243c-43c4-a8b8-4c19cf3a973c admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.726765 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99228d-243c-43c4-a8b8-4c19cf3a973c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.728596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99228d-243c-43c4-a8b8-4c19cf3a973c admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.740316 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1434/2883] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:31.745196 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aa90d-c28a-427f-b722-c32df412b4dd admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.756225 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aa90d-c28a-427f-b722-c32df412b4dd admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.761984 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621353c-0cca-46f5-af80-7956459c7780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.762652 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621353c-0cca-46f5-af80-7956459c7780 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.762930 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621353c-0cca-46f5-af80-7956459c7780 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.763200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621353c-0cca-46f5-af80-7956459c7780 admin admin] PATH_INFO: `/v3/projects/19ff429bea2c4601a08db77313e34110/users/84e5225f58bd4604bf9ec054723097bd/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.780227 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621353c-0cca-46f5-af80-7956459c7780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ff429bea2c4601a08db77313e34110, user_id=84e5225f58bd4604bf9ec054723097bd, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.783059 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621353c-0cca-46f5-af80-7956459c7780 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.801232 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1450/2884] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:31 2022] PUT /identity/v3/projects/19ff429bea2c4601a08db77313e34110/users/84e5225f58bd4604bf9ec054723097bd/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:31.806934 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99228d-243c-43c4-a8b8-4c19cf3a973c admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.818682 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99228d-243c-43c4-a8b8-4c19cf3a973c admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.885094 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fe7a4-285b-40a1-bc6c-26182057fb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.885717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fe7a4-285b-40a1-bc6c-26182057fb03 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.885983 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fe7a4-285b-40a1-bc6c-26182057fb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.886265 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fe7a4-285b-40a1-bc6c-26182057fb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.886899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fe7a4-285b-40a1-bc6c-26182057fb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.888554 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fe7a4-285b-40a1-bc6c-26182057fb03 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.906109 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1435/2885] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:31.910619 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621353c-0cca-46f5-af80-7956459c7780 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.922652 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621353c-0cca-46f5-af80-7956459c7780 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.928352 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc922953-76b2-4df9-9b1c-9e3ad453ccd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.929116 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc922953-76b2-4df9-9b1c-9e3ad453ccd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.929385 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc922953-76b2-4df9-9b1c-9e3ad453ccd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.929998 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc922953-76b2-4df9-9b1c-9e3ad453ccd3 admin admin] PATH_INFO: `/v3/projects/19ff429bea2c4601a08db77313e34110/users/84e5225f58bd4604bf9ec054723097bd/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.932004 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc922953-76b2-4df9-9b1c-9e3ad453ccd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ff429bea2c4601a08db77313e34110, user_id=84e5225f58bd4604bf9ec054723097bd, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.934737 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc922953-76b2-4df9-9b1c-9e3ad453ccd3 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.947758 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1451/2886] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:31 2022] PUT /identity/v3/projects/19ff429bea2c4601a08db77313e34110/users/84e5225f58bd4604bf9ec054723097bd/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:31.958757 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff61370-a9da-439b-9838-41dcb9314792 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.959015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff61370-a9da-439b-9838-41dcb9314792 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.959296 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff61370-a9da-439b-9838-41dcb9314792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.989215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-cff61370-a9da-439b-9838-41dcb9314792 None None] MFA Rules not processed for user `84e5225f58bd4604bf9ec054723097bd`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:31.990439 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-cff61370-a9da-439b-9838-41dcb9314792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:32.065958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1436/2887] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:32.078010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc922953-76b2-4df9-9b1c-9e3ad453ccd3 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:32.080296 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-dc922953-76b2-4df9-9b1c-9e3ad453ccd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:32.141185 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc922953-76b2-4df9-9b1c-9e3ad453ccd3 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:32.145565 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b9052-0a01-4779-bb76-8d290eaa106f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:32.146150 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b9052-0a01-4779-bb76-8d290eaa106f service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:32.146429 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b9052-0a01-4779-bb76-8d290eaa106f service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:32.146692 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b9052-0a01-4779-bb76-8d290eaa106f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:32.159867 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b9052-0a01-4779-bb76-8d290eaa106f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:32.161372 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b9052-0a01-4779-bb76-8d290eaa106f service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:32.173857 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1452/2888] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:32.291607 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff61370-a9da-439b-9838-41dcb9314792 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:32.296442 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:32.303846 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff61370-a9da-439b-9838-41dcb9314792 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:32.308254 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345ac93-4953-4ea6-8292-8081ce90c059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:32.308995 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345ac93-4953-4ea6-8292-8081ce90c059 service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:32.309282 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345ac93-4953-4ea6-8292-8081ce90c059 service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:32.309565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345ac93-4953-4ea6-8292-8081ce90c059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:32.373913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345ac93-4953-4ea6-8292-8081ce90c059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:32.375417 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345ac93-4953-4ea6-8292-8081ce90c059 service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:32.385859 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1437/2889] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:35.119104 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b9052-0a01-4779-bb76-8d290eaa106f service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:35.189965 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b9052-0a01-4779-bb76-8d290eaa106f service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:35.194369 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707ce31-87ba-4e7b-8e96-e9fdb294d57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:35.195126 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707ce31-87ba-4e7b-8e96-e9fdb294d57c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:35.195874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707ce31-87ba-4e7b-8e96-e9fdb294d57c admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:35.195874 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707ce31-87ba-4e7b-8e96-e9fdb294d57c admin admin] PATH_INFO: `/v3/users/7d42107670c24dbc90ae5827c7305dee` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:35.196940 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707ce31-87ba-4e7b-8e96-e9fdb294d57c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d42107670c24dbc90ae5827c7305dee)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:35.198908 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707ce31-87ba-4e7b-8e96-e9fdb294d57c admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:35.225231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:35.269795 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8707ce31-87ba-4e7b-8e96-e9fdb294d57c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d42107670c24dbc90ae5827c7305dee'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.270578 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8707ce31-87ba-4e7b-8e96-e9fdb294d57c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d42107670c24dbc90ae5827c7305dee'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.279452 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8707ce31-87ba-4e7b-8e96-e9fdb294d57c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d42107670c24dbc90ae5827c7305dee'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.296235 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8707ce31-87ba-4e7b-8e96-e9fdb294d57c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d42107670c24dbc90ae5827c7305dee'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.306092 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-8707ce31-87ba-4e7b-8e96-e9fdb294d57c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d42107670c24dbc90ae5827c7305dee'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.317399 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1453/2890] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:35 2022] DELETE /identity/v3/users/7d42107670c24dbc90ae5827c7305dee => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:35.318842 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25f515-43d6-4c8b-8e84-d867a4599042 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:35.319437 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25f515-43d6-4c8b-8e84-d867a4599042 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:35.319437 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25f515-43d6-4c8b-8e84-d867a4599042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:35.340071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-7c25f515-43d6-4c8b-8e84-d867a4599042 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:35.341372 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7c25f515-43d6-4c8b-8e84-d867a4599042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:35.418329 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1438/2891] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:35.428978 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707ce31-87ba-4e7b-8e96-e9fdb294d57c admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:35.430925 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-8707ce31-87ba-4e7b-8e96-e9fdb294d57c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:35.508959 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707ce31-87ba-4e7b-8e96-e9fdb294d57c admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:35.513554 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bed00-5855-4bec-85e9-5fdb3a02d48a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:35.514209 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bed00-5855-4bec-85e9-5fdb3a02d48a service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:35.514474 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bed00-5855-4bec-85e9-5fdb3a02d48a service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:35.514749 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bed00-5855-4bec-85e9-5fdb3a02d48a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:35.526571 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bed00-5855-4bec-85e9-5fdb3a02d48a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:35.528048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bed00-5855-4bec-85e9-5fdb3a02d48a service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:35.538529 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1454/2892] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:35.845137 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25f515-43d6-4c8b-8e84-d867a4599042 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:35.847146 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-7c25f515-43d6-4c8b-8e84-d867a4599042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:35.862518 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25f515-43d6-4c8b-8e84-d867a4599042 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:35.881461 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9878e4d-f199-4e04-9446-4d6954a8e41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:35.882214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9878e4d-f199-4e04-9446-4d6954a8e41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:35.882600 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9878e4d-f199-4e04-9446-4d6954a8e41f admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:35.882958 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9878e4d-f199-4e04-9446-4d6954a8e41f admin admin] PATH_INFO: `/v3/projects/f8a38b7319f44cbbbac0f5bbce1e4963` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:35.884582 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9878e4d-f199-4e04-9446-4d6954a8e41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a38b7319f44cbbbac0f5bbce1e4963)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:35.886641 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9878e4d-f199-4e04-9446-4d6954a8e41f admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:35.947997 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d9878e4d-f199-4e04-9446-4d6954a8e41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a38b7319f44cbbbac0f5bbce1e4963', 'request_id': 'req-d9878e4d-f199-4e04-9446-4d6954a8e41f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.956815 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d9878e4d-f199-4e04-9446-4d6954a8e41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a38b7319f44cbbbac0f5bbce1e4963', 'request_id': 'req-d9878e4d-f199-4e04-9446-4d6954a8e41f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.964195 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d9878e4d-f199-4e04-9446-4d6954a8e41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a38b7319f44cbbbac0f5bbce1e4963', 'request_id': 'req-d9878e4d-f199-4e04-9446-4d6954a8e41f'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.977606 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d9878e4d-f199-4e04-9446-4d6954a8e41f admin admin] The token cache is being invalidate because project f8a38b7319f44cbbbac0f5bbce1e4963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:35.977951 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d9878e4d-f199-4e04-9446-4d6954a8e41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.978644 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-d9878e4d-f199-4e04-9446-4d6954a8e41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.980243 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1439/2893] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:35 2022] DELETE /identity/v3/projects/f8a38b7319f44cbbbac0f5bbce1e4963 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:35.984544 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bed00-5855-4bec-85e9-5fdb3a02d48a service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:35.995875 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bed00-5855-4bec-85e9-5fdb3a02d48a service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:36.066546 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a35a64-a58c-4df9-bfd2-977038c4f501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:36.067193 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a35a64-a58c-4df9-bfd2-977038c4f501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:36.067475 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a35a64-a58c-4df9-bfd2-977038c4f501 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:36.067751 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a35a64-a58c-4df9-bfd2-977038c4f501 admin admin] PATH_INFO: `/v3/users/84e5225f58bd4604bf9ec054723097bd` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:36.068980 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a35a64-a58c-4df9-bfd2-977038c4f501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e5225f58bd4604bf9ec054723097bd)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:36.071047 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a35a64-a58c-4df9-bfd2-977038c4f501 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:36.140754 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:36.145360 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b6a35a64-a58c-4df9-bfd2-977038c4f501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e5225f58bd4604bf9ec054723097bd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:36.146250 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b6a35a64-a58c-4df9-bfd2-977038c4f501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e5225f58bd4604bf9ec054723097bd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:36.162099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b6a35a64-a58c-4df9-bfd2-977038c4f501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e5225f58bd4604bf9ec054723097bd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:36.180016 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b6a35a64-a58c-4df9-bfd2-977038c4f501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e5225f58bd4604bf9ec054723097bd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:36.190568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-b6a35a64-a58c-4df9-bfd2-977038c4f501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e5225f58bd4604bf9ec054723097bd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:36.199081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1455/2894] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:35 2022] DELETE /identity/v3/users/84e5225f58bd4604bf9ec054723097bd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:36.519822 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9878e4d-f199-4e04-9446-4d6954a8e41f admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:36.521638 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-d9878e4d-f199-4e04-9446-4d6954a8e41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:36.538090 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9878e4d-f199-4e04-9446-4d6954a8e41f admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:36.562931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:36.610574 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dd4db-7ea3-4213-befa-be689a48eb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:36.611414 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dd4db-7ea3-4213-befa-be689a48eb2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:36.611733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dd4db-7ea3-4213-befa-be689a48eb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:36.612073 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dd4db-7ea3-4213-befa-be689a48eb2a admin admin] PATH_INFO: `/v3/projects/19ff429bea2c4601a08db77313e34110` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:36.613509 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dd4db-7ea3-4213-befa-be689a48eb2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ff429bea2c4601a08db77313e34110)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:36.615636 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dd4db-7ea3-4213-befa-be689a48eb2a admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:36.670871 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c07dd4db-7ea3-4213-befa-be689a48eb2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ff429bea2c4601a08db77313e34110', 'request_id': 'req-c07dd4db-7ea3-4213-befa-be689a48eb2a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:36.680393 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c07dd4db-7ea3-4213-befa-be689a48eb2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ff429bea2c4601a08db77313e34110', 'request_id': 'req-c07dd4db-7ea3-4213-befa-be689a48eb2a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:36.688240 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c07dd4db-7ea3-4213-befa-be689a48eb2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ff429bea2c4601a08db77313e34110', 'request_id': 'req-c07dd4db-7ea3-4213-befa-be689a48eb2a'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:36.704270 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c07dd4db-7ea3-4213-befa-be689a48eb2a admin admin] The token cache is being invalidate because project 19ff429bea2c4601a08db77313e34110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:36.704854 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c07dd4db-7ea3-4213-befa-be689a48eb2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:36.705855 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-c07dd4db-7ea3-4213-befa-be689a48eb2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:36.708506 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1440/2895] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:36 2022] DELETE /identity/v3/projects/19ff429bea2c4601a08db77313e34110 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:36.715400 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a78dda-d7a7-47ef-99fa-468e5b55266e None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:36.715689 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a78dda-d7a7-47ef-99fa-468e5b55266e None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:36.715990 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a78dda-d7a7-47ef-99fa-468e5b55266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:36.739817 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-56a78dda-d7a7-47ef-99fa-468e5b55266e None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:36.741076 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-56a78dda-d7a7-47ef-99fa-468e5b55266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:36.804815 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1456/2896] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:36.874015 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f4e1a-5c06-44e6-a346-fc7bb3918d4a None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:36.874295 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f4e1a-5c06-44e6-a346-fc7bb3918d4a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:36.874570 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f4e1a-5c06-44e6-a346-fc7bb3918d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:36.896823 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-1e9f4e1a-5c06-44e6-a346-fc7bb3918d4a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:36.898124 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-1e9f4e1a-5c06-44e6-a346-fc7bb3918d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:36.915991 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1441/2897] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:36.920668 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a78dda-d7a7-47ef-99fa-468e5b55266e None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:36.931302 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a78dda-d7a7-47ef-99fa-468e5b55266e None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:36.936231 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf91418-b305-47cc-8222-90102e42fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:36.936894 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf91418-b305-47cc-8222-90102e42fd04 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:36.937177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf91418-b305-47cc-8222-90102e42fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:36.937463 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf91418-b305-47cc-8222-90102e42fd04 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:36.938119 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf91418-b305-47cc-8222-90102e42fd04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:36.938419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf91418-b305-47cc-8222-90102e42fd04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:36.940055 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf91418-b305-47cc-8222-90102e42fd04 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:36.953537 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1457/2898] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:36.958169 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f4e1a-5c06-44e6-a346-fc7bb3918d4a None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:36.971815 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f4e1a-5c06-44e6-a346-fc7bb3918d4a None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:36.977080 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f79fc-d1e7-4991-ba34-376ac5d3b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:36.977705 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f79fc-d1e7-4991-ba34-376ac5d3b653 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:36.977986 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f79fc-d1e7-4991-ba34-376ac5d3b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:36.978260 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f79fc-d1e7-4991-ba34-376ac5d3b653 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:36.978925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f79fc-d1e7-4991-ba34-376ac5d3b653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:36.980909 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f79fc-d1e7-4991-ba34-376ac5d3b653 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.013418 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1442/2899] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:36 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:37.016023 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf91418-b305-47cc-8222-90102e42fd04 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.027036 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf91418-b305-47cc-8222-90102e42fd04 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.089876 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccc14a-7434-4245-8243-3cc1fcd00f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.090486 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccc14a-7434-4245-8243-3cc1fcd00f26 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.090773 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccc14a-7434-4245-8243-3cc1fcd00f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.091054 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccc14a-7434-4245-8243-3cc1fcd00f26 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.091811 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccc14a-7434-4245-8243-3cc1fcd00f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.093855 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccc14a-7434-4245-8243-3cc1fcd00f26 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.118794 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1458/2900] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:37 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:37.123113 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f79fc-d1e7-4991-ba34-376ac5d3b653 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.135866 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f79fc-d1e7-4991-ba34-376ac5d3b653 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.141775 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac702b-7ee5-4571-94b7-9a7919f1aa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.142463 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac702b-7ee5-4571-94b7-9a7919f1aa67 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.142685 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac702b-7ee5-4571-94b7-9a7919f1aa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.142996 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac702b-7ee5-4571-94b7-9a7919f1aa67 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.143706 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac702b-7ee5-4571-94b7-9a7919f1aa67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.145323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac702b-7ee5-4571-94b7-9a7919f1aa67 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.157168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1443/2901] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:37.161453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccc14a-7434-4245-8243-3cc1fcd00f26 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.172609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccc14a-7434-4245-8243-3cc1fcd00f26 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.180489 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b2146-9ccd-4497-86b5-dd805dbb1ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.181613 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b2146-9ccd-4497-86b5-dd805dbb1ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.181918 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b2146-9ccd-4497-86b5-dd805dbb1ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.182206 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b2146-9ccd-4497-86b5-dd805dbb1ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.182892 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b2146-9ccd-4497-86b5-dd805dbb1ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.184612 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b2146-9ccd-4497-86b5-dd805dbb1ae7 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.200403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1459/2902] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:37.204726 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac702b-7ee5-4571-94b7-9a7919f1aa67 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.217720 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac702b-7ee5-4571-94b7-9a7919f1aa67 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.222495 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499166c-ebb2-4dba-b3b5-2aaa0051cb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.223168 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499166c-ebb2-4dba-b3b5-2aaa0051cb3e admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.223444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499166c-ebb2-4dba-b3b5-2aaa0051cb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.223712 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499166c-ebb2-4dba-b3b5-2aaa0051cb3e admin admin] PATH_INFO: `/v3/projects/d651242c64b945fba1fe46de19156a59/users/84b808f2811e4f9dbcdc9d8c266947e9/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.240363 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499166c-ebb2-4dba-b3b5-2aaa0051cb3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d651242c64b945fba1fe46de19156a59, user_id=84b808f2811e4f9dbcdc9d8c266947e9, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.244004 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499166c-ebb2-4dba-b3b5-2aaa0051cb3e admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.261446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1444/2903] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:37 2022] PUT /identity/v3/projects/d651242c64b945fba1fe46de19156a59/users/84b808f2811e4f9dbcdc9d8c266947e9/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:37.272145 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97aa45-2065-43ad-b42d-80dda5cc9a71 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.272438 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97aa45-2065-43ad-b42d-80dda5cc9a71 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.272720 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97aa45-2065-43ad-b42d-80dda5cc9a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.307253 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-db97aa45-2065-43ad-b42d-80dda5cc9a71 None None] MFA Rules not processed for user `84b808f2811e4f9dbcdc9d8c266947e9`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:37.308656 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-db97aa45-2065-43ad-b42d-80dda5cc9a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:37.326371 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:37.392103 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1460/2904] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:37.397172 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499166c-ebb2-4dba-b3b5-2aaa0051cb3e admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.453581 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:37.466830 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499166c-ebb2-4dba-b3b5-2aaa0051cb3e admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.472950 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba242f-9673-4785-b7a9-71d1d1d6ab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.473503 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba242f-9673-4785-b7a9-71d1d1d6ab44 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.473779 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba242f-9673-4785-b7a9-71d1d1d6ab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.474037 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba242f-9673-4785-b7a9-71d1d1d6ab44 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.474688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba242f-9673-4785-b7a9-71d1d1d6ab44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.477444 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba242f-9673-4785-b7a9-71d1d1d6ab44 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.509323 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1445/2905] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:37 2022] POST /identity/v3/projects => generated 361 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:37.513677 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97aa45-2065-43ad-b42d-80dda5cc9a71 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.526421 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97aa45-2065-43ad-b42d-80dda5cc9a71 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.590609 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89768ac4-94eb-4732-958c-33b9be675e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.591252 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89768ac4-94eb-4732-958c-33b9be675e4f admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.591560 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89768ac4-94eb-4732-958c-33b9be675e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.591763 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89768ac4-94eb-4732-958c-33b9be675e4f admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.592477 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89768ac4-94eb-4732-958c-33b9be675e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.594455 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89768ac4-94eb-4732-958c-33b9be675e4f admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.617697 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1461/2906] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:37 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:37.621977 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba242f-9673-4785-b7a9-71d1d1d6ab44 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.633400 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba242f-9673-4785-b7a9-71d1d1d6ab44 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.639668 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8922b-87cd-4fe8-ba1f-940b1024c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.640302 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8922b-87cd-4fe8-ba1f-940b1024c2cc admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.640776 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8922b-87cd-4fe8-ba1f-940b1024c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.641017 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8922b-87cd-4fe8-ba1f-940b1024c2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.641667 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8922b-87cd-4fe8-ba1f-940b1024c2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.643301 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8922b-87cd-4fe8-ba1f-940b1024c2cc admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.655769 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1446/2907] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:37.660056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89768ac4-94eb-4732-958c-33b9be675e4f admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.671189 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89768ac4-94eb-4732-958c-33b9be675e4f admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.676449 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f70d5-375e-4dfd-a44d-53d943483598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.677109 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f70d5-375e-4dfd-a44d-53d943483598 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.677582 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f70d5-375e-4dfd-a44d-53d943483598 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.677750 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f70d5-375e-4dfd-a44d-53d943483598 admin admin] PATH_INFO: `/v3/projects/0de06cc4ff42474c86eacc55f89499cc/users/8235d0f7c50646d6b4d2e93106099b70/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.696929 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f70d5-375e-4dfd-a44d-53d943483598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de06cc4ff42474c86eacc55f89499cc, user_id=8235d0f7c50646d6b4d2e93106099b70, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.700405 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f70d5-375e-4dfd-a44d-53d943483598 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.715326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1462/2908] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:37 2022] PUT /identity/v3/projects/0de06cc4ff42474c86eacc55f89499cc/users/8235d0f7c50646d6b4d2e93106099b70/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:37.719987 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8922b-87cd-4fe8-ba1f-940b1024c2cc admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.736875 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8922b-87cd-4fe8-ba1f-940b1024c2cc admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.810199 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b1b0a-d639-47ec-af9a-37db1781e250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.810846 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b1b0a-d639-47ec-af9a-37db1781e250 admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.811121 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b1b0a-d639-47ec-af9a-37db1781e250 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.811391 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b1b0a-d639-47ec-af9a-37db1781e250 admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.812044 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b1b0a-d639-47ec-af9a-37db1781e250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.813717 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b1b0a-d639-47ec-af9a-37db1781e250 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.838973 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1447/2909] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:37.844160 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f70d5-375e-4dfd-a44d-53d943483598 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.856175 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f70d5-375e-4dfd-a44d-53d943483598 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.862813 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4a930-8998-4315-9433-46ae2d5f2115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.864345 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4a930-8998-4315-9433-46ae2d5f2115 admin admin] REQUEST_METHOD: `PUT` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.864759 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4a930-8998-4315-9433-46ae2d5f2115 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.865273 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4a930-8998-4315-9433-46ae2d5f2115 admin admin] PATH_INFO: `/v3/projects/0de06cc4ff42474c86eacc55f89499cc/users/8235d0f7c50646d6b4d2e93106099b70/roles/ec4ce60afb404b16a36bbb4974e0bca1` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.870214 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4a930-8998-4315-9433-46ae2d5f2115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de06cc4ff42474c86eacc55f89499cc, user_id=8235d0f7c50646d6b4d2e93106099b70, role_id=ec4ce60afb404b16a36bbb4974e0bca1)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.875446 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4a930-8998-4315-9433-46ae2d5f2115 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.893097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1463/2910] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:37 2022] PUT /identity/v3/projects/0de06cc4ff42474c86eacc55f89499cc/users/8235d0f7c50646d6b4d2e93106099b70/roles/ec4ce60afb404b16a36bbb4974e0bca1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:37.906602 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3586b-72ba-46df-bdd8-f0267c14385e None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.906913 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3586b-72ba-46df-bdd8-f0267c14385e None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.907312 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3586b-72ba-46df-bdd8-f0267c14385e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.942327 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-76b3586b-72ba-46df-bdd8-f0267c14385e None None] MFA Rules not processed for user `8235d0f7c50646d6b4d2e93106099b70`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:37.943598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-76b3586b-72ba-46df-bdd8-f0267c14385e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:38.036911 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1448/2911] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:38.049985 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4a930-8998-4315-9433-46ae2d5f2115 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:38.051910 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-93e4a930-8998-4315-9433-46ae2d5f2115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:38.128414 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4a930-8998-4315-9433-46ae2d5f2115 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:38.132905 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21f64f-3225-42b1-9749-e0d7839f8f79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:38.133821 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21f64f-3225-42b1-9749-e0d7839f8f79 service cinder] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:38.134111 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21f64f-3225-42b1-9749-e0d7839f8f79 service cinder] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:38.134403 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21f64f-3225-42b1-9749-e0d7839f8f79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:38.146282 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21f64f-3225-42b1-9749-e0d7839f8f79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:38.147780 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21f64f-3225-42b1-9749-e0d7839f8f79 service cinder] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:38.158646 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1464/2912] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:38.269161 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3586b-72ba-46df-bdd8-f0267c14385e None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:38.284361 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3586b-72ba-46df-bdd8-f0267c14385e None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:38.289792 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d1ffa-a7cc-404a-b4a4-e6d2a373791d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:38.290509 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d1ffa-a7cc-404a-b4a4-e6d2a373791d service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:38.290790 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d1ffa-a7cc-404a-b4a4-e6d2a373791d service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:38.291081 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d1ffa-a7cc-404a-b4a4-e6d2a373791d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:38.353428 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:38.376544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d1ffa-a7cc-404a-b4a4-e6d2a373791d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:38.379030 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d1ffa-a7cc-404a-b4a4-e6d2a373791d service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:38.394087 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1449/2913] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:43.638792 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21f64f-3225-42b1-9749-e0d7839f8f79 service cinder] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:43.653612 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:43.708776 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21f64f-3225-42b1-9749-e0d7839f8f79 service cinder] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:43.714789 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849bc64-d1fc-4664-b2e5-713cb799c014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:43.715549 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849bc64-d1fc-4664-b2e5-713cb799c014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:43.715861 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849bc64-d1fc-4664-b2e5-713cb799c014 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:43.716170 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849bc64-d1fc-4664-b2e5-713cb799c014 admin admin] PATH_INFO: `/v3/users/84b808f2811e4f9dbcdc9d8c266947e9` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:43.717684 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849bc64-d1fc-4664-b2e5-713cb799c014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b808f2811e4f9dbcdc9d8c266947e9)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:43.719696 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849bc64-d1fc-4664-b2e5-713cb799c014 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:43.774030 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d849bc64-d1fc-4664-b2e5-713cb799c014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b808f2811e4f9dbcdc9d8c266947e9'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:43.774779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d849bc64-d1fc-4664-b2e5-713cb799c014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b808f2811e4f9dbcdc9d8c266947e9'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:43.782557 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d849bc64-d1fc-4664-b2e5-713cb799c014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b808f2811e4f9dbcdc9d8c266947e9'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:43.797383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d849bc64-d1fc-4664-b2e5-713cb799c014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b808f2811e4f9dbcdc9d8c266947e9'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:43.805943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-d849bc64-d1fc-4664-b2e5-713cb799c014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b808f2811e4f9dbcdc9d8c266947e9'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:43.812177 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1465/2914] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:43 2022] DELETE /identity/v3/users/84b808f2811e4f9dbcdc9d8c266947e9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:43.824233 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd9cab-c039-4c25-ba00-558870085565 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:43.824832 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd9cab-c039-4c25-ba00-558870085565 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:43.825056 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd9cab-c039-4c25-ba00-558870085565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:43.846973 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-bafd9cab-c039-4c25-ba00-558870085565 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:43.848233 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-bafd9cab-c039-4c25-ba00-558870085565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:43.931443 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1450/2915] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:43.942678 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849bc64-d1fc-4664-b2e5-713cb799c014 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:43.944478 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-d849bc64-d1fc-4664-b2e5-713cb799c014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:44.020080 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849bc64-d1fc-4664-b2e5-713cb799c014 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:44.023910 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db9d2f-08eb-4516-aa3c-9fe5d041ac02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:44.024621 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db9d2f-08eb-4516-aa3c-9fe5d041ac02 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:44.024931 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db9d2f-08eb-4516-aa3c-9fe5d041ac02 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:44.025192 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db9d2f-08eb-4516-aa3c-9fe5d041ac02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:44.035948 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db9d2f-08eb-4516-aa3c-9fe5d041ac02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:44.037451 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db9d2f-08eb-4516-aa3c-9fe5d041ac02 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:44.047599 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1466/2916] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:44.376446 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd9cab-c039-4c25-ba00-558870085565 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:44.378850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-bafd9cab-c039-4c25-ba00-558870085565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:44.400471 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd9cab-c039-4c25-ba00-558870085565 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:44.405528 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870e38e-7211-4ae0-9eb2-5bd81d918324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:44.405975 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870e38e-7211-4ae0-9eb2-5bd81d918324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:44.406256 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870e38e-7211-4ae0-9eb2-5bd81d918324 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:44.406529 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870e38e-7211-4ae0-9eb2-5bd81d918324 admin admin] PATH_INFO: `/v3/projects/d651242c64b945fba1fe46de19156a59` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:44.407692 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870e38e-7211-4ae0-9eb2-5bd81d918324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d651242c64b945fba1fe46de19156a59)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:44.409664 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870e38e-7211-4ae0-9eb2-5bd81d918324 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:44.469175 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-6870e38e-7211-4ae0-9eb2-5bd81d918324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd651242c64b945fba1fe46de19156a59', 'request_id': 'req-6870e38e-7211-4ae0-9eb2-5bd81d918324'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:44.478177 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-6870e38e-7211-4ae0-9eb2-5bd81d918324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd651242c64b945fba1fe46de19156a59', 'request_id': 'req-6870e38e-7211-4ae0-9eb2-5bd81d918324'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:44.487462 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-6870e38e-7211-4ae0-9eb2-5bd81d918324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd651242c64b945fba1fe46de19156a59', 'request_id': 'req-6870e38e-7211-4ae0-9eb2-5bd81d918324'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:44.503046 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-6870e38e-7211-4ae0-9eb2-5bd81d918324 admin admin] The token cache is being invalidate because project d651242c64b945fba1fe46de19156a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:44.503360 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-6870e38e-7211-4ae0-9eb2-5bd81d918324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:44.504269 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-6870e38e-7211-4ae0-9eb2-5bd81d918324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:44.506453 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1451/2917] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:44 2022] DELETE /identity/v3/projects/d651242c64b945fba1fe46de19156a59 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:44.510932 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db9d2f-08eb-4516-aa3c-9fe5d041ac02 service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:44.521503 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db9d2f-08eb-4516-aa3c-9fe5d041ac02 service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:44.560700 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:44.598681 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bdbdf-9a79-4ee4-8cdf-8628f329d0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:44.599540 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bdbdf-9a79-4ee4-8cdf-8628f329d0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:44.599877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bdbdf-9a79-4ee4-8cdf-8628f329d0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:44.600200 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bdbdf-9a79-4ee4-8cdf-8628f329d0bc admin admin] PATH_INFO: `/v3/users/8235d0f7c50646d6b4d2e93106099b70` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:44.601845 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bdbdf-9a79-4ee4-8cdf-8628f329d0bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8235d0f7c50646d6b4d2e93106099b70)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:44.603851 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bdbdf-9a79-4ee4-8cdf-8628f329d0bc admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:44.665853 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c78bdbdf-9a79-4ee4-8cdf-8628f329d0bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8235d0f7c50646d6b4d2e93106099b70'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:44.666523 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c78bdbdf-9a79-4ee4-8cdf-8628f329d0bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8235d0f7c50646d6b4d2e93106099b70'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:44.675051 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c78bdbdf-9a79-4ee4-8cdf-8628f329d0bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8235d0f7c50646d6b4d2e93106099b70'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:44.691291 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c78bdbdf-9a79-4ee4-8cdf-8628f329d0bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8235d0f7c50646d6b4d2e93106099b70'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:44.701317 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-c78bdbdf-9a79-4ee4-8cdf-8628f329d0bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8235d0f7c50646d6b4d2e93106099b70'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:44.708310 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1467/2918] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:44 2022] DELETE /identity/v3/users/8235d0f7c50646d6b4d2e93106099b70 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:45.043066 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870e38e-7211-4ae0-9eb2-5bd81d918324 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:45.045778 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6870e38e-7211-4ae0-9eb2-5bd81d918324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:45.065376 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870e38e-7211-4ae0-9eb2-5bd81d918324 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:45.131293 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251de4db-80a3-422c-b8bb-188807e00219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:45.132128 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251de4db-80a3-422c-b8bb-188807e00219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:45.132441 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251de4db-80a3-422c-b8bb-188807e00219 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:45.132718 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251de4db-80a3-422c-b8bb-188807e00219 admin admin] PATH_INFO: `/v3/projects/0de06cc4ff42474c86eacc55f89499cc` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:45.134263 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251de4db-80a3-422c-b8bb-188807e00219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0de06cc4ff42474c86eacc55f89499cc)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:45.136264 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251de4db-80a3-422c-b8bb-188807e00219 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:45.148670 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:45.198815 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-251de4db-80a3-422c-b8bb-188807e00219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0de06cc4ff42474c86eacc55f89499cc', 'request_id': 'req-251de4db-80a3-422c-b8bb-188807e00219'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:45.208840 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-251de4db-80a3-422c-b8bb-188807e00219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0de06cc4ff42474c86eacc55f89499cc', 'request_id': 'req-251de4db-80a3-422c-b8bb-188807e00219'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:45.215383 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-251de4db-80a3-422c-b8bb-188807e00219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0de06cc4ff42474c86eacc55f89499cc', 'request_id': 'req-251de4db-80a3-422c-b8bb-188807e00219'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:45.228242 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-251de4db-80a3-422c-b8bb-188807e00219 admin admin] The token cache is being invalidate because project 0de06cc4ff42474c86eacc55f89499cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:45.228601 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-251de4db-80a3-422c-b8bb-188807e00219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:45.230178 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-251de4db-80a3-422c-b8bb-188807e00219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:45.232125 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1452/2919] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:45 2022] DELETE /identity/v3/projects/0de06cc4ff42474c86eacc55f89499cc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:45.238186 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1da65-4bc9-42c1-abc1-4173374a2402 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:45.238514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1da65-4bc9-42c1-abc1-4173374a2402 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:45.238792 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1da65-4bc9-42c1-abc1-4173374a2402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:45.262497 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-e1b1da65-4bc9-42c1-abc1-4173374a2402 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:45.263735 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-e1b1da65-4bc9-42c1-abc1-4173374a2402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:45.338473 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1468/2920] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:45.349798 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d411d-6e6d-492f-8724-ad53558dfe3a None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:45.350077 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d411d-6e6d-492f-8724-ad53558dfe3a None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:45.350445 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d411d-6e6d-492f-8724-ad53558dfe3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:45.381120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-963d411d-6e6d-492f-8724-ad53558dfe3a None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:45.382451 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-963d411d-6e6d-492f-8724-ad53558dfe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:45.394388 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1453/2921] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:45.399291 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1da65-4bc9-42c1-abc1-4173374a2402 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:45.409883 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1da65-4bc9-42c1-abc1-4173374a2402 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:45.414889 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047fbe2-ca72-40a9-b611-bf32eafce379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:45.415509 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047fbe2-ca72-40a9-b611-bf32eafce379 admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:45.415793 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047fbe2-ca72-40a9-b611-bf32eafce379 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:45.416064 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047fbe2-ca72-40a9-b611-bf32eafce379 admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:45.416796 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047fbe2-ca72-40a9-b611-bf32eafce379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:45.417102 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047fbe2-ca72-40a9-b611-bf32eafce379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:45.418752 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047fbe2-ca72-40a9-b611-bf32eafce379 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:45.438410 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1469/2922] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:20:45.443742 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d411d-6e6d-492f-8724-ad53558dfe3a None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:45.454504 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d411d-6e6d-492f-8724-ad53558dfe3a None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:45.461234 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd6841-2402-4ac1-bcb9-c5271d60cb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:45.464533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd6841-2402-4ac1-bcb9-c5271d60cb53 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:45.464533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd6841-2402-4ac1-bcb9-c5271d60cb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:45.464533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd6841-2402-4ac1-bcb9-c5271d60cb53 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:45.464533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd6841-2402-4ac1-bcb9-c5271d60cb53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:45.468214 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd6841-2402-4ac1-bcb9-c5271d60cb53 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:45.515339 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1454/2923] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:45 2022] POST /identity/v3/projects => generated 363 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:45.525056 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047fbe2-ca72-40a9-b611-bf32eafce379 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:45.544084 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047fbe2-ca72-40a9-b611-bf32eafce379 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:45.602658 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:45.631688 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f53b62-fe6d-41d3-9c74-1f1c997a073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:45.632500 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f53b62-fe6d-41d3-9c74-1f1c997a073d admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:45.632923 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f53b62-fe6d-41d3-9c74-1f1c997a073d admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:45.633513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f53b62-fe6d-41d3-9c74-1f1c997a073d admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:45.634272 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f53b62-fe6d-41d3-9c74-1f1c997a073d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:45.636312 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f53b62-fe6d-41d3-9c74-1f1c997a073d admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:45.665326 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1470/2924] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:45 2022] POST /identity/v3/users => generated 282 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:45.670657 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd6841-2402-4ac1-bcb9-c5271d60cb53 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:45.685512 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd6841-2402-4ac1-bcb9-c5271d60cb53 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:45.691604 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d729c-7368-42b1-81ab-b5cf71c28a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:45.692489 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d729c-7368-42b1-81ab-b5cf71c28a9b admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:45.692679 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d729c-7368-42b1-81ab-b5cf71c28a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:45.692850 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d729c-7368-42b1-81ab-b5cf71c28a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:45.693687 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d729c-7368-42b1-81ab-b5cf71c28a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:45.695596 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d729c-7368-42b1-81ab-b5cf71c28a9b admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:45.709088 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1455/2925] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:45.715610 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f53b62-fe6d-41d3-9c74-1f1c997a073d admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:45.732761 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f53b62-fe6d-41d3-9c74-1f1c997a073d admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:45.739419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb23a2-d10c-4a6c-943f-2bc47793900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:45.740091 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb23a2-d10c-4a6c-943f-2bc47793900b admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:45.740410 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb23a2-d10c-4a6c-943f-2bc47793900b admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:45.740766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb23a2-d10c-4a6c-943f-2bc47793900b admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:45.741910 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb23a2-d10c-4a6c-943f-2bc47793900b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:45.743552 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb23a2-d10c-4a6c-943f-2bc47793900b admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:45.755554 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1471/2926] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:45.760544 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d729c-7368-42b1-81ab-b5cf71c28a9b admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:45.773067 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d729c-7368-42b1-81ab-b5cf71c28a9b admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:45.778962 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0374c4-286d-4f87-bdf0-f11d5edb6f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:45.779787 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0374c4-286d-4f87-bdf0-f11d5edb6f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:45.780116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0374c4-286d-4f87-bdf0-f11d5edb6f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:45.780493 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0374c4-286d-4f87-bdf0-f11d5edb6f19 admin admin] PATH_INFO: `/v3/projects/88f36a05ae554ffab2a51c021f8ff486/users/fe70c50569914f5f8c5af48b76d46bcd/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:45.801736 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0374c4-286d-4f87-bdf0-f11d5edb6f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f36a05ae554ffab2a51c021f8ff486, user_id=fe70c50569914f5f8c5af48b76d46bcd, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:45.807120 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0374c4-286d-4f87-bdf0-f11d5edb6f19 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:45.830432 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1456/2927] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:45 2022] PUT /identity/v3/projects/88f36a05ae554ffab2a51c021f8ff486/users/fe70c50569914f5f8c5af48b76d46bcd/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:45.841887 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32ca1a-b420-4fc1-8739-dd008208d368 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:45.842191 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32ca1a-b420-4fc1-8739-dd008208d368 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:45.842513 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32ca1a-b420-4fc1-8739-dd008208d368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:45.881328 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-be32ca1a-b420-4fc1-8739-dd008208d368 None None] MFA Rules not processed for user `fe70c50569914f5f8c5af48b76d46bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:45.881328 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-be32ca1a-b420-4fc1-8739-dd008208d368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:45.998592 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1472/2928] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:20:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:46.011424 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0374c4-286d-4f87-bdf0-f11d5edb6f19 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:46.013857 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-6a0374c4-286d-4f87-bdf0-f11d5edb6f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:46.095744 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0374c4-286d-4f87-bdf0-f11d5edb6f19 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:46.099899 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69f941-ab52-4d80-8571-e97c638bfeb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:46.101218 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69f941-ab52-4d80-8571-e97c638bfeb2 service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:46.101525 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69f941-ab52-4d80-8571-e97c638bfeb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:46.101798 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69f941-ab52-4d80-8571-e97c638bfeb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:46.121020 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69f941-ab52-4d80-8571-e97c638bfeb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:46.123621 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69f941-ab52-4d80-8571-e97c638bfeb2 service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:46.138811 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1457/2929] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:55.992616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=48,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:56.132132 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:17.599010 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32ca1a-b420-4fc1-8739-dd008208d368 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:17.683420 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32ca1a-b420-4fc1-8739-dd008208d368 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:17.688725 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e28ff7-5caf-40bc-a411-82ee6a916e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:17.689383 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e28ff7-5caf-40bc-a411-82ee6a916e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:17.689784 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e28ff7-5caf-40bc-a411-82ee6a916e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:17.690240 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e28ff7-5caf-40bc-a411-82ee6a916e8b admin admin] PATH_INFO: `/v3/users/fe70c50569914f5f8c5af48b76d46bcd` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:17.691943 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e28ff7-5caf-40bc-a411-82ee6a916e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe70c50569914f5f8c5af48b76d46bcd)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:17.697156 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e28ff7-5caf-40bc-a411-82ee6a916e8b admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:17.763417 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-f1e28ff7-5caf-40bc-a411-82ee6a916e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe70c50569914f5f8c5af48b76d46bcd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:17.764238 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-f1e28ff7-5caf-40bc-a411-82ee6a916e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe70c50569914f5f8c5af48b76d46bcd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:17.773815 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-f1e28ff7-5caf-40bc-a411-82ee6a916e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe70c50569914f5f8c5af48b76d46bcd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:17.795099 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-f1e28ff7-5caf-40bc-a411-82ee6a916e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe70c50569914f5f8c5af48b76d46bcd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:17.807359 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-f1e28ff7-5caf-40bc-a411-82ee6a916e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe70c50569914f5f8c5af48b76d46bcd'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:17.821562 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1473/2930] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:17 2022] DELETE /identity/v3/users/fe70c50569914f5f8c5af48b76d46bcd => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:17.827725 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacee40-b036-40fe-b7a1-dfd5261993ee None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:17.828465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacee40-b036-40fe-b7a1-dfd5261993ee None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:17.828465 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacee40-b036-40fe-b7a1-dfd5261993ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:17.860863 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-ffacee40-b036-40fe-b7a1-dfd5261993ee None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:17.862170 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ffacee40-b036-40fe-b7a1-dfd5261993ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:17.940758 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1458/2931] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:17.951589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e28ff7-5caf-40bc-a411-82ee6a916e8b admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:17.953494 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-f1e28ff7-5caf-40bc-a411-82ee6a916e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:18.039117 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e28ff7-5caf-40bc-a411-82ee6a916e8b admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:18.043097 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d22f51-85fd-4b8d-b36e-64ce509bbf3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:18.043820 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d22f51-85fd-4b8d-b36e-64ce509bbf3b service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.044101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d22f51-85fd-4b8d-b36e-64ce509bbf3b service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.044389 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d22f51-85fd-4b8d-b36e-64ce509bbf3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.055391 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d22f51-85fd-4b8d-b36e-64ce509bbf3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:18.056958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d22f51-85fd-4b8d-b36e-64ce509bbf3b service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:18.072101 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1474/2932] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:18.435682 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacee40-b036-40fe-b7a1-dfd5261993ee None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:18.438148 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-ffacee40-b036-40fe-b7a1-dfd5261993ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:18.451167 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacee40-b036-40fe-b7a1-dfd5261993ee None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:18.456205 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb62230-450a-42d3-98aa-71c8ba416db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:18.456926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb62230-450a-42d3-98aa-71c8ba416db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.457526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb62230-450a-42d3-98aa-71c8ba416db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.457755 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb62230-450a-42d3-98aa-71c8ba416db8 admin admin] PATH_INFO: `/v3/projects/88f36a05ae554ffab2a51c021f8ff486` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.459101 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb62230-450a-42d3-98aa-71c8ba416db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f36a05ae554ffab2a51c021f8ff486)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:18.461223 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb62230-450a-42d3-98aa-71c8ba416db8 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:18.533006 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8bb62230-450a-42d3-98aa-71c8ba416db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f36a05ae554ffab2a51c021f8ff486', 'request_id': 'req-8bb62230-450a-42d3-98aa-71c8ba416db8'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:18.544606 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8bb62230-450a-42d3-98aa-71c8ba416db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f36a05ae554ffab2a51c021f8ff486', 'request_id': 'req-8bb62230-450a-42d3-98aa-71c8ba416db8'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:18.553115 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8bb62230-450a-42d3-98aa-71c8ba416db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f36a05ae554ffab2a51c021f8ff486', 'request_id': 'req-8bb62230-450a-42d3-98aa-71c8ba416db8'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:18.566565 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8bb62230-450a-42d3-98aa-71c8ba416db8 admin admin] The token cache is being invalidate because project 88f36a05ae554ffab2a51c021f8ff486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:18.566963 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8bb62230-450a-42d3-98aa-71c8ba416db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:18.567534 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-8bb62230-450a-42d3-98aa-71c8ba416db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:18.569116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1459/2933] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:18 2022] DELETE /identity/v3/projects/88f36a05ae554ffab2a51c021f8ff486 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:18.574208 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ee752-7fe7-4a4a-955d-c13346e16151 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.574501 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ee752-7fe7-4a4a-955d-c13346e16151 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.574766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ee752-7fe7-4a4a-955d-c13346e16151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.605220 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-987ee752-7fe7-4a4a-955d-c13346e16151 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:18.607179 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-987ee752-7fe7-4a4a-955d-c13346e16151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:18.631390 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:18.702568 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1475/2934] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:18.711533 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4945ff-37f6-4b7d-9f6e-a558f29abf51 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.711928 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4945ff-37f6-4b7d-9f6e-a558f29abf51 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.712071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4945ff-37f6-4b7d-9f6e-a558f29abf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.747280 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-3d4945ff-37f6-4b7d-9f6e-a558f29abf51 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:18.748594 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-3d4945ff-37f6-4b7d-9f6e-a558f29abf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:18.759271 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1460/2935] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:18.763856 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ee752-7fe7-4a4a-955d-c13346e16151 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:18.777183 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ee752-7fe7-4a4a-955d-c13346e16151 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:18.783480 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90160609-3937-4a3c-b545-5caf044b48cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:18.784251 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90160609-3937-4a3c-b545-5caf044b48cc admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.784605 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90160609-3937-4a3c-b545-5caf044b48cc admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.784877 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90160609-3937-4a3c-b545-5caf044b48cc admin admin] PATH_INFO: `/v3/domains` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.785638 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90160609-3937-4a3c-b545-5caf044b48cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:21:18.786378 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90160609-3937-4a3c-b545-5caf044b48cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:18.787620 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90160609-3937-4a3c-b545-5caf044b48cc admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:18.802368 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1476/2936] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Sep 7 13:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:21:18.807040 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4945ff-37f6-4b7d-9f6e-a558f29abf51 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:18.818071 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4945ff-37f6-4b7d-9f6e-a558f29abf51 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:18.824064 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f086ef-e493-46f5-81e5-584658cda076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:18.824733 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f086ef-e493-46f5-81e5-584658cda076 admin admin] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.825007 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f086ef-e493-46f5-81e5-584658cda076 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.825278 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f086ef-e493-46f5-81e5-584658cda076 admin admin] PATH_INFO: `/v3/projects` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.825952 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f086ef-e493-46f5-81e5-584658cda076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:18.827925 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f086ef-e493-46f5-81e5-584658cda076 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:18.868234 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1461/2937] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Sep 7 13:21:18 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:18.872589 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90160609-3937-4a3c-b545-5caf044b48cc admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:18.883790 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90160609-3937-4a3c-b545-5caf044b48cc admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:18.965804 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6015-8076-4a76-a5a4-881eda4e9371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:18.966550 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6015-8076-4a76-a5a4-881eda4e9371 admin admin] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.966871 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6015-8076-4a76-a5a4-881eda4e9371 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.967195 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6015-8076-4a76-a5a4-881eda4e9371 admin admin] PATH_INFO: `/v3/users` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.967900 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b6015-8076-4a76-a5a4-881eda4e9371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:18.970085 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b6015-8076-4a76-a5a4-881eda4e9371 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:18.995673 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1477/2938] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Sep 7 13:21:18 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:19.000294 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f086ef-e493-46f5-81e5-584658cda076 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:19.013451 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f086ef-e493-46f5-81e5-584658cda076 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:19.018767 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882177d-7b13-4cb2-b4ac-165ca43393ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:19.019521 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882177d-7b13-4cb2-b4ac-165ca43393ad admin admin] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:19.019887 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882177d-7b13-4cb2-b4ac-165ca43393ad admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:19.020215 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882177d-7b13-4cb2-b4ac-165ca43393ad admin admin] PATH_INFO: `/v3/roles` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:19.021089 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882177d-7b13-4cb2-b4ac-165ca43393ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:19.023116 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882177d-7b13-4cb2-b4ac-165ca43393ad admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:19.035017 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1462/2939] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:19.039766 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6015-8076-4a76-a5a4-881eda4e9371 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:19.051457 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6015-8076-4a76-a5a4-881eda4e9371 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:19.057385 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ec555-9a63-4629-b609-011e50cc775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:19.058100 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ec555-9a63-4629-b609-011e50cc775b admin admin] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:19.058514 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ec555-9a63-4629-b609-011e50cc775b admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:19.058949 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ec555-9a63-4629-b609-011e50cc775b admin admin] PATH_INFO: `/v3/roles` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:19.059870 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ec555-9a63-4629-b609-011e50cc775b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:19.062419 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ec555-9a63-4629-b609-011e50cc775b admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:19.082048 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1478/2940] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:19.089146 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882177d-7b13-4cb2-b4ac-165ca43393ad admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:19.104143 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882177d-7b13-4cb2-b4ac-165ca43393ad admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:19.110889 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ef806-7cc8-4986-a59b-7508d736c0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:19.111844 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ef806-7cc8-4986-a59b-7508d736c0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:19.112172 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ef806-7cc8-4986-a59b-7508d736c0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:19.112502 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ef806-7cc8-4986-a59b-7508d736c0e4 admin admin] PATH_INFO: `/v3/projects/7531b1e33ec84be08bc70d594416e851/users/0fea2d3a345d48548a2b4d13df303ba7/roles/30891346cde644e7bd9ae90a3876efc8` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:19.132777 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ef806-7cc8-4986-a59b-7508d736c0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7531b1e33ec84be08bc70d594416e851, user_id=0fea2d3a345d48548a2b4d13df303ba7, role_id=30891346cde644e7bd9ae90a3876efc8)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:19.135283 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ef806-7cc8-4986-a59b-7508d736c0e4 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:19.151569 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1463/2941] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:19 2022] PUT /identity/v3/projects/7531b1e33ec84be08bc70d594416e851/users/0fea2d3a345d48548a2b4d13df303ba7/roles/30891346cde644e7bd9ae90a3876efc8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:19.163017 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71091ce2-19eb-4a66-a3b1-0eea0e5e1c52 None None] REQUEST_METHOD: `POST` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:19.163453 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71091ce2-19eb-4a66-a3b1-0eea0e5e1c52 None None] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:19.163841 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71091ce2-19eb-4a66-a3b1-0eea0e5e1c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:19.204396 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.auth.core [None req-71091ce2-19eb-4a66-a3b1-0eea0e5e1c52 None None] MFA Rules not processed for user `0fea2d3a345d48548a2b4d13df303ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=104922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:19.205695 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-71091ce2-19eb-4a66-a3b1-0eea0e5e1c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:19.305723 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1479/2942] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:21:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:21:19.324123 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ef806-7cc8-4986-a59b-7508d736c0e4 admin admin] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:19.326112 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-cb2ef806-7cc8-4986-a59b-7508d736c0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:19.354653 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:19.416357 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ef806-7cc8-4986-a59b-7508d736c0e4 admin admin] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:19.420901 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8571f68-b73f-4331-9d6b-bec6f9e66456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4089419bb88e4aeda23bf141370cb6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:19.421630 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8571f68-b73f-4331-9d6b-bec6f9e66456 service cinder] REQUEST_METHOD: `GET` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:19.421931 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8571f68-b73f-4331-9d6b-bec6f9e66456 service cinder] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:19.422198 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8571f68-b73f-4331-9d6b-bec6f9e66456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:19.435747 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8571f68-b73f-4331-9d6b-bec6f9e66456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:19.437359 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8571f68-b73f-4331-9d6b-bec6f9e66456 service cinder] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:19.451145 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1464/2943] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:19.484955 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71091ce2-19eb-4a66-a3b1-0eea0e5e1c52 None None] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:19.512675 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:19.567755 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71091ce2-19eb-4a66-a3b1-0eea0e5e1c52 None None] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:19.573852 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e2a3f-2a67-4d14-a005-06981d8e3fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:19.574588 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e2a3f-2a67-4d14-a005-06981d8e3fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:19.574958 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e2a3f-2a67-4d14-a005-06981d8e3fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:19.575306 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e2a3f-2a67-4d14-a005-06981d8e3fe7 admin admin] PATH_INFO: `/v3/users/0fea2d3a345d48548a2b4d13df303ba7` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:19.576718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e2a3f-2a67-4d14-a005-06981d8e3fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fea2d3a345d48548a2b4d13df303ba7)` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:19.578975 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e2a3f-2a67-4d14-a005-06981d8e3fe7 admin admin] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:19.650928 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-653e2a3f-2a67-4d14-a005-06981d8e3fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fea2d3a345d48548a2b4d13df303ba7'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:19.651762 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-653e2a3f-2a67-4d14-a005-06981d8e3fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fea2d3a345d48548a2b4d13df303ba7'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:19.672616 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-653e2a3f-2a67-4d14-a005-06981d8e3fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fea2d3a345d48548a2b4d13df303ba7'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:19.688774 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-653e2a3f-2a67-4d14-a005-06981d8e3fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fea2d3a345d48548a2b4d13df303ba7'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:19.699696 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.notifications [None req-653e2a3f-2a67-4d14-a005-06981d8e3fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fea2d3a345d48548a2b4d13df303ba7'} {{(pid=104922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:19.709779 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1480/2944] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:19 2022] DELETE /identity/v3/users/0fea2d3a345d48548a2b4d13df303ba7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:19.715921 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21428e-8b7d-4738-820a-ecfd72715a39 None None] REQUEST_METHOD: `POST` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:19.716394 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21428e-8b7d-4738-820a-ecfd72715a39 None None] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:19.716805 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21428e-8b7d-4738-820a-ecfd72715a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:19.742051 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.auth.core [None req-4f21428e-8b7d-4738-820a-ecfd72715a39 None None] MFA Rules not processed for user `28cc602f739f4f2fbcd0f584e9147da4`. Rule list: `[]` (Enabled: `True`). {{(pid=104921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:19.743344 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4f21428e-8b7d-4738-820a-ecfd72715a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:19.842904 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1465/2945] 10.222.0.30 () {58 vars in 958 bytes} [Wed Sep 7 13:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:19.856401 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e2a3f-2a67-4d14-a005-06981d8e3fe7 admin admin] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:19.858095 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-653e2a3f-2a67-4d14-a005-06981d8e3fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:19.963174 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e2a3f-2a67-4d14-a005-06981d8e3fe7 admin admin] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:19.968128 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bf2d0-c990-4adb-bd90-bb95df89b696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eefd1293a22848e3b595e54be0455d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:19.968976 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bf2d0-c990-4adb-bd90-bb95df89b696 service neutron] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:19.969356 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bf2d0-c990-4adb-bd90-bb95df89b696 service neutron] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:19.969722 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bf2d0-c990-4adb-bd90-bb95df89b696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:19.981244 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bf2d0-c990-4adb-bd90-bb95df89b696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:19.983009 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bf2d0-c990-4adb-bd90-bb95df89b696 service neutron] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:19.996081 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1481/2946] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:21:20.409598 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21428e-8b7d-4738-820a-ecfd72715a39 None None] Authenticating user token {{(pid=104921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:20.411233 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.fernet_utils [None req-4f21428e-8b7d-4738-820a-ecfd72715a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:20.424127 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21428e-8b7d-4738-820a-ecfd72715a39 None None] Validating token access rules against request {{(pid=104921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:20.438926 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f1d53-da00-412a-9a92-7b1ecaae5e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28cc602f739f4f2fbcd0f584e9147da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3af01406fe7484583db161921c3b6ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:20.439526 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f1d53-da00-412a-9a92-7b1ecaae5e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:20.439807 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f1d53-da00-412a-9a92-7b1ecaae5e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:20.440049 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f1d53-da00-412a-9a92-7b1ecaae5e13 admin admin] PATH_INFO: `/v3/projects/7531b1e33ec84be08bc70d594416e851` {{(pid=104921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:20.441820 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f1d53-da00-412a-9a92-7b1ecaae5e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7531b1e33ec84be08bc70d594416e851)` {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:20.443872 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f1d53-da00-412a-9a92-7b1ecaae5e13 admin admin] RBAC: Authorization granted {{(pid=104921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:20.512343 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-362f1d53-da00-412a-9a92-7b1ecaae5e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7531b1e33ec84be08bc70d594416e851', 'request_id': 'req-362f1d53-da00-412a-9a92-7b1ecaae5e13'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:20.522688 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-362f1d53-da00-412a-9a92-7b1ecaae5e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7531b1e33ec84be08bc70d594416e851', 'request_id': 'req-362f1d53-da00-412a-9a92-7b1ecaae5e13'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:20.530467 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-362f1d53-da00-412a-9a92-7b1ecaae5e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7531b1e33ec84be08bc70d594416e851', 'request_id': 'req-362f1d53-da00-412a-9a92-7b1ecaae5e13'} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:20.545310 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-362f1d53-da00-412a-9a92-7b1ecaae5e13 admin admin] The token cache is being invalidate because project 7531b1e33ec84be08bc70d594416e851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:20.545603 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-362f1d53-da00-412a-9a92-7b1ecaae5e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:20.546348 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG keystone.notifications [None req-362f1d53-da00-412a-9a92-7b1ecaae5e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:20.547898 dv-cinder-853315-7-smb devstack@keystone.service[104921]: [pid: 104921|app: 0|req: 1466/2947] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:20 2022] DELETE /identity/v3/projects/7531b1e33ec84be08bc70d594416e851 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:29.989942 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:30.540709 dv-cinder-853315-7-smb devstack@keystone.service[104921]: DEBUG dbcounter [-] [104921] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:21.087106 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bf2d0-c990-4adb-bd90-bb95df89b696 service neutron] Authenticating user token {{(pid=104922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:21.089493 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-3a3bf2d0-c990-4adb-bd90-bb95df89b696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:21.172718 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bf2d0-c990-4adb-bd90-bb95df89b696 service neutron] Validating token access rules against request {{(pid=104922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:21.247685 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e2a0c-9187-4aa6-b958-fb17717a3601 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2420def47ee4a5b8cf4373252583d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3381c0688581489b903e641f91914839', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:21.248466 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e2a0c-9187-4aa6-b958-fb17717a3601 service placement] REQUEST_METHOD: `GET` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:21.248661 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e2a0c-9187-4aa6-b958-fb17717a3601 service placement] SCRIPT_NAME: `/identity` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:21.248934 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e2a0c-9187-4aa6-b958-fb17717a3601 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:21.251258 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.fernet_utils [None req-552e2a0c-9187-4aa6-b958-fb17717a3601 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:21.271309 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e2a0c-9187-4aa6-b958-fb17717a3601 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:21.278781 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e2a0c-9187-4aa6-b958-fb17717a3601 service placement] RBAC: Authorization granted {{(pid=104922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:21.292038 dv-cinder-853315-7-smb devstack@keystone.service[104922]: [pid: 104922|app: 0|req: 1482/2948] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Sep 7 13:22:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:22:31.285979 dv-cinder-853315-7-smb devstack@keystone.service[104922]: DEBUG dbcounter [-] [104922] Writing DB stats keystone:SELECT=58 {{(pid=104922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}